00000400:00080000:3.0F:1783073988.125823:0:83661:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1783073988.83262 00010000:02000000:1.0F:1783073988.126102:0:83262:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:02, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:1.0:1783073988.142910:0:83262:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc7ad3e10 00100000:10000000:1.0:1783073988.142923:0:83262:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0F:1783073988.143397:0:83250:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x4b0:0x0] 00000100:00100000:0.0:1783073988.143452:0:83250:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83250:1869685723452928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0F:1783073988.143474:0:83248:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:2.0:1783073988.143507:0:83248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d2328a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83248:1869685723453056:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783073988.143542:0:83250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073988.143578:0:83250:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c55e6240 going to sleep for 20 seconds 00000100:00100000:2.0:1783073988.143579:0:83248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073988.143604:0:83248:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a3d80 going to sleep for 20 seconds 00000100:00100000:0.0:1783073988.143606:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723452928 00000100:00100000:0.0:1783073988.143613:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723452928 00000100:00100000:2.0:1783073988.143633:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453056 00000100:00100000:2.0:1783073988.143638:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453056 00000100:00080000:1.0:1783073988.143645:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783073988.143650:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783073988.143670:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4860 00000100:00100000:0.0:1783073988.143682:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83250:x1869685723452928:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783073988.143685:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4861 00000020:02000000:0.0:1783073988.143692:0:26171:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783073988.143700:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83248:x1869685723453056:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1783073988.143706:0:17659:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1783073988.143719:0:26171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -529 00002000:00080000:1.0:1783073988.143724:0:17659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -31 00002000:02000040:0.0:1783073988.143727:0:26171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1201 to 0x2c0000401:1729) 00002000:02000040:1.0:1783073988.143730:0:17659:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1729) 00002000:00010000:0.0:1783073988.143771:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.143779:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143794:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.143798:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.143803:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143818:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143828:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143836:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143873:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.143963:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.143969:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143976:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.143979:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.143983:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143991:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.143998:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144005:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144026:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783073988.144050:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783073988.144058:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144068:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086cc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.144073:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.144078:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.144083:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144085:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144105:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.144112:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144116:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.144126:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144128:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ac4ba5/0x5fb609b3016de2cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144162:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144164:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.144170:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144177:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144182:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086da00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.144187:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144196:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144206:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144207:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.144222:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144230:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed3029d1/0x5fb609b3016de2d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144245:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.144249:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.144255:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.144256:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.144262:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144264:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144281:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144282:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.144289:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.144298:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144302:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144350:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adfeeda7/0x5fb609b3016de2da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144365:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144373:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.144376:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.144376:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.144379:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.144392:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144412:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.144449:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.144454:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144462:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.144466:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.144470:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144480:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144487:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144494:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144509:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783073988.144515:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783073988.144523:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144533:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086ca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.144537:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144545:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.144546:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.144557:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144564:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144581:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.144582:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d77fac8/0x5fb609b3016de2e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144587:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.144596:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144608:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144609:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.144616:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144620:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144625:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086ce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.144631:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144634:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144646:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144651:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.144674:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144682:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eea3895/0x5fb609b3016de2e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.144691:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.144699:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.144699:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144706:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144712:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.144719:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.144720:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783073988.144724:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144727:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144737:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144742:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144751:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144773:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e02337/0x5fb609b3016de2ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144777:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144789:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.144789:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144793:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.144800:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.144803:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.144809:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144816:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.144820:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144829:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.144840:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.144841:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144851:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144855:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005792c933/0x5fb609b3016de2f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144863:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.144868:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.144872:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.144873:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.144877:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.144880:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.144888:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144895:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144901:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144926:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.144964:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.144969:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144977:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.144979:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.144988:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.144998:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145006:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145013:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145021:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783073988.145050:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1783073988.145056:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.145058:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145064:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145070:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.145075:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145078:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.145085:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145088:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.145097:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145104:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145109:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145115:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cac991f1/0x5fb609b3016de2fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145125:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145134:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145139:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.145143:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.145144:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145154:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.145165:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145175:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.145188:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.145189:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145200:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145202:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fe45157/0x5fb609b3016de304 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145221:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.145226:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.145230:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.145231:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145235:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145249:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.145249:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145255:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145266:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145270:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145291:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145295:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145299:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.145307:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016de30b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145368:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1783073988.145368:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.145373:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145376:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145386:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.145389:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.145397:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145398:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.145404:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145414:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145417:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145435:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145440:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145447:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145453:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de312 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145463:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.145471:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.145476:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145483:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.145486:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.145503:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.145507:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145510:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145519:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145530:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.145532:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de319 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145533:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783073988.145540:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.145541:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145548:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.145555:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.145556:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.145557:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.145559:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.145564:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.145570:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145580:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145596:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.145603:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.145608:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145614:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.145621:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145627:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145636:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.145639:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.145641:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016de320 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145649:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145659:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.145660:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.145662:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.145665:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.145669:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.145675:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145685:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145704:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145711:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145728:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.145760:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.145765:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145772:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.145775:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.145779:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145788:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145796:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145801:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145823:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783073988.145858:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.145862:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145867:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.145869:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783073988.145871:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783073988.145873:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145878:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145881:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145895:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.145897:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145900:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145905:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145922:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145926:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783073988.145940:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.145953:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.145956:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de327 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145960:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145971:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.145975:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783073988.145979:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.145983:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.145993:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.145994:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.146000:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146011:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146013:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146033:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146038:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146045:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.146046:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146054:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146055:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de32e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146068:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.146080:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.146084:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146087:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.146095:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146107:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146108:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.146113:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.146126:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146128:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.146137:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.146142:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146145:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.146158:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de335 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146158:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146160:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146191:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146193:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146196:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.146200:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.146203:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.146217:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de33c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146217:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146220:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.146226:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.146237:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146238:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.146241:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.146245:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.146379:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.146418:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.146423:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146431:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.146433:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.146436:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146444:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146452:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146459:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146477:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783073988.146508:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:0.0:1783073988.146510:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.146513:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146516:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146520:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.146525:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146531:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.146539:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783073988.146542:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146543:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146566:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146570:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146572:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146577:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146600:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de343 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146603:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783073988.146620:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783073988.146624:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146631:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869e00 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:0.0:1783073988.146633:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.146635:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146639:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146653:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146653:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.146657:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.146665:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146673:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146676:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146687:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de34a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146704:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.146705:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146709:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146722:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146724:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.146736:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146738:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.146749:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146761:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146770:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de351 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.146781:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.146785:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.146788:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146790:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146811:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.146811:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.146817:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146818:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.146827:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146832:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146846:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146850:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146858:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146862:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146868:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146894:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.146898:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.146901:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.146913:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.146917:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.146922:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146930:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.146935:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.146943:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.146951:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.146956:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146956:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.146959:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146972:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.146976:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de35f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.146978:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.146981:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.146986:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.146990:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.146999:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147006:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147013:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147031:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.147065:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.147067:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.147072:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147075:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147091:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.147099:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.147104:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147113:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147120:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147128:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147142:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.147156:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.147167:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147176:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.147179:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.147190:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147193:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.147196:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147202:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147209:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.147219:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783073988.147221:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147224:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.147228:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147231:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147248:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.147252:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147255:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147256:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.147256:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147277:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147282:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147305:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de36d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147307:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147364:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.147372:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.147373:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.147377:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147378:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.147382:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.147388:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.147391:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147396:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147402:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.147405:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.147407:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.147415:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147418:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6bf09c0/0x5fb609b3016de374 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147438:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.147444:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.147448:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147452:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147458:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147465:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147467:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.147470:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147477:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147495:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.147527:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.147531:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147544:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.147547:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.147551:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147560:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.147561:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147567:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147577:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147580:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.147586:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147593:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147597:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.147614:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147618:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.147624:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ec1c46/0x5fb609b3016de37b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147639:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.147641:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.147645:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.147645:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147653:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.147656:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.147658:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783073988.147665:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147670:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147675:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147682:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.147690:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.147695:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147696:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147715:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030105e39/0x5fb609b3016de382 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147716:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147740:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.147744:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.147747:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147748:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147756:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147772:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.147790:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.147795:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783073988.147808:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.147810:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.147818:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147819:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147842:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.147844:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147848:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.147857:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147863:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147868:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147874:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028c22ec3/0x5fb609b3016de389 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147881:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147892:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147892:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.147895:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.147898:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.147928:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783073988.147965:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.147970:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147978:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.147980:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.147984:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147992:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.147999:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148006:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148028:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783073988.148058:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.148064:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148072:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.148080:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.148084:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148093:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148102:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148108:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148119:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783073988.148151:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.148156:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148163:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.148166:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.148170:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148178:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148187:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148199:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148213:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783073988.148221:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783073988.148224:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148231:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.148234:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148241:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148252:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148259:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038896f00/0x5fb609b3016de390 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148272:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783073988.148275:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148292:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.148295:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148302:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148342:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148351:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c36075b5/0x5fb609b3016de397 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148363:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783073988.148366:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148373:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.148376:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148382:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148390:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148402:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e40105e/0x5fb609b3016de39e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148412:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.148415:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148422:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.148426:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148433:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.148437:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.148448:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148455:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002139eb8/0x5fb609b3016de3a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.148467:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.148469:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.148471:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.148932:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.148938:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783073988.151079:0:26171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1200 00000100:00100000:0.0:1783073988.151177:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83250:x1869685723452928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7495us (7635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073988.151194:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4860 00000100:00100000:2.0:1783073988.151293:0:83250:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83250:1869685723452928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783073988.151307:0:83250:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x4b0:0x0] 00000100:00100000:2.0:1783073988.151401:0:83250:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83250:1869685723453312:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783073988.151408:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723453184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783073988.151447:0:83250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073988.151466:0:83250:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a36c0 going to sleep for 20 seconds 00000100:00100000:3.0:1783073988.151522:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073988.151530:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453312 00000100:00100000:0.0:1783073988.151537:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453312 00000100:00100000:0.0:1783073988.151573:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4862 00000100:00100000:0.0:1783073988.151581:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83250:x1869685723453312:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1783073988.151587:0:8487:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1783073988.151618:0:8487:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00000100:00100000:0.0:1783073988.152932:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:83250:x1869685723453312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1350us (1484us total) trans 4294968706 rc 0/0 00000100:00100000:0.0:1783073988.152941:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4862 00000100:00100000:3.0:1783073988.153014:0:83250:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83250:1869685723453312:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783073988.153016:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453184 00000004:00080000:3.0:1783073988.153027:0:83250:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00000100:00100000:2.0:1783073988.153028:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453184 00000100:00100000:2.0:1783073988.153063:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:2.0:1783073988.153070:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723453184:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1783073988.153075:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783073988.153086:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783073988.153127:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723453184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073988.153133:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:3.0:1783073988.153457:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723453184:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1783073988.156246:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.156260:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156276:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.156280:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.156286:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156302:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156649:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156660:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156704:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.156772:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.156778:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.156786:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.156789:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.156797:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.156810:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.156811:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.156823:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016de3ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156823:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156845:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.156849:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.156854:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.156855:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.156858:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.156866:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.156868:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156878:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156885:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156902:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783073988.156925:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.156932:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.156943:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.156952:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.156953:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.156959:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156969:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.156971:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156982:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.156984:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.156989:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.156991:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016de3b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157012:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.157025:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.157027:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.157029:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.157038:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157047:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157067:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.157088:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.157092:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157098:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bcc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.157100:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157112:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157121:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157125:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de3ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157135:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.157136:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.157138:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783073988.157163:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.157169:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157177:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.157181:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.157185:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157195:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157203:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157218:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157240:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.157269:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.157275:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.157278:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.157290:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.157290:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157296:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157308:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.157343:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.157353:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157356:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157376:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157384:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157388:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157400:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de3c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157403:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157419:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.157424:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157429:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783073988.157431:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.157436:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157444:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157454:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157461:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de3c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157485:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.157487:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783073988.157489:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.157490:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.157498:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.157508:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.157520:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.157523:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.157527:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157537:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157546:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157554:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157571:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783073988.157589:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.157595:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.157603:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.157607:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.157612:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.157615:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157619:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.157632:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157633:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.157640:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.157650:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.157651:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de3cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157675:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.157681:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.157684:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.157686:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.157699:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157706:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157723:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.157744:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.157758:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.157763:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.157770:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.157773:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157775:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157796:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.157798:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157804:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.157814:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157818:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157827:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157830:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de3d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157849:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157856:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.157859:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157860:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.157863:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.157892:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.157923:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.157929:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.157931:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.157942:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157962:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.157964:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bda00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.157967:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.157970:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157973:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.157986:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.157991:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158000:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158002:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158023:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de3dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158025:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158059:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.158063:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158070:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.158073:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158081:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158090:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158102:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.158104:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.158193:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783073988.158194:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.158200:0:17659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de3e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.158255:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.158260:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158274:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.158277:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.158281:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158290:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158298:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158304:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158344:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.158358:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.158364:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158372:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.158377:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.158384:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.158386:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158392:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158402:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158404:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.158411:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.158423:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de3eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158423:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158447:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158461:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.158463:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.158465:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.158479:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158485:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158502:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.158521:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.158527:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.158542:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.158546:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.158550:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158552:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158571:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.158574:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158575:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.158583:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158594:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158596:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158615:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de3f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158617:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158635:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158640:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.158643:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.158645:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.158666:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.158684:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.158689:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158697:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.158700:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.158706:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.158709:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158713:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158734:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.158738:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.158741:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158743:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158753:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158759:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158765:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158778:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.158802:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de3f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.158814:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.158821:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783073988.158821:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158827:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158834:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.158838:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.158843:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158846:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.158856:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158858:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158878:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158882:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158895:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158897:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de400 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158918:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158924:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.158927:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.158935:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783073988.158936:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.158942:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158949:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.158952:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158961:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.158973:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.158977:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783073988.158980:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de407 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158985:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.158997:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.158998:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.159000:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.159002:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.159007:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.159009:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159013:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.159019:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.159021:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159030:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159042:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159057:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783073988.159095:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159100:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159107:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.159109:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.159113:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159120:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159127:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159133:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159144:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783073988.159175:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159180:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159191:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.159193:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.159197:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159205:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159213:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159234:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159245:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783073988.159306:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159340:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159348:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.159351:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.159355:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159365:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159383:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159391:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159400:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783073988.159438:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159443:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159460:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.159463:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.159467:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159476:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159483:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159489:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783073988.159490:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159497:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159524:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.159525:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783073988.159528:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159538:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159552:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159559:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de40e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.159566:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159574:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159578:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783073988.159585:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159586:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.159594:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.159597:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783073988.159603:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.159604:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159606:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159609:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159630:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159632:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.159634:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159640:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159653:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159661:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.159670:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783073988.159671:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159672:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.159684:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159694:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de415 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159703:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783073988.159704:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.159705:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.159711:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159725:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783073988.159731:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de41c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159733:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.159734:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.159744:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159756:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159762:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.159769:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159770:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159771:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:2.0:1783073988.159773:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.159781:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.159788:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de423 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159788:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.159800:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159801:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159809:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.159816:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159820:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159832:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159837:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159855:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159862:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159866:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159870:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de431 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159888:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783073988.159892:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001df7b350/0x5fb609b3016de42a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159928:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.159932:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.159932:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.159943:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159947:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.159953:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.159953:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.159957:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:0.0:1783073988.159958:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.159962:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.159966:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783073988.159971:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159973:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.159996:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.159997:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160018:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.160019:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.160032:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.160035:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160036:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.160037:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.160045:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160059:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783073988.160095:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.160101:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160102:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.160111:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160113:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.160115:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.160123:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160131:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.160138:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160139:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160160:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160164:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160169:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160171:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.160174:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.160184:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.160190:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160199:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783073988.160200:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016de43f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160231:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.160235:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.160240:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.160244:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783073988.160248:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160250:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160264:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160270:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.160277:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.160280:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160282:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160294:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160299:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016de446 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160325:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160349:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160350:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.160354:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.160357:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160373:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.160390:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.160396:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160404:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.160408:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160417:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.160417:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.160430:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160435:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160442:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.160446:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016de44d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160448:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.160455:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160465:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160484:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160491:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160513:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783073988.160532:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783073988.160537:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160543:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783073988.160547:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160556:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.160557:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.160565:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.160574:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160577:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:3.0:1783073988.160580:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160583:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.160593:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160596:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de454 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160621:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.160624:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.160628:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783073988.160631:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160636:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160646:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160679:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783073988.160687:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073988.160694:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.160698:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.160706:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073988.160710:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783073988.160719:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783073988.160719:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160730:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160737:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160740:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.160748:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783073988.160752:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005495f94e/0x5fb609b3016de45b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160755:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160773:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160777:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073988.160780:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160784:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.160790:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.160796:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.160972:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783073988.161012:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.161018:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161026:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.161033:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.161037:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161047:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161055:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161062:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161093:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783073988.161098:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161115:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.161119:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161127:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161138:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161145:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de462 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161160:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.161163:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161170:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.161173:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161181:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161190:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161202:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.161203:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.161205:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.161237:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783073988.161241:0:17659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016de469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783073988.161263:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783073988.161288:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.161294:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161301:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.161304:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.161308:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161394:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161408:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161416:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161467:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783073988.161508:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.161514:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161522:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.161525:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.161528:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161538:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161546:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161554:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161598:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783073988.161603:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161610:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.161613:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161621:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161632:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161639:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c7c582/0x5fb609b3016de470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161653:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.161656:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161663:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.161672:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161680:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161691:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.161698:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.161700:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.161701:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073988.161735:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783073988.161740:0:17659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016de477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073988.161758:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783073988.161794:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783073988.161799:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161807:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=2827s v=(0 0) 00010000:00010000:1.0:1783073988.161810:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783073988.161814:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161823:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161831:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161838:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073988.161890:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783073988.161920:0:17659:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00000100:00100000:1.0:1783073988.162017:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83248:x1869685723453056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18317us (18434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073988.162033:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4861 00000100:00100000:3.0:1783073988.162130:0:83248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d2328a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83248:1869685723453056:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783073988.162144:0:83248:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x6a2:0x0] 00000100:00100000:1.0:1783073988.162217:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723453440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783073988.162255:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073988.162355:0:83248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83248:1869685723453568:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783073988.162382:0:83248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073988.162442:0:83248:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e480 going to sleep for 20 seconds 00000100:00100000:3.0:1783073988.162463:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453568 00000100:00100000:3.0:1783073988.162469:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453568 00000100:00100000:3.0:1783073988.162505:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863 00000100:00100000:3.0:1783073988.162513:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:83248:x1869685723453568:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1783073988.162519:0:26170:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1783073988.162550:0:26170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00010000:00010000:2.0:1783073988.162596:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783073988.162603:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.162613:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783073988.162617:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.162627:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.162642:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.162651:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002149367a/0x5fb609b3016de47e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783073988.162676:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.162679:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783073988.163224:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783073988.164171:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:83248:x1869685723453568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1656us (1786us total) trans 4294968710 rc 0/0 00000100:00100000:3.0:1783073988.164181:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863 00000100:00100000:0.0:1783073988.164385:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453440 00000100:00100000:0.0:1783073988.164393:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453440 00000100:00100000:0.0:1783073988.164424:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1783073988.164432:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723453440:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1783073988.164438:0:8447:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783073988.164453:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783073988.164498:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723453440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073988.164506:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:2.0:1783073988.164520:0:83248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83248:1869685723453568:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783073988.164535:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723453440:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1783073988.164536:0:83248:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00010000:00010000:3.0:1783073988.206511:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1783073989.038681:0:26189:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524c48e7480 x1869685723451648/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1783073998 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783073989.038785:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c48e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723451648:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1018565us (1018898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073989.038797:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555 00000100:00100000:1.0:1783073989.039008:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783073989.039025:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723453696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783073989.039067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073989.039188:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453696 00000100:00100000:3.0:1783073989.039196:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453696 00000100:00100000:3.0:1783073989.039251:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:3.0:1783073989.039261:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723453696:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1783073989.039267:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783073989.039285:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783073989.039393:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723453696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073989.039399:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00080000:1.0:1783073989.039567:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783073989.039603:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723453696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783073989.041510:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783073989.041516:0:53092:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1783073989.041531:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723453952:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.041580:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723454208:0@lo:400:kworker.0 00000100:00100000:3.0:1783073989.041600:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073989.041690:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723453824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783073989.041739:0:83237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453952 00000100:00100000:1.0:1783073989.041746:0:83237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453952 00000100:00100000:1.0:1783073989.041790:0:83237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783073989.041799:0:83237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723453952:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783073989.041804:0:83237:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.042477:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.042566:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723454720:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.042598:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.042615:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723455232:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.042634:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.042654:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783073989.042660:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723454080:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.042679:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.042695:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723454592:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.042716:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.042732:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723455104:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.042750:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.042779:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454208 00000100:00100000:2.0:1783073989.042783:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454208 00000100:00100000:2.0:1783073989.042815:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454720 00000100:00100000:2.0:1783073989.042830:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454720 00000100:00100000:2.0:1783073989.042844:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455232 00000100:00100000:2.0:1783073989.042846:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455232 00000100:00100000:2.0:1783073989.042854:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454080 00000100:00100000:2.0:1783073989.042856:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454080 00000100:00100000:2.0:1783073989.042870:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1783073989.042876:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723454208:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.042881:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.042918:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723454208:12345-0@lo:400:kworker.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.042926:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1783073989.042943:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1783073989.042949:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723454720:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.042952:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.042977:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723454720:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.042984:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1783073989.042995:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1783073989.043000:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723455232:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.043004:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.043088:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723455232:12345-0@lo:400:kworker.0 Request processed in 87us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.043094:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1783073989.043107:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1783073989.043113:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869685723454080:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.043116:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.043138:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869685723454080:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.043152:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1783073989.043183:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454592 00000100:00100000:2.0:1783073989.043187:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454592 00000100:00100000:2.0:1783073989.043210:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455104 00000100:00100000:2.0:1783073989.043213:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455104 00000100:00100000:2.0:1783073989.043229:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1783073989.043236:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723454592:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.043240:0:26177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.043268:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723454592:12345-0@lo:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.043274:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1783073989.043285:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1783073989.043290:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723455104:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.043294:0:26177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.043347:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723455104:12345-0@lo:400:kworker.0 Request processed in 56us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.043354:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00080000:2.0:1783073989.043380:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783073989.043384:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783073989.043386:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783073989.043410:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723454080:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.043429:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723454592:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.043438:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723455104:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.043448:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723454208:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.043457:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723454720:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.043480:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723455232:0@lo:400:kworker.0 00000100:00080000:2.0:1783073989.043524:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783073989.043532:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9524c8ffe300 x1869685723451648/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074018 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783073989.043541:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9524c8ffe300 x1869685723451648/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074018 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783073989.043547:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783073989.043558:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783073989.043564:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004d630abb): req@ffff9524fababb80 x1869685723367936/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783073809 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783073989.043574:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723451648:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1783073989.043689:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073989.043740:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723367936 00000100:00100000:2.0:1783073989.043743:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723367936 00000100:00100000:2.0:1783073989.043764:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561 00000100:00100000:2.0:1783073989.043769:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723367936:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1783073989.043773:0:23954:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783073989.043794:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444757504 avail 1298518016 00000100:00100000:2.0:1783073989.043830:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723367936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.043836:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561 00000100:00100000:2.0:1783073989.043865:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723367936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783073989.043958:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723454464:0@lo:400:kworker.0 00000100:00100000:3.0:1783073989.043990:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073989.044037:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723454976:0@lo:400:kworker.0 00000100:00100000:3.0:1783073989.044061:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073989.044086:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783073989.044092:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723455360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783073989.044114:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073989.044144:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454464 00000100:00100000:3.0:1783073989.044149:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454464 00000100:00100000:3.0:1783073989.044181:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1783073989.044188:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723454464:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783073989.044193:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783073989.044212:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073989.044242:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723454336:0@lo:400:kworker.0 00000100:00100000:3.0:1783073989.044248:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723454464:12345-0@lo:400:kworker.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073989.044255:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1783073989.044273:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073989.044291:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723454848:0@lo:400:kworker.0 00000100:00100000:0.0:1783073989.044354:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073989.044381:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455360 00000100:00100000:0.0:1783073989.044384:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455360 00000100:00100000:0.0:1783073989.044400:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454848 00000100:00100000:0.0:1783073989.044402:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454848 00000100:00100000:0.0:1783073989.044421:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562 00000100:00100000:0.0:1783073989.044428:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723455360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783073989.044436:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563 00000020:02000000:0.0:1783073989.044443:0:8453:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.044450:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723454848:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1783073989.044459:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444757504 avail 1298518016 00000020:02000000:2.0:1783073989.044467:0:26189:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783073989.044488:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723455360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073989.044493:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562 00000100:00100000:0.0:1783073989.044515:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723453824 00000100:00100000:2.0:1783073989.044518:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723454848:12345-0@lo:400:kworker.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073989.044518:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723453824 00000100:00100000:2.0:1783073989.044528:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563 00000100:00100000:0.0:1783073989.044539:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1783073989.044545:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723453824:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1783073989.044559:0:83645:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073989.044563:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454336 00002000:00000024:0.0:1783073989.044568:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783073989.044569:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454336 00000100:00100000:0.0:1783073989.044593:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723453824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073989.044598:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1783073989.044602:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1783073989.044610:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723454336:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073989.044614:0:66201:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783073989.044632:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723453824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783073989.044645:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723454848:0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.044652:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723454336:12345-0@lo:400:kworker.0 Request processed in 41us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073989.044660:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1783073989.044663:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723454336:0@lo:400:kworker.0 00000100:00080000:2.0:1783073989.044685:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783073989.044689:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783073989.044692:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723454976 00000100:00100000:0.0:1783073989.044695:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723454976 00000100:00100000:2.0:1783073989.044722:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723455360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783073989.044727:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:0.0:1783073989.044736:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723454976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783073989.044739:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723454464:0@lo:400:kworker.0 00000020:02000000:0.0:1783073989.044741:0:8443:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783073989.044787:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723454976:12345-0@lo:400:kworker.0 Request processed in 51us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073989.044793:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:2.0:1783073989.044799:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723454976:0@lo:400:kworker.0 00000100:00100000:1.0:1783073989.044983:0:83237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723453952:12345-0@lo:400:kworker.0 Request processed in 3183us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073989.044992:0:83237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783073989.045073:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723453952:0@lo:400:kworker.0 00010000:00010000:0.0:1783073989.230960:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073990.254734:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783073991.087126:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783073991.087155:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723455488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783073991.087226:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073991.087335:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455488 00000100:00100000:0.0:1783073991.087343:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455488 00000100:00100000:0.0:1783073991.087392:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564 00000100:00100000:0.0:1783073991.087400:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723455488:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1783073991.087416:0:8453:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783073991.087449:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:0.0:1783073991.087499:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723455488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073991.087506:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564 00000100:00100000:1.0:1783073991.087590:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723455488:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783073991.278607:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073992.302475:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783073993.070550:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723455616:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.070606:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723455744:0@lo:400:kworker.0 00000100:00100000:2.0:1783073993.070611:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1869685723456000:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.070630:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723455872:0@lo:400:kworker.0 00000100:00100000:0.0:1783073993.070640:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073993.070661:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073993.070687:0:83235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455616 00000100:00100000:2.0:1783073993.070696:0:83235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455616 00000100:00100000:1.0:1783073993.070696:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073993.070705:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723456128:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.070752:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723456256:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.070757:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723456384:0@lo:400:kworker.0 00000100:00100000:2.0:1783073993.070760:0:83235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783073993.070774:0:83235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723455616:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073993.070781:0:83235:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783073993.070795:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783073993.070804:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073993.070805:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073993.070838:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723456768:0@lo:400:kworker.0 00000100:00100000:0.0:1783073993.070845:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723456640:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.070850:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723456896:0@lo:400:kworker.0 00000100:00100000:2.0:1783073993.070854:0:83235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723455616:12345-0@lo:400:kworker.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.070864:0:83235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783073993.070876:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073993.070889:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783073993.070894:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073993.070914:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455744 00000100:00100000:2.0:1783073993.070919:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455744 00000100:00100000:0.0:1783073993.070920:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723457152:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.070928:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456256 00000100:00100000:3.0:1783073993.070934:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456256 00000100:00100000:1.0:1783073993.070952:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456384 00000100:00100000:1.0:1783073993.070957:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456384 00000100:00100000:2.0:1783073993.070960:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723455872 00000100:00100000:2.0:1783073993.070965:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723455872 00000100:00100000:3.0:1783073993.070969:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456768 00000100:00100000:3.0:1783073993.070973:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456768 00000100:00100000:1.0:1783073993.070991:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456896 00000100:00100000:1.0:1783073993.070996:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456896 00000100:00100000:3.0:1783073993.071015:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565 00000100:00100000:3.0:1783073993.071022:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723456256:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783073993.071025:0:8454:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073993.071058:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456128 00000100:00100000:2.0:1783073993.071062:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456128 00000100:00100000:2.0:1783073993.071074:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456640 00000100:00100000:2.0:1783073993.071076:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456640 00000100:00100000:2.0:1783073993.071087:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1783073993.071092:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869685723455744:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073993.071097:0:66200:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783073993.071159:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1783073993.071169:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723456384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.071174:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723456256:12345-0@lo:400:kworker.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000020:02000000:1.0:1783073993.071177:0:8444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783073993.071185:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565 00000100:00100000:3.0:1783073993.071202:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3566 00000100:00100000:3.0:1783073993.071209:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723456768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.071220:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723456384:12345-0@lo:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000020:02000000:3.0:1783073993.071225:0:8454:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783073993.071228:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:2.0:1783073993.071260:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869685723455744:12345-0@lo:400:kworker.0 Request processed in 165us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.071268:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1783073993.071286:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723456768:12345-0@lo:400:kworker.0 Request processed in 75us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.071286:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1783073993.071296:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3566 00000100:00100000:2.0:1783073993.071299:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723455872:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073993.071304:0:66200:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783073993.071356:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1783073993.071358:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723455872:12345-0@lo:400:kworker.0 Request processed in 62us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.071368:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723456128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783073993.071369:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000020:02000000:3.0:1783073993.071377:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073993.071387:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1783073993.071396:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723456640:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073993.071400:0:66200:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783073993.071421:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:1.0:1783073993.071430:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723456896:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783073993.071435:0:8444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073993.071474:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723456640:12345-0@lo:400:kworker.0 Request processed in 79us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073993.071480:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723456896:12345-0@lo:400:kworker.0 Request processed in 49us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.071485:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1783073993.071491:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1783073993.071519:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723456128:12345-0@lo:400:kworker.0 Request processed in 152us (714us total) trans 0 rc 0/0 00000100:00080000:2.0:1783073993.071534:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783073993.071538:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00080000:2.0:1783073993.071541:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783073993.071545:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783073993.071603:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723455744:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.071616:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723456256:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.071625:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723456768:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.071743:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723455872:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.071758:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723456384:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.071768:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723456896:0@lo:400:kworker.0 00000100:00100000:0.0:1783073993.072133:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073993.072178:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723455616:0@lo:400:kworker.0 00000100:00100000:0.0:1783073993.072198:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723456128:0@lo:400:kworker.0 00000100:00100000:0.0:1783073993.072207:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723456640:0@lo:400:kworker.0 00000100:00100000:2.0:1783073993.072354:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457152 00000100:00100000:2.0:1783073993.072359:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457152 00000100:00100000:2.0:1783073993.072397:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1783073993.072405:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723457152:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783073993.072410:0:66200:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073993.072458:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723457152:12345-0@lo:400:kworker.0 Request processed in 54us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.072466:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1783073993.072506:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073993.072533:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723457152:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.072540:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456000 00000100:00100000:1.0:1783073993.072543:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723456512:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.072546:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456000 00000100:00080000:0.0:1783073993.072573:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783073993.072589:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1783073993.072591:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073993.072599:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1869685723456000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.072633:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723457024:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.072655:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783073993.072683:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723456512 00000100:00100000:1.0:1783073993.072687:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723456512 00000100:00100000:1.0:1783073993.072709:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457024 00000100:00100000:1.0:1783073993.072711:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457024 00000100:00100000:1.0:1783073993.072728:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:1.0:1783073993.072734:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723456512:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783073993.072738:0:8445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:3.0:1783073993.072763:0:66201:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783073993.072772:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723456512:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073993.072779:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:1.0:1783073993.072798:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:1.0:1783073993.072805:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723457024:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783073993.072809:0:8445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783073993.072817:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1869685723456000:12345-0@lo:400:kworker.0 Request processed in 217us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.072824:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1783073993.072843:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723457024:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073993.072850:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00080000:0.0:1783073993.072861:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783073993.072909:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1869685723456000:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.072920:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723456512:0@lo:400:kworker.0 00000100:00100000:1.0:1783073993.072929:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723457024:0@lo:400:kworker.0 00000100:00100000:3.0:1783073993.199303:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073993.199409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073993.199449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783073993.199500:0:83236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708010496 00000100:00100000:2.0:1783073993.199513:0:83236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708010496 00000100:00100000:2.0:1783073993.199567:0:83236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 153 00000100:00100000:2.0:1783073993.199574:0:83236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708010496:12345-192.168.204.26@tcp:400:kworker.0 00000020:02000000:2.0:1783073993.199580:0:83236:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783073993.199633:0:83236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708010496:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.199638:0:83236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 153 00000100:00100000:0.0:1783073993.200516:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708010752 00000100:00100000:0.0:1783073993.200523:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708010752 00000100:00100000:0.0:1783073993.200630:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708010624 00000100:00100000:0.0:1783073993.200634:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708010624 00000100:00100000:0.0:1783073993.200654:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 691 00000100:00100000:0.0:1783073993.200662:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708010752:12345-192.168.204.26@tcp:400:kworker.0 00000020:02000000:0.0:1783073993.200667:0:66202:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783073993.200707:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708010752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 46us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073993.200713:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 691 00000100:00100000:0.0:1783073993.200729:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 995 00000100:00100000:0.0:1783073993.200733:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708010624:12345-192.168.204.26@tcp:38:kworker.0 00000020:02000000:0.0:1783073993.200737:0:66202:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1783073993.200761:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t94489280515 exp 0000000000000000 cur 2832 last 0 00000020:00000080:0.0:1783073993.200810:0:66202:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016de485 00000004:00100000:0.0:1783073993.200836:0:66202:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783073993.200868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00080000:0.0:1783073993.200960:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524c3568000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783073993.200978:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708010880 00000100:00100000:3.0:1783073993.200984:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708010880 00000100:00100000:0.0:1783073993.201007:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708010624:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 272us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073993.201015:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 995 00000100:00080000:2.0:1783073993.201121:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783073993.201126:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783073993.202458:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2026 00000100:00100000:3.0:1783073993.202480:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708010880:12345-192.168.204.26@tcp:400:kworker.0 00000020:02000000:3.0:1783073993.202487:0:26175:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783073993.202539:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708010880:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 63us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.202548:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2026 00000100:00100000:3.0:1783073993.221953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783073993.222977:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011008 00000100:00100000:2.0:1783073993.222988:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011008 00000100:00100000:2.0:1783073993.223050:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 996 00000100:00100000:2.0:1783073993.223060:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:63967:x1869685708011008:12345-192.168.204.26@tcp:41:lfs.0 00000020:02000000:2.0:1783073993.223068:0:68632:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783073993.223103:0:68632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783073993.223182:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:63967:x1869685708011008:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 122us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073993.223200:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 996 00000100:00100000:2.0:1783073993.227287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073993.228086:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011136 00000100:00100000:3.0:1783073993.228097:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011136 00000100:00100000:3.0:1783073993.228154:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1595 00000100:00100000:3.0:1783073993.228165:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:63967:x1869685708011136:12345-192.168.204.26@tcp:13:lfs.0 00000020:02000000:3.0:1783073993.228173:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783073993.228206:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783073993.228299:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:63967:x1869685708011136:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 135us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.228307:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1595 00000100:00100000:0.0:1783073993.230403:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073993.230497:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011264 00000100:00100000:3.0:1783073993.230507:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011264 00000100:00100000:3.0:1783073993.230595:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4864 00000100:00100000:3.0:1783073993.230603:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2401:x1869685708011264:12345-192.168.204.26@tcp:8:lfs.0 00000020:02000000:3.0:1783073993.230610:0:26170:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1783073993.230645:0:26170:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2832 last 0 00000020:00000080:3.0:1783073993.230677:0:26170:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016de48c 00002000:00100000:3.0:1783073993.230689:0:26170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9523c6a60000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783073993.230706:0:26170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783073993.230799:0:26170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783073993.230828:0:26170:0:(import.c:65:import_set_state_nolock()) ffff9523c6a62000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783073993.231549:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708011264:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 943us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.231558:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4864 00000001:00100000:1.0:1783073993.235121:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00080000:1.0:1783073993.235137:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968706 is committed 00000100:00100000:1.0:1783073993.237478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783073993.239043:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011392 00000100:00100000:0.0:1783073993.239056:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011392 00000100:00100000:0.0:1783073993.239166:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1596 00000100:00100000:0.0:1783073993.239177:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:63967:x1869685708011392:12345-192.168.204.26@tcp:13:lfs.0 00000020:02000000:0.0:1783073993.239185:0:83645:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783073993.239225:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783073993.239330:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:63967:x1869685708011392:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 154us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073993.239339:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1596 00010000:00010000:0.0:1783073993.326469:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783073993.646575:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783073993.646772:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e41c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723457408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783073993.646837:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073993.647558:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457408 00000100:00100000:3.0:1783073993.647566:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457408 00000100:00100000:3.0:1783073993.647607:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1783073993.647616:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723457408:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1783073993.647630:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783073993.647651:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783073993.647724:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723457408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.647731:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:2.0:1783073993.648307:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723457280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783073993.648347:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073993.648429:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457280 00000100:00100000:3.0:1783073993.648433:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457280 00000100:00100000:3.0:1783073993.648462:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1783073993.648469:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723457280:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1783073993.648474:0:8447:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783073993.648485:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783073993.648534:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723457280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073993.648541:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:1.0:1783073993.648593:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e41c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723457408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783073993.648621:0:3658:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968706 gen 2 00000100:00100000:2.0:1783073993.648639:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723457280:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1783073993.653445:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968710 is committed 00000100:00100000:3.0:1783073994.158543:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783073994.158544:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e3c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723457664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783073994.158564:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723457536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783073994.158702:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723457792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783073994.160125:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073994.160125:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783073994.160202:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073994.160275:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457536 00000100:00100000:2.0:1783073994.160284:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457536 00000100:00100000:0.0:1783073994.160437:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457664 00000100:00100000:0.0:1783073994.160441:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457664 00000100:00100000:3.0:1783073994.160450:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457792 00000100:00100000:3.0:1783073994.160455:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457792 00000100:00100000:0.0:1783073994.160479:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:0.0:1783073994.160491:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723457664:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783073994.160492:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000020:02000000:0.0:1783073994.160502:0:83645:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783073994.160507:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723457792:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1783073994.160513:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783073994.160526:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783073994.160528:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783073994.160703:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567 00000100:00100000:2.0:1783073994.160711:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723457536:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1783073994.160716:0:8454:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783073994.160738:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:0.0:1783073994.160847:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723457664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 360us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073994.160855:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1783073994.160888:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723457792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 384us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073994.160896:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:2.0:1783073994.160938:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723457536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073994.160945:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567 00000100:00100000:1.0:1783073994.161036:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e3c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723457664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783073994.161067:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723457792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783073994.161648:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723457536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783073994.350560:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783073994.673053:0:83230:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000100:00100000:0.0:1783073994.707842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073994.707931:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011520 00000100:00100000:3.0:1783073994.707942:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011520 00000100:00100000:3.0:1783073994.708004:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 997 00000100:00100000:3.0:1783073994.708023:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:64062:x1869685708011520:12345-192.168.204.26@tcp:101:lfs.0 00000020:02000000:3.0:1783073994.708031:0:67186:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1783073994.708049:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783073994.708074:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016de493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af01 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783073994.709932:0:67186:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1805us 00010000:00010000:1.0:1783073994.729333:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016de49a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073994.729352:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016de49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073994.729365:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016de49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783073994.729415:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783073994.729418:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1783073994.729450:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016de49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073994.729489:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016de493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af01 expref: 7 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073994.729504:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016de49a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af01 expref: 6 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073994.729512:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9600) 00010000:00010000:1.0:1783073994.729515:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783073994.729535:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24e00, rc 0) 00000100:00100000:1.0:1783073994.729600:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64062:x1869685708011520:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 21587us (21767us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073994.729609:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 997 00000100:00100000:3.0:1783073994.735042:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783073994.735110:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011648 00000100:00100000:1.0:1783073994.735120:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011648 00000100:00100000:1.0:1783073994.735273:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 998 00000100:00100000:1.0:1783073994.735285:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64062:x1869685708011648:12345-192.168.204.26@tcp:41:lfs.0 00000020:02000000:1.0:1783073994.735292:0:66200:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1783073994.738227:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:1.0:1783073994.738344:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64062:x1869685708011648:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 3055us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073994.738357:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 998 00000100:00100000:3.0:1783073994.755261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783073994.757016:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708011776 00000100:00100000:0.0:1783073994.757028:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708011776 00000100:00100000:0.0:1783073994.757082:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 999 00000100:00100000:0.0:1783073994.757091:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:63587:x1869685708011776:12345-192.168.204.26@tcp:101:multiop.0 00000020:02000000:0.0:1783073994.757098:0:66201:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1783073994.757113:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783073994.757131:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af08 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757201:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757226:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757241:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757256:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757262:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757269:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757459:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757468:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757475:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783073994.757509:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:0.0:1783073994.757513:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1783073994.757552:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757575:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757584:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757589:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757595:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757601:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783073994.757605:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757612:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757624:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9600) 00010000:00010000:0.0:1783073994.757627:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783073994.757631:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757637:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de4a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757652:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757657:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757669:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757675:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783073994.757678:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757684:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757691:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9524f4934b00) 00010000:00010000:0.0:1783073994.757694:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783073994.757697:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757702:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de4af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757734:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af08 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757747:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af08 expref: 7 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073994.757754:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9524f4934100) 00010000:00010000:0.0:1783073994.757757:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783073994.757759:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb361a00, rc 0) 00000100:00100000:0.0:1783073994.757942:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:63587:x1869685708011776:12345-192.168.204.26@tcp:101:multiop.0 Request processed in 851us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073994.757958:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 999 00010000:00010000:2.0:1783073995.378919:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783073996.207514:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783073996.207536:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e3c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723457920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783073996.207609:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073996.207684:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723457920 00000100:00100000:0.0:1783073996.207691:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723457920 00000100:00100000:0.0:1783073996.207741:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568 00000100:00100000:0.0:1783073996.207750:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723457920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783073996.207780:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:0.0:1783073996.207822:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723457920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073996.207828:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568 00000100:00100000:1.0:1783073996.207902:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e3c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723457920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783073996.366468:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783073996.366565:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012032 00000100:00100000:1.0:1783073996.366576:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012032 00000100:00100000:1.0:1783073996.366642:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1000 00000100:00100000:1.0:1783073996.366652:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:64180:x1869685708012032:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:1.0:1783073996.366697:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783073996.366721:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361a00/0x5fb609b3016de4b6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af08 expref: 7 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366735:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9524f4934100) 00010000:00010000:1.0:1783073996.366758:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016de49a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af01 expref: 6 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366765:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9600) 00010000:00010000:1.0:1783073996.366771:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783073996.366791:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366802:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366810:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366820:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366825:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366831:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366909:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366917:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.366923:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783073996.367202:0:67186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].2, 64 off8320 00000004:00080000:1.0:1783073996.367219:0:67186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2835584907389ns, next at 2836584905494ns, rc = 0 00010000:00010000:1.0:1783073996.367274:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367283:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367291:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367298:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367305:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367337:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367352:0:67186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783073996.367382:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367389:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367396:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367402:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783073996.367406:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367424:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367434:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9524d31acb00) 00010000:00010000:1.0:1783073996.367437:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783073996.367440:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367446:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016de4cb lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367461:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367468:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367473:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367478:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367484:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783073996.367487:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367493:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367500:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d31ac100) 00010000:00010000:1.0:1783073996.367508:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783073996.367512:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367518:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016de4bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783073996.367531:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092d6df42 reply state 000000006e76580d transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367542:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783073996.367549:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9524d31ac400) 00010000:00010000:1.0:1783073996.367551:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783073996.367553:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783073996.367624:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:64180:x1869685708012032:12345-192.168.204.26@tcp:36:rm.0 Request processed in 973us (1163us total) trans 98784247809 rc 0/0 00000100:00100000:1.0:1783073996.367632:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1000 00000100:00080000:0.0:1783073996.368041:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783073996.368053:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783073996.368059:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073996.368065:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783073996.368068:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073996.368075:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073996.368084:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9524d31acb00) 00010000:00010000:0.0:1783073996.368087:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783073996.368090:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073996.368095:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016de4d2 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783073996.368119:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073996.368121:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073996.368123:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783073996.398503:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783073997.422850:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783073998.254748:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e41c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723458048:0@lo:400:kworker.0 00000100:00100000:2.0:1783073998.254825:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.254943:0:83235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458048 00000100:00100000:3.0:1783073998.254960:0:83235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458048 00000100:00100000:3.0:1783073998.255021:0:83235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783073998.255031:0:83235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.255277:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723458432:0@lo:400:kworker.0 00000100:00100000:2.0:1783073998.255440:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e41c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723458048:0@lo:400:kworker.0 00000100:00100000:1.0:1783073998.255460:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e41c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723458176:0@lo:400:kworker.0 00000100:00100000:2.0:1783073998.255472:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723458560:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.258239:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073998.258305:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723458944:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.258362:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073998.258382:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723459456:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.258402:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073998.258441:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458432 00000100:00100000:0.0:1783073998.258448:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458432 00000100:00100000:0.0:1783073998.258498:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1783073998.258507:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.258556:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723458432:12345-0@lo:400:kworker.0 Request processed in 50us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.258563:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1783073998.258585:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458944 00000100:00100000:0.0:1783073998.258589:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458944 00000100:00100000:0.0:1783073998.258611:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459456 00000100:00100000:0.0:1783073998.258614:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459456 00000100:00100000:0.0:1783073998.258632:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1783073998.258638:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723458944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.258668:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723458944:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.258674:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1783073998.258698:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1783073998.258703:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723459456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.258726:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723459456:12345-0@lo:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073998.258849:0:83235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723458048:12345-0@lo:400:kworker.0 Request processed in 3816us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073998.258858:0:83235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1783073998.259371:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783073998.259376:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783073998.259410:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723458944:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.259423:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723459456:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.259432:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723458432:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.259482:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e41c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723458304:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.259523:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.259547:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723458816:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.259569:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.259589:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723459328:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.259612:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.259647:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458816 00000100:00100000:3.0:1783073998.259651:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458816 00000100:00100000:0.0:1783073998.260006:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1783073998.260025:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459328 00000100:00100000:0.0:1783073998.260028:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459328 00000100:00100000:3.0:1783073998.260192:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1783073998.260201:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723458816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.260217:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1783073998.260227:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723459328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.260256:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723458816:12345-0@lo:400:kworker.0 Request processed in 56us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073998.260265:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:0.0:1783073998.260271:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723459328:12345-0@lo:400:kworker.0 Request processed in 45us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.260279:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00080000:3.0:1783073998.260289:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783073998.260304:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458304 00000100:00100000:0.0:1783073998.260325:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458304 00000100:00100000:3.0:1783073998.260339:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723458816:0@lo:400:kworker.0 00000100:00100000:1.0:1783073998.260339:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.260352:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968710 gen 2 00000100:00100000:0.0:1783073998.260365:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458176 00000100:00100000:3.0:1783073998.260367:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723459328:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.260371:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458176 00000100:00080000:3.0:1783073998.260408:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783073998.260411:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783073998.260521:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783073998.260537:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1783073998.260545:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723459072:0@lo:400:kworker.0 00000100:00100000:1.0:1783073998.260547:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723458304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783073998.260569:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783073998.260582:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723458304:12345-0@lo:400:kworker.0 Request processed in 38us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073998.260592:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723459584:0@lo:400:kworker.0 00000100:00100000:2.0:1783073998.260614:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783073998.260638:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458560 00000100:00100000:2.0:1783073998.260641:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458560 00000100:00100000:3.0:1783073998.260841:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1783073998.260845:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459072 00000100:00100000:1.0:1783073998.260846:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1783073998.260850:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723458176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.260852:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459072 00000100:00100000:1.0:1783073998.260865:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459584 00000100:00100000:1.0:1783073998.260870:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459584 00000100:00100000:0.0:1783073998.260879:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1783073998.260891:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723459072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.260896:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723458176:12345-0@lo:400:kworker.0 Request processed in 46us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073998.260900:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1783073998.260903:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1783073998.260907:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723459584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.260938:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723459072:12345-0@lo:400:kworker.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073998.260949:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723459584:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.260949:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1783073998.260959:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00080000:3.0:1783073998.261038:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783073998.261058:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723459072:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.261075:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723459584:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.261102:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e41c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723458304:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261220:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1783073998.261228:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261266:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723458560:12345-0@lo:400:kworker.0 Request processed in 39us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.261282:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1783073998.261397:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723458560:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261433:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e41c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723458176:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261441:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723458688:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261467:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073998.261485:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723459200:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261505:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073998.261613:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723458688 00000100:00100000:0.0:1783073998.261617:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723458688 00000100:00100000:0.0:1783073998.261639:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459200 00000100:00100000:0.0:1783073998.261642:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459200 00000100:00100000:0.0:1783073998.261658:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3569 00000100:00100000:0.0:1783073998.261664:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723458688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261698:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723458688:12345-0@lo:400:kworker.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.261704:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3569 00000100:00100000:0.0:1783073998.261716:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570 00000100:00100000:0.0:1783073998.261721:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723459200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261798:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723459200:12345-0@lo:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073998.261804:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570 00000100:00100000:0.0:1783073998.261831:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723458688:0@lo:400:kworker.0 00000100:00100000:0.0:1783073998.261839:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723459200:0@lo:400:kworker.0 00000100:00100000:3.0:1783073998.319114:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073998.319187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073998.319291:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073998.319346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783073998.320208:0:83236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012160 00000100:00100000:2.0:1783073998.320217:0:83236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012160 00000100:00100000:2.0:1783073998.320269:0:83236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:2.0:1783073998.320279:0:83236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2402:x1869685708012160:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783073998.320376:0:83236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2402:x1869685708012160:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 97us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073998.320384:0:83236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:2.0:1783073998.320547:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012672 00000100:00100000:2.0:1783073998.320551:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012672 00000100:00100000:2.0:1783073998.320588:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2031 00000100:00100000:2.0:1783073998.320595:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708012672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783073998.320627:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708012672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 32us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073998.320633:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2031 00000100:00080000:2.0:1783073998.320650:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783073998.321361:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783073998.321405:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012544 00000100:00100000:3.0:1783073998.321409:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012544 00000100:00100000:3.0:1783073998.321453:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2032 00000100:00100000:3.0:1783073998.321468:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708012544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783073998.321502:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708012544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073998.321509:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2032 00000100:00080000:3.0:1783073998.321536:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783073998.321714:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012416 00000100:00100000:0.0:1783073998.321724:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012416 00000100:00080000:3.0:1783073998.321793:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783073998.322915:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012288 00000100:00100000:2.0:1783073998.322922:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012288 00000100:00100000:2.0:1783073998.323004:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 698 00000100:00100000:2.0:1783073998.323011:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708012416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783073998.323055:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708012416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 45us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073998.323062:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 698 00000100:00100000:2.0:1783073998.323084:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 699 00000100:00100000:2.0:1783073998.323090:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708012288:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783073998.323115:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708012288:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783073998.323121:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 699 00000100:00080000:3.0:1783073998.324264:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783073998.446544:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783073998.767472:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723459712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783073998.767540:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.767608:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459712 00000100:00100000:3.0:1783073998.767616:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459712 00000100:00100000:3.0:1783073998.767661:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1783073998.767670:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723459712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783073998.767696:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783073998.767737:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723459712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073998.767750:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1783073998.767793:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723459712:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783073998.768420:0:83248:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2837986108090ns, next at 2838986106068ns, rc = 0 00000100:00100000:3.0:1783073998.768439:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783073998.768448:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723459840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783073998.768476:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073998.768507:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459840 00000100:00100000:3.0:1783073998.768511:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459840 00000100:00100000:3.0:1783073998.768536:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1783073998.768543:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723459840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783073998.768560:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783073998.768596:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723459840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073998.768602:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1783073998.768632:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723459840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783073999.278799:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723459968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783073999.278866:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073999.278922:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723459968 00000100:00100000:3.0:1783073999.278931:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723459968 00000100:00100000:1.0:1783073999.278960:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783073999.278968:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723460096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783073999.278984:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:1.0:1783073999.278995:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783073999.278999:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723459968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783073999.279029:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783073999.279040:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460096 00000100:00100000:1.0:1783073999.279044:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460096 00000100:00100000:1.0:1783073999.279083:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1783073999.279090:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723460096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783073999.279102:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783073999.279304:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723460224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783073999.279412:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723459968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783073999.280921:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723460096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1825us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1783073999.280932:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:3.0:1783073999.282036:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723459968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3038us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783073999.282048:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1783073999.282230:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723460096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783073999.282389:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783073999.282497:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460224 00000100:00100000:0.0:1783073999.282503:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460224 00000100:00100000:0.0:1783073999.282629:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571 00000100:00100000:0.0:1783073999.282638:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723460224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783073999.282670:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:0.0:1783073999.282724:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723460224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783073999.282731:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571 00000100:00100000:3.0:1783073999.282791:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723460224:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783073999.472947:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783073999.766429:0:83960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 06:19:58 (1783073998) 00000004:00080000:3.0:1783074000.263296:0:83230:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783074000.263344:0:83230:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:3.0:1783074000.263351:0:83230:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1783074000.263408:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074000.263428:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723460352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783074000.263489:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074000.263523:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460352 00000100:00100000:3.0:1783074000.263530:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460352 00010000:00010000:0.0:1783074000.263587:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.263598:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.263605:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.263611:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074000.263616:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.263623:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.263639:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9524d31ac400) 00010000:00010000:0.0:1783074000.263642:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074000.263656:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.263662:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016de4c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783074000.263703:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074000.263742:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4865 00000100:00100000:3.0:1783074000.263752:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723460352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783074000.263781:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1698 count 1 00010000:00010000:3.0:1783074000.264672:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.264694:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 5 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.264703:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=208s v=(0 0) 00010000:00010000:3.0:1783074000.264708:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074000.264712:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.264744:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 5 pid: 8444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.264757:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 5 pid: 8444 timeout: 2939 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074000.264770:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1869685723460480:192.168.204.26@tcp:104: 00000100:00100000:3.0:1783074000.265887:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e0134540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074000.269897:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1869685723460480:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074000.269926:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074000.270200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074000.270263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012800 00000100:00100000:3.0:1783074000.270270:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012800 00000100:00080000:0.0:1783074000.270332:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783074000.270334:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 6 pid: 8444 timeout: 2939 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074000.270369:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2569 00000100:00100000:3.0:1783074000.270379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708012800:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074000.270394:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074000.270401:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 6 pid: 8444 timeout: 2939 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.270414:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 6 pid: 8444 timeout: 2939 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.270643:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e75fb3/0x5fb609b3016de079 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed0 expref: 6 pid: 8444 timeout: 2939 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.270660:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074000.270669:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074000.270675:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.270694:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.270724:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074000.270778:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708012800:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 399us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074000.270786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2569 00010000:00010000:1.0:1783074000.271828:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074000.271855:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074000.271877:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074000.271885:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074000.271911:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074000.271952:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074000.271959:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.271966:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074000.271970:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.271976:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.272001:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.272009:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016de4d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.272030:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074000.272032:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074000.272034:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074000.272541:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723460352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8789us (9049us total) trans 4294968711 rc 0/0 00000100:00100000:1.0:1783074000.272551:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4865 00000004:00080000:2.0:1783074000.272663:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9524f4bbca80/2, rc 0, transno 4294968711 00000100:00100000:2.0:1783074000.272671:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723460352:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1783074000.273953:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968711 is committed 00000100:00100000:1.0:1783074000.308337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074000.308376:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708012928 00000100:00100000:2.0:1783074000.308387:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708012928 00000100:00080000:0.0:1783074000.308756:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074000.308767:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1001 00000100:00100000:2.0:1783074000.308780:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:64766:x1869685708012928:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074000.308799:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074000.308824:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016de4e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af0f expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.308887:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de4e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.308901:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.308929:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074000.308975:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074000.308996:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783074000.309021:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.309046:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016de4e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af0f expref: 7 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.309061:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de4e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af0f expref: 6 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.309070:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f44eec00) 00010000:00010000:2.0:1783074000.309074:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074000.309078:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298800, rc 0) 00000100:00100000:2.0:1783074000.309148:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64766:x1869685708012928:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 370us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074000.309157:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1001 00000100:00100000:0.0:1783074000.314030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074000.314087:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013056 00000100:00100000:2.0:1783074000.314097:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013056 00000100:00100000:2.0:1783074000.314161:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1002 00000100:00100000:2.0:1783074000.314172:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64766:x1869685708013056:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074000.314209:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:2.0:1783074000.314553:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64766:x1869685708013056:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 381us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074000.314561:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1002 00000100:00100000:0.0:1783074000.316419:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074000.316457:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013184 00000100:00100000:0.0:1783074000.316465:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013184 00000100:00100000:0.0:1783074000.316520:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1003 00000100:00100000:0.0:1783074000.316531:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64766:x1869685708013184:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074000.316576:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00080000:1.0:1783074000.316603:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074000.316651:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64766:x1869685708013184:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 122us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074000.316659:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1003 00000100:00100000:1.0:1783074000.320566:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074000.320809:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013312 00000100:00100000:0.0:1783074000.320819:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013312 00000100:00100000:0.0:1783074000.320872:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1605 00000100:00100000:0.0:1783074000.320883:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:64766:x1869685708013312:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074000.320913:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074000.321637:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:64766:x1869685708013312:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 752us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074000.321647:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1605 00000100:00100000:1.0:1783074000.326580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074000.326641:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013440 00000100:00100000:3.0:1783074000.326651:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013440 00000100:00080000:1.0:1783074000.326695:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074000.326719:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1606 00000100:00100000:3.0:1783074000.326730:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c5586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:64766:x1869685708013440:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074000.326763:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074000.326829:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c5586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:64766:x1869685708013440:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074000.326837:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1606 00000100:00100000:3.0:1783074000.361343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074000.361615:0:66209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013568 00000100:00100000:0.0:1783074000.361625:0:66209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013568 00000100:00100000:0.0:1783074000.361679:0:66209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1783074000.361688:0:66209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6afa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64773:x1869685708013568:12345-192.168.204.26@tcp:700:mcreate.0 00000100:00100000:0.0:1783074000.361776:0:66209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6afa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64773:x1869685708013568:12345-192.168.204.26@tcp:700:mcreate.0 Request processed in 88us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074000.361784:0:66209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:3.0:1783074000.363695:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074000.364143:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013824 00000100:00100000:0.0:1783074000.364158:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013824 00000100:00100000:0.0:1783074000.364214:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1004 00000100:00100000:0.0:1783074000.364223:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:64773:x1869685708013824:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00010000:0.0:1783074000.364273:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074000.364297:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de4e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af0f expref: 6 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.364327:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f44eec00) 00010000:00010000:0.0:1783074000.364340:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074000.364393:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.364403:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.364409:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.364417:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.364421:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.364425:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368897:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368911:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368924:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368931:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368938:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074000.368943:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368950:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368968:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1000) 00010000:00010000:2.0:1783074000.368971:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074000.368976:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.368983:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de4ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074000.369001:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6cd7969 reply state 000000004ffdede7 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.369014:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.369022:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1400) 00010000:00010000:2.0:1783074000.369024:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074000.369026:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074000.369430:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:64773:x1869685708013824:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 5204us (5736us total) trans 98784247810 rc 0/0 00000100:00100000:2.0:1783074000.369443:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1004 00000100:00100000:2.0:1783074000.382699:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074000.382777:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013952 00000100:00100000:3.0:1783074000.382786:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013952 00000100:00100000:3.0:1783074000.382878:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1005 00000100:00100000:3.0:1783074000.382888:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:64777:x1869685708013952:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074000.382919:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074000.382941:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671400/0x5fb609b3016de4fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af16 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.383022:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016de503 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.383035:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016de503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.383046:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016de503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074000.383091:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074000.383095:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783074000.383126:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016de503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.383150:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671400/0x5fb609b3016de4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af16 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.383165:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016de503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af16 expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.383173:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4c00) 00010000:00010000:3.0:1783074000.383175:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074000.383179:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671200, rc 0) 00000100:00100000:3.0:1783074000.383237:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:64777:x1869685708013952:12345-192.168.204.26@tcp:101:rm.0 Request processed in 351us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074000.383245:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1005 00000100:00100000:2.0:1783074000.386242:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074000.386387:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014080 00000100:00100000:0.0:1783074000.386394:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014080 00000100:00100000:0.0:1783074000.386462:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1006 00000100:00100000:0.0:1783074000.386470:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:64777:x1869685708014080:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:0.0:1783074000.386495:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074000.386509:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de50a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af1d expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386560:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386571:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386580:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386591:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386598:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386605:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386683:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386691:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386698:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074000.386735:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:0.0:1783074000.386744:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1783074000.386764:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386776:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386786:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386792:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386799:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386805:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386811:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074000.386816:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386824:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386835:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4c00) 00010000:00010000:0.0:1783074000.386838:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074000.386843:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386849:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386875:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386881:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386887:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386892:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074000.386896:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386902:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386910:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1400) 00010000:00010000:0.0:1783074000.386912:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074000.386915:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386921:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361c00/0x5fb609b3016de518 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386944:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361200/0x5fb609b3016de50a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af1d expref: 10 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386957:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af1d expref: 9 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074000.386974:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9524fb6f1200) 00010000:00010000:0.0:1783074000.386976:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074000.386978:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360c00, rc 0) 00000100:00100000:0.0:1783074000.387039:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:64777:x1869685708014080:12345-192.168.204.26@tcp:101:rm.0 Request processed in 569us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074000.387047:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1006 00000100:00100000:1.0:1783074000.390666:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074000.390743:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014336 00000100:00100000:2.0:1783074000.390751:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014336 00000100:00100000:2.0:1783074000.390887:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1007 00000100:00100000:2.0:1783074000.390897:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:64777:x1869685708014336:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1783074000.390946:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783074000.390970:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360c00/0x5fb609b3016de51f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af1d expref: 9 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.390988:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9524fb6f1200) 00010000:00010000:2.0:1783074000.391005:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016de503 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af16 expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391015:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4c00) 00010000:00010000:2.0:1783074000.391021:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074000.391042:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391053:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391062:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391071:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391094:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391116:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391191:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391199:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391206:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391428:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391437:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391445:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391453:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391460:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391466:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391495:0:67186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074000.391515:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391521:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391528:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391535:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074000.391538:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391545:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391554:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9524f44eef00) 00010000:00010000:2.0:1783074000.391556:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783074000.391559:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391566:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de534 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391580:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391586:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391591:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391602:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391612:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074000.391615:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391622:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391630:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f44ee800) 00010000:00010000:2.0:1783074000.391632:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074000.391634:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391641:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016de526 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074000.391658:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f102ea6 reply state 00000000a3dccac9 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.391661:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074000.391671:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391674:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074000.391686:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1400) 00010000:00010000:2.0:1783074000.391691:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074000.391692:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc0c63ce0) 00000100:00100000:2.0:1783074000.391694:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783074000.391697:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.391705:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.391718:0:46245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9524f44eef00) 00010000:00010000:3.0:1783074000.391721:0:46245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783074000.391724:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.391729:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016de53b lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074000.391745:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074000.391747:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074000.391749:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074000.391759:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:64777:x1869685708014336:12345-192.168.204.26@tcp:36:rm.0 Request processed in 863us (1099us total) trans 98784247811 rc 0/0 00000100:00100000:2.0:1783074000.391768:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1007 00010000:00010000:3.0:1783074000.496450:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074001.327646:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723460608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074001.327736:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074001.327823:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460608 00000100:00100000:0.0:1783074001.327830:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460608 00000100:00100000:0.0:1783074001.327894:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572 00000100:00100000:0.0:1783074001.327903:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723460608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783074001.327944:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:0.0:1783074001.327987:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723460608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074001.327994:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572 00000100:00100000:1.0:1783074001.328066:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723460608:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783074001.518879:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074002.543613:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074003.374471:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723460736:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.374544:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374583:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723461120:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374624:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374653:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c643b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723461632:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374674:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374690:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723462144:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374717:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374744:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783074003.374759:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723461248:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374802:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374820:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723461760:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374840:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374856:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723462272:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374875:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374899:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723460864:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374921:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374934:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723461376:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374954:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374966:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723461888:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.374982:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.374997:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783074003.375002:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723460992:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375019:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.375033:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723461504:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375064:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.375088:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723462016:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375108:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074003.375132:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461120 00000100:00100000:2.0:1783074003.375138:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461120 00000100:00100000:2.0:1783074003.375187:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461248 00000100:00100000:2.0:1783074003.375190:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461248 00000100:00100000:2.0:1783074003.375205:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461760 00000100:00100000:2.0:1783074003.375207:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461760 00000100:00100000:2.0:1783074003.375219:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462272 00000100:00100000:2.0:1783074003.375221:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462272 00000100:00100000:2.0:1783074003.375232:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460864 00000100:00100000:2.0:1783074003.375235:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460864 00000100:00100000:2.0:1783074003.375252:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460992 00000100:00100000:2.0:1783074003.375255:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460992 00000100:00100000:2.0:1783074003.375273:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1783074003.375281:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723461120:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783074003.375304:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c52c8700 x1869685723461120/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:329/0 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074003.375368:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723461120:12345-0@lo:400:kworker.0 Request processed in 87us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375376:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1783074003.375393:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1783074003.375399:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723461248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375427:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723461248:12345-0@lo:400:kworker.0 Request processed in 29us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375433:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1783074003.375451:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1783074003.375457:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723461760:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783074003.375479:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4af7800 x1869685723461760/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:329/0 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074003.375488:0:83239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723460736 00000100:00100000:1.0:1783074003.375510:0:83239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723460736 00000100:00100000:2.0:1783074003.375515:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723461760:12345-0@lo:400:kworker.0 Request processed in 56us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375522:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1783074003.375540:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1783074003.375547:0:83239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783074003.375547:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1783074003.375550:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723462272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.375560:0:83239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723460736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.375560:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723460864:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783074003.375566:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f0929500 x1869685723462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:329/0 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:0.0:1783074003.375577:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4679500 x1869685723460864/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:329/0 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074003.375611:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723462272:12345-0@lo:400:kworker.0 Request processed in 64us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074003.375614:0:83239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723460736:12345-0@lo:400:kworker.0 Request processed in 57us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074003.375619:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723460864:12345-0@lo:400:kworker.0 Request processed in 64us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375622:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1783074003.375632:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1783074003.375640:0:83239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783074003.375646:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1783074003.375657:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723460992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.375673:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461632 00000100:00100000:1.0:1783074003.375677:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462144 00000100:00100000:0.0:1783074003.375679:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461632 00000100:00100000:1.0:1783074003.375680:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462144 00000100:00100000:2.0:1783074003.375695:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723460992:12345-0@lo:400:kworker.0 Request processed in 40us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375702:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1783074003.375710:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461504 00000100:00100000:0.0:1783074003.375715:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461504 00000100:00100000:1.0:1783074003.375722:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462016 00000100:00100000:1.0:1783074003.375725:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462016 00000100:00100000:2.0:1783074003.375734:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461376 00000100:00100000:3.0:1783074003.375739:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1783074003.375740:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461376 00000100:00100000:0.0:1783074003.375749:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1783074003.375754:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723461632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.375762:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1783074003.375762:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723462144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.375768:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c57eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723461504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375778:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723461888 00000100:00100000:2.0:1783074003.375782:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723461888 00000100:00100000:2.0:1783074003.375809:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573 00000100:00100000:2.0:1783074003.375816:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723461376:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783074003.375832:0:8453:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4678700 x1869685723461376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:329/0 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074003.375837:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723461632:12345-0@lo:400:kworker.0 Request processed in 86us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074003.375839:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c57eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723461504:12345-0@lo:400:kworker.0 Request processed in 68us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074003.375839:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723462144:12345-0@lo:400:kworker.0 Request processed in 80us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074003.375855:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1783074003.375861:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1783074003.375873:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1783074003.375883:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1783074003.375893:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c57edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723462016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375905:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723461376:12345-0@lo:400:kworker.0 Request processed in 87us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375912:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573 00000100:00080000:1.0:1783074003.375916:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074003.375921:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723460736:0@lo:400:kworker.0 00000100:00080000:1.0:1783074003.375922:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074003.375925:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074003.375928:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074003.375936:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574 00000100:00100000:3.0:1783074003.375942:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c57edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723462016:12345-0@lo:400:kworker.0 Request processed in 48us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.375949:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723461888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.375961:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723461248:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.375962:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723460992:0@lo:400:kworker.0 00000100:00100000:3.0:1783074003.375966:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1783074003.375979:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723461760:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.375979:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723461504:0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.375995:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723462272:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.375999:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723461888:12345-0@lo:400:kworker.0 Request processed in 52us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.376008:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574 00000100:00100000:1.0:1783074003.376011:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723461120:0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.376024:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c643b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723461632:0@lo:400:kworker.0 00000100:00100000:1.0:1783074003.376036:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723462144:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.376372:0:3658:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968711 gen 2 00000004:00080000:0.0:1783074003.376377:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9524f4bbca80, transno 4294968711 00000100:00100000:0.0:1783074003.376392:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723462016:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.376403:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723460864:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.376412:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723461376:0@lo:400:kworker.0 00000100:00100000:0.0:1783074003.376421:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723461888:0@lo:400:kworker.0 00000100:00100000:2.0:1783074003.442416:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074003.442452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074003.442489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074003.442491:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014592 00000100:00100000:3.0:1783074003.442494:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014848 00000100:00100000:0.0:1783074003.442501:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014592 00000100:00100000:3.0:1783074003.442502:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014848 00000100:00100000:2.0:1783074003.442516:0:83236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014464 00000100:00100000:2.0:1783074003.442521:0:83236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014464 00000100:00100000:2.0:1783074003.442570:0:83236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 157 00000100:00100000:3.0:1783074003.442575:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2037 00000100:00100000:2.0:1783074003.442582:0:83236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708014464:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074003.442588:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c394bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708014848:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074003.442643:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c394bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708014848:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074003.442650:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2037 00000100:00080000:3.0:1783074003.442677:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074003.442682:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074003.442702:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 706 00000100:00100000:2.0:1783074003.442709:0:83236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708014464:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 68us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074003.442711:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708014592:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074003.442722:0:83236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 157 00010000:00000080:0.0:1783074003.442937:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c3948e00 x1869685708014592/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074003.442984:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708014592:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 274us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074003.442990:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 706 00000100:00100000:3.0:1783074003.444534:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074003.444621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074003.444838:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014720 00000100:00100000:3.0:1783074003.444845:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014720 00000100:00100000:3.0:1783074003.444898:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 707 00000100:00100000:3.0:1783074003.444908:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708014720:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074003.444977:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708014720:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 70us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074003.444991:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 707 00000100:00100000:3.0:1783074003.445014:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014976 00000100:00100000:3.0:1783074003.445018:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014976 00000100:00100000:3.0:1783074003.445056:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2038 00000100:00100000:3.0:1783074003.445064:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708014976:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074003.445103:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708014976:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074003.445120:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2038 00000100:00080000:3.0:1783074003.445152:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074003.445157:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783074003.566752:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074003.887418:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074003.887443:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723462400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074003.887507:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074003.887579:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462400 00000100:00100000:3.0:1783074003.887586:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462400 00000100:00100000:3.0:1783074003.887645:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:3.0:1783074003.887657:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723462400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074003.887690:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074003.887951:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723462400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074003.887961:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:3.0:1783074003.888020:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723462400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074003.888111:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723462528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074003.888948:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074003.889007:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462528 00000100:00100000:3.0:1783074003.889012:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462528 00000100:00100000:3.0:1783074003.889063:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:3.0:1783074003.889074:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723462528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783074003.889097:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074003.889150:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723462528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074003.889159:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:3.0:1783074003.889234:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723462528:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1783074003.906906:0:84356:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1783074003.941303:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074003.941492:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015104 00000100:00100000:2.0:1783074003.941502:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015104 00000100:00100000:2.0:1783074003.941549:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1008 00000100:00100000:2.0:1783074003.941559:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:64843:x1869685708015104:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074003.941579:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074003.941600:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016de542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af24 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074003.941673:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de549 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074003.941687:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074003.941700:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074003.941739:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074003.941744:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783074003.941762:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074003.941785:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016de542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af24 expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074003.941800:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de549 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af24 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074003.941809:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524c35fbe00) 00010000:00010000:2.0:1783074003.941811:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074003.941814:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299400, rc 0) 00010000:00000080:2.0:1783074003.941821:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524faad4e00 x1869685708015104/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 576/688 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074003.941891:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:64843:x1869685708015104:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 333us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074003.941899:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1008 00000100:00100000:2.0:1783074003.944512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074003.944588:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015232 00000100:00100000:0.0:1783074003.944595:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015232 00000100:00100000:0.0:1783074003.944687:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1009 00000100:00100000:0.0:1783074003.944697:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:64843:x1869685708015232:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074003.944713:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074003.944727:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360200/0x5fb609b3016de550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af2b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944780:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944793:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944803:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944817:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944824:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944831:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944882:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944890:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944896:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944903:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944908:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074003.944913:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944920:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944932:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524c35fbe00) 00010000:00010000:0.0:1783074003.944935:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074003.944939:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944946:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360e00/0x5fb609b3016de557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944955:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944961:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944973:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944978:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074003.944981:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944987:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.944996:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9524fb6f1100) 00010000:00010000:0.0:1783074003.944999:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074003.945003:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.945008:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de55e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.945047:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360200/0x5fb609b3016de550 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af2b expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.945057:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524c35fbe00) 00010000:00010000:0.0:1783074003.945059:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074003.945063:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360200/0x5fb609b3016de550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af2b expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.945072:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360200, rc 0) 00010000:00000080:0.0:1783074003.945080:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c394a680 x1869685708015232/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 592/584 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074003.945181:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:64843:x1869685708015232:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 485us (675us total) trans 0 rc 301/301 00000100:00100000:0.0:1783074003.945188:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1009 00000100:00100000:3.0:1783074003.948206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074003.948287:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015488 00000100:00100000:0.0:1783074003.948295:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015488 00000100:00100000:0.0:1783074003.948511:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1010 00000100:00100000:0.0:1783074003.948522:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:64843:x1869685708015488:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074003.948538:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074003.948540:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783074003.948560:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016de549 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af24 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948574:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524c35fbe00) 00010000:00010000:0.0:1783074003.948583:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074003.948595:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361400/0x5fb609b3016de565 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af32 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948679:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948691:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948701:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948712:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948731:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.948738:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949098:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949105:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949110:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074003.949116:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783074003.949132:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949136:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949140:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949144:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074003.949147:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949151:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949164:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1c00) 00010000:00010000:0.0:1783074003.949166:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074003.949168:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949172:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360400/0x5fb609b3016de56c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074003.949178:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2037139 reply state 00000000ae1d98c5 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949187:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949193:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9524fb6f1900) 00010000:00010000:0.0:1783074003.949195:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074003.949197:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074003.949220:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361400/0x5fb609b3016de565 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 12 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949236:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 11 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.949243:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9524fb6f1600) 00010000:00010000:0.0:1783074003.949245:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074003.949247:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360600, rc 0) 00010000:00000080:0.0:1783074003.949254:0:66201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524e406d500 x1869685708015488/t98784247812(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 536/608 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074003.949429:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:64843:x1869685708015488:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 908us (1227us total) trans 98784247812 rc 0/0 00000100:00100000:0.0:1783074003.949445:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1010 00000100:00100000:2.0:1783074003.952297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074003.952548:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015744 00000100:00100000:0.0:1783074003.952558:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015744 00000100:00100000:0.0:1783074003.952610:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1011 00000100:00100000:0.0:1783074003.952620:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:64843:x1869685708015744:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074003.952642:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074003.952662:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360200/0x5fb609b3016de588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af39 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.952903:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.952918:0:66200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 13 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.952926:0:66200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.952958:0:66200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 13 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074003.952972:0:66200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 13 pid: 66201 timeout: 2943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074003.952985:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66200:1869685723462656:192.168.204.26@tcp:104: 00000100:00100000:0.0:1783074003.953102:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712300 going to sleep for 11 seconds 00000100:00100000:2.0:1783074003.956737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074003.956883:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66200:1869685723462656:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074003.956909:0:66200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074003.957028:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015872 00000100:00100000:1.0:1783074003.957043:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015872 00010000:00010000:1.0:1783074003.957073:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 14 pid: 66201 timeout: 2943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074003.957141:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2570 00000100:00100000:1.0:1783074003.957152:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c394b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:2405:x1869685708015872:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074003.957168:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074003.957175:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 14 pid: 66201 timeout: 2943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074003.957187:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 14 pid: 66201 timeout: 2943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074003.957208:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360600/0x5fb609b3016de57a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 14 pid: 66201 timeout: 2943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074003.957222:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9524fb6f1600) 00010000:00010000:1.0:1783074003.957227:0:19651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074003.957237:0:19651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074003.957244:0:19651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074003.957282:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074003.957337:0:66200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.957345:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074003.957348:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c394b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2405:x1869685708015872:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 198us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074003.957356:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2570 00000004:00200000:3.0:1783074003.957363:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783074003.958178:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958188:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958196:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958202:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074003.958205:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958211:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958222:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9524fb6f1600) 00010000:00010000:3.0:1783074003.958232:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783074003.958236:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958243:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361000/0x5fb609b3016de58f lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958298:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360200/0x5fb609b3016de588 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af39 expref: 13 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958460:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1100) 00010000:00010000:3.0:1783074003.958463:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074003.958468:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360200/0x5fb609b3016de588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af39 expref: 13 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074003.958483:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360200, rc 0) 00010000:00000080:3.0:1783074003.958491:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c394b480 x1869685708015744/t98784247813(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 712/824 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074003.958543:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:64843:x1869685708015744:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 5924us (6252us total) trans 98784247813 rc 301/301 00000100:00100000:3.0:1783074003.958551:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1011 00000100:00100000:1.0:1783074003.960560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074003.960691:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016128 00000100:00100000:0.0:1783074003.960703:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016128 00000100:00100000:0.0:1783074003.960744:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:0.0:1783074003.960752:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:64843:x1869685708016128:12345-192.168.204.26@tcp:35:lfs.0 00010000:00000080:0.0:1783074003.960893:0:66204:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c6cf5f80 x1869685708016128/t98784247814(0) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 392/456 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074003.960985:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:64843:x1869685708016128:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 234us (429us total) trans 98784247814 rc 0/0 00000100:00100000:0.0:1783074003.960992:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:3.0:1783074003.962175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074003.962684:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016384 00000100:00100000:2.0:1783074003.962691:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016384 00000100:00100000:2.0:1783074003.962734:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:2.0:1783074003.962743:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c3ceec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:64843:x1869685708016384:12345-192.168.204.26@tcp:35:lfs.0 00010000:00000080:2.0:1783074003.962878:0:80537:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c3ceec50 x1869685708016384/t98784247815(0) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:329/0 lens 392/456 e 0 to 0 dl 1783074014 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074003.962930:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c3ceec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:64843:x1869685708016384:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 187us (755us total) trans 98784247815 rc 0/0 00000100:00100000:2.0:1783074003.962939:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:0.0:1783074004.398459:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074004.398484:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723462912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074004.398550:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074004.398589:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723462784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074004.398596:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462912 00000100:00100000:1.0:1783074004.398604:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462912 00000100:00100000:0.0:1783074004.398613:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074004.398712:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723462784 00000100:00100000:1.0:1783074004.398716:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723462784 00000100:00100000:1.0:1783074004.398743:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:1.0:1783074004.398753:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723462912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074004.398776:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074004.398823:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723462912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074004.398830:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:1.0:1783074004.398849:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1783074004.398856:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723462784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074004.398866:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074004.398894:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723462784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074004.398900:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1783074004.398963:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723462912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074004.398976:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723462784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074004.402569:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723463040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074004.402639:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074004.402698:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463040 00000100:00100000:3.0:1783074004.402705:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463040 00000100:00100000:3.0:1783074004.402874:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3575 00000100:00100000:3.0:1783074004.402883:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723463040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783074004.402923:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00010000:00000080:3.0:1783074004.402938:0:23954:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524faba9c00 x1869685723463040/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:330/0 lens 224/368 e 0 to 0 dl 1783074015 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074004.402983:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723463040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074004.402990:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3575 00000100:00100000:3.0:1783074004.403049:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723463040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783074004.590529:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783074004.916903:0:84453:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783074004.916954:0:84453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.916968:0:84453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.916976:0:84453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.916983:0:84453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.917000:0:84453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783074004.917025:0:84453:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1783074004.917043:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074004.917051:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783074004.917056:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1783074004.917068:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074004.917072:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.917082:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074004.917090:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074004.917096:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074004.917098:0:6517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783074004.917101:0:6517:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1783074004.917121:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783074004.917129:0:84453:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1783074004.917135:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.917143:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1783074004.917146:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524c86b3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783074004.917168:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.917177:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52a00/0x5fb609b3016de198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de19f expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074004.917188:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723463168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074004.917190:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074004.917193:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074004.917196:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074004.917249:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074004.917528:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723463296:0@lo:39:umount.0 00000100:00100000:2.0:1783074004.917560:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074004.917596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463168 00000100:00100000:2.0:1783074004.917601:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463168 00000100:00100000:2.0:1783074004.917673:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1783074004.917680:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723463168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074004.917692:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074004.917704:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086de00/0x5fb609b3016de19f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de198 expref: 24 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074004.917716:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074004.917751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3659:x1869685723463168:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074004.917758:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1783074004.917791:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723463168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074004.917793:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463296 00000100:00100000:2.0:1783074004.917798:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463296 00000100:00100000:2.0:1783074004.917838:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1783074004.917845:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723463296:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783074004.917866:0:67186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de29b 00000100:00080000:2.0:1783074004.917872:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524f41af000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783074004.917900:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:2.0:1783074004.917902:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f469a300 x1869685723463296/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:330/0 lens 224/224 e 0 to 0 dl 1783074015 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074004.917941:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869685723463296:12345-0@lo:39:umount.0 Request processed in 96us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074004.917949:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00080000:0.0:1783074004.917956:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c86b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1783074004.917957:0:67186:0:(genops.c:906:class_export_put()) final put ffff9524de7c3800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1783074004.917971:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723463296:0@lo:39:umount.0 00000020:00000080:2.0:1783074004.917990:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524de7c3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1783074004.917993:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074004.917996:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074004.918000:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074004.918045:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f41af000 for lustre-MDT0000 00010000:00010000:0.0:1783074004.918947:0:84453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.918958:0:84453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.918970:0:84453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.918977:0:84453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919001:0:84453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074004.919007:0:84453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919033:0:84453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919040:0:84453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919047:0:84453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919048:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074004.919057:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919067:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074004.919071:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919080:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074004.919087:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074004.919093:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783074004.919096:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783074004.919116:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919123:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074004.919128:0:84453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074004.919138:0:84453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919147:0:84453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919150:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919156:0:84453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919162:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299800/0x5fb609b3016de0bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de0c6 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919168:0:84453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074004.919174:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074004.919179:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074004.919183:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074004.919183:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919191:0:84453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074004.919192:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074004.919194:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299e00 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:3.0:1783074004.919200:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074004.919201:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919202:0:84453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919219:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074004.919227:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919227:0:84453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074004.919228:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919251:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074004.919252:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074004.919273:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074004.919274:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074004.919277:0:84453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074004.919288:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783074004.919289:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1783074004.919294:0:84453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074004.919295:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783074004.919295:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:3.0:1783074004.919301:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1783074004.919336:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1783074004.919339:0:84453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783074004.919345:0:84453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:1.0:1783074004.919350:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723463424:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1783074004.919350:0:84453:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1783074004.919387:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074004.919393:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074004.919395:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074004.919403:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074004.919407:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919416:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074004.919423:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074004.919429:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783074004.919432:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783074004.919435:0:8460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783074004.919449:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074004.919455:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919462:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074004.919483:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919490:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016de0b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de0b8 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074004.919504:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074004.919508:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074004.919511:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074004.919524:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723463552:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1783074004.919529:0:84453:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783074004.919534:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783074004.919539:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1783074004.919544:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:0.0:1783074004.919545:0:84453:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1783074004.919555:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783074004.919555:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074004.919574:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919591:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016de18a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de191 expref: -99 pid: 83229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074004.919597:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463424 00000100:00100000:1.0:1783074004.919601:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463424 00010000:00010000:3.0:1783074004.919604:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074004.919606:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074004.919608:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074004.919618:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074004.919627:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723463680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074004.919633:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463552 00000100:00100000:1.0:1783074004.919635:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463552 00000100:00100000:3.0:1783074004.919661:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074004.919661:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1783074004.919670:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723463424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074004.919680:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074004.919692:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159000/0x5fb609b3016de0c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de0bf expref: 24 pid: 83235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.919702:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074004.919714:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074004.919716:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463680 00000100:00100000:3.0:1783074004.919722:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463680 00000100:00100000:1.0:1783074004.919731:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3661:x1869685723463424:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074004.919737:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00010000:00010000:2.0:1783074004.919751:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783074004.919756:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1783074004.919767:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3661:x1869685723463552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074004.919771:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.919775:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074004.919783:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299e00/0x5fb609b3016de1bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de1c2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.919788:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53c00/0x5fb609b3016de0b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de0b1 expref: 22 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.919804:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074004.919805:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074004.919807:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074004.919809:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074004.919831:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723463552:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074004.919839:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1783074004.919865:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074004.919879:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723463808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074004.919890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1783074004.919899:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c40a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3659:x1869685723463680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074004.919907:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783074004.919907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074004.919924:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299a00/0x5fb609b3016de191 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de18a expref: 21 pid: 83236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.919935:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074004.919941:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463808 00000100:00100000:1.0:1783074004.919944:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463808 00000100:00100000:3.0:1783074004.919964:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c40a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3659:x1869685723463680:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074004.919971:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1783074004.919980:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1783074004.919987:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3658:x1869685723463808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074004.919994:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074004.920003:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c800/0x5fb609b3016de1c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de1bb expref: 20 pid: 83239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.920029:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074004.920062:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3658:x1869685723463808:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074004.920069:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1783074004.920105:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723463808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074004.920138:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723463552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074004.920151:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fababb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723463424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074004.920199:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723463680:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1783074004.922072:0:84453:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1783074004.922793:0:83230:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000020:00000080:0.0:1783074004.923000:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1783074004.923023:0:84453:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c356a000 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 192.168.204.26@tcp 7 (0 0 0) 0 0 0 3: ffff9524d0b6b000 98784247815 stale:0 00000020:00080000:0.0:1783074004.923030:0:84453:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524d2ca4000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783074004.923035:0:84453:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524fb6b3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783074004.923039:0:84453:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524fb6b1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783074004.923044:0:84453:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c6022000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783074004.923049:0:84453:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9524f4b919c0) has exports, disconnecting them 00000020:00080000:0.0:1783074004.923053:0:84453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.26@tcp (ffff9524c356a000), last request at 1783074003 00000020:00000080:0.0:1783074004.923060:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de485 00000100:00080000:0.0:1783074004.923069:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524c3568000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783074004.923092:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524c356a000): rc 0 00010000:00010000:2.0:1783074004.923095:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783074004.923097:0:84453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524d2ca4000), last request at 1783073806 00000020:00000080:0.0:1783074004.923102:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de294 00000100:00080000:0.0:1783074004.923106:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca4800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783074004.923129:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524d2ca4000): rc 0 00000020:00000080:0.0:1783074004.923132:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524d2ca4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783074004.923148:0:84453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524fb6b3800), last request at 1783074003 00000020:00000080:0.0:1783074004.923151:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de28d 00000100:00080000:0.0:1783074004.923155:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783074004.923163:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524fb6b3800): rc 0 00000020:00000080:0.0:1783074004.923165:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524fb6b3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783074004.923169:0:84453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524fb6b1800), last request at 1783074003 00000020:00000080:0.0:1783074004.923171:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de286 00000100:00080000:0.0:1783074004.923181:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783074004.923208:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524fb6b1800): rc 0 00000020:00000080:0.0:1783074004.923210:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524fb6b1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783074004.923215:0:84453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c6022000), last request at 1783073801 00000020:00000080:0.0:1783074004.923218:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de10c 00010000:00010000:2.0:1783074004.923221:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074004.923227:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca0000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783074004.923229:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074004.923243:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783074004.923243:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c6022000): rc 0 00000020:00000080:0.0:1783074004.923247:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c6022000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1783074004.923255:0:84453:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd3bc15efae0 00000100:00080000:0.0:1783074004.923271:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074004.923275:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411437 gen 3 00000020:00000080:3.0:1783074004.923577:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074004.923621:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb6b3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074004.923636:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb6b1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074004.923656:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6022000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074004.923676:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d2ca4800 for lustre-MDT0000 00000020:00000080:3.0:1783074004.923681:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb6b0000 for lustre-MDT0000 00000020:00000080:3.0:1783074004.923685:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb6b7000 for lustre-MDT0000 00000020:00000080:3.0:1783074004.923689:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d2ca0000 for lustre-MDT0000 00010000:00010000:3.0:1783074004.923699:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074004.924089:0:84453:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783074004.924108:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524c6020000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783074004.924212:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924235:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074004.924239:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723463936:0@lo:39:umount.0 00010000:00010000:1.0:1783074004.924247:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924254:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074004.924266:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924274:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924290:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1400) 00010000:00010000:1.0:1783074004.924294:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074004.924298:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924304:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360800/0x5fb609b3016de4f5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074004.924333:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074004.924339:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924347:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924353:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924359:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074004.924363:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074004.924364:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723463936 00000100:00100000:3.0:1783074004.924372:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723463936 00010000:00010000:1.0:1783074004.924373:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924384:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1400) 00010000:00010000:1.0:1783074004.924386:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074004.924395:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924401:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299000/0x5fb609b3016de52d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924420:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924427:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924433:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924438:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074004.924441:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924447:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074004.924457:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9524fb6f1900) 00010000:00010000:1.0:1783074004.924460:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074004.924463:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074004.924468:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576 00010000:00010000:1.0:1783074004.924473:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb360000/0x5fb609b3016de573 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074004.924486:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723463936:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783074004.924489:0:3644:0:(genops.c:906:class_export_put()) final put ffff9524c356a000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000100:00080000:0.0:1783074004.924503:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783074004.924507:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968711 gen 3 00000020:00000080:3.0:1783074004.924510:0:8453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de13d 00000100:00080000:3.0:1783074004.924518:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9524f08dc800 : changing import state from FULL to CLOSED 00000004:00080000:0.0:1783074004.924523:0:84453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:3.0:1783074004.924537:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411437 00000100:00080000:0.0:1783074004.924585:0:84453:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783074004.924599:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9523c4e78800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783074004.924617:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783074004.924625:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968706 gen 3 00000004:00080000:0.0:1783074004.924636:0:84453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074004.924694:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723464064:0@lo:9:umount.0 00000100:00100000:3.0:1783074004.924699:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3657:x1869685723463936:12345-0@lo:39:umount.0 Request processed in 216us (392us total) trans 77309411438 rc 0/0 00000100:00080000:0.0:1783074004.924709:0:84453:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783074004.924714:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576 00000100:00080000:0.0:1783074004.924723:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524c86a8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783074004.924743:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783074004.924785:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f4b919c0) has no exports 00000100:00080000:1.0:1783074004.924797:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c6020000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783074004.924804:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723463936:0@lo:39:umount.0 00000100:00100000:1.0:1783074004.924814:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723464192:0@lo:9:umount.0 00000100:00100000:1.0:1783074004.924845:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074004.924892:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074004.924897:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464064 00000020:00000080:3.0:1783074004.924901:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c356a000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-MDT0000 00000100:00100000:0.0:1783074004.924903:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464064 00000100:00100000:0.0:1783074004.924945:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464192 00000020:00000080:3.0:1783074004.924946:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c3568000 for lustre-MDT0000 00000100:00100000:0.0:1783074004.924949:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464192 00000100:00100000:0.0:1783074004.924991:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4866 00000100:00100000:0.0:1783074004.925001:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723464064:12345-0@lo:9:umount.0 00000100:00100000:3.0:1783074004.925004:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4867 00000100:00100000:3.0:1783074004.925027:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723464192:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783074004.925028:0:26176:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de160 00000100:00080000:0.0:1783074004.925037:0:26176:0:(import.c:65:import_set_state_nolock()) ffff9523c2c29800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783074004.925046:0:26168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de183 00000100:00080000:3.0:1783074004.925054:0:26168:0:(import.c:65:import_set_state_nolock()) ffff9524d08ce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783074004.925075:0:26176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968711 00010000:00010000:1.0:1783074004.925086:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783074004.925098:0:26168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968706 00000100:00100000:0.0:1783074004.925202:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723464064:12345-0@lo:9:umount.0 Request processed in 202us (460us total) trans 0 rc 0/0 00000020:00080000:1.0:1783074004.925203:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f4b919c0) has no exports 00000100:00100000:0.0:1783074004.925213:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4866 00000100:00100000:3.0:1783074004.925225:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723464192:12345-0@lo:9:umount.0 Request processed in 209us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074004.925234:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4867 00000100:00080000:0.0:1783074004.925248:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c86a8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783074004.925263:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783074004.925266:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1783074004.925270:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074004.925270:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723464192:0@lo:9:umount.0 00000100:00080000:0.0:1783074004.925285:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4e78800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783074004.925302:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783074004.925304:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074004.925306:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723464064:0@lo:9:umount.0 00000020:00000080:1.0:1783074004.950247:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de121 00000020:00000080:1.0:1783074004.950263:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c6cab800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783074004.950356:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783074004.950413:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6cab800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783074004.950436:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074004.950449:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783074004.950453:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9523c338cd40) has no exports 00000020:00000080:0.0:1783074004.951083:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de11a 00000020:00000080:0.0:1783074004.951101:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c6cae000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074004.951162:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074004.951170:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783074004.951173:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c4403800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783074004.951175:0:84453:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4403800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783074004.951195:0:84453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783074004.951407:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6cae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783074004.951498:0:84453:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524fb756d80 - data ffff9524fbedeaf8/ffff9524fb121c00 00000020:01000000:0.0:1783074004.951628:0:84453:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c680f600 - data ffff9524fbc8c948/ffff952501ed8c00 00000100:00080000:1.0:1783074004.980254:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783074004.980262:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411437 gen 4 00000100:00100000:1.0:1783074004.980276:0:84453:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9524e4069c00 x1869685723463936/t77309411438(77309411438) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074014 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074004.980298:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783074004.981831:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783074004.981835:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968711 gen 4 00000004:00080000:1.0:1783074004.981852:0:84453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074004.981854:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783074004.982148:0:83247:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783074004.982153:0:83247:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 2 count 1 00000040:00080000:2.0:1783074004.982165:0:83247:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:1.0:1783074004.982852:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783074004.982855:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968706 gen 4 00000004:00080000:1.0:1783074004.982873:0:84453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074004.982875:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783074004.983092:0:83249:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783074004.983096:0:83249:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:2.0:1783074004.983105:0:83249:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:1.0:1783074004.985891:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de0db 00000020:00000080:1.0:1783074004.985904:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c6024000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074004.986539:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de0f0 00000020:00000080:1.0:1783074004.986544:0:84453:0:(genops.c:906:class_export_put()) final put ffff9523c4b62000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074004.986635:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6024000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783074004.986688:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783074004.986692:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074004.986711:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783074004.986716:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9524f4b94d40) has no exports 00000004:01000000:1.0:1783074004.986839:0:84453:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783074004.986845:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de16e 00000020:00000080:1.0:1783074004.986848:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524fc253800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074004.986864:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4b62000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783074004.986902:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783074004.986906:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074004.986912:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783074004.986915:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9523c2c34d40) has no exports 00000020:00000080:1.0:1783074004.986920:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de167 00000020:00000080:1.0:1783074004.986924:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c86af800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783074004.986939:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc253800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1783074004.987213:0:84453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783074004.987217:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783074004.987221:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968706 gen 5 00000004:00080000:1.0:1783074004.987226:0:84453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074004.987228:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074004.987252:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074004.987259:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074004.987264:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de152 00000020:00000080:1.0:1783074004.987268:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524fb548000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783074004.987271:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783074004.987274:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074004.987278:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783074004.987281:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9523c2284d40) has no exports 00000020:00000080:1.0:1783074004.987398:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de14b 00000020:00000080:1.0:1783074004.987402:0:84453:0:(genops.c:906:class_export_put()) final put ffff9523c4e7b800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783074004.987748:0:84453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783074004.987751:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783074004.987753:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968711 gen 5 00000004:00080000:1.0:1783074004.987756:0:84453:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074004.987758:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074004.987785:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074004.987798:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783074004.987807:0:84453:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783074004.987811:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de136 00000020:00000080:1.0:1783074004.987815:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c4406000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783074004.987819:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783074004.987822:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074004.987826:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783074004.987829:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9523c33899c0) has no exports 00000020:00000080:1.0:1783074004.987832:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de12f 00000020:00000080:1.0:1783074004.987835:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524fb54e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783074004.988213:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c86af800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074004.988222:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c86a8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783074004.988227:0:36249:0:(genops.c:906:class_export_put()) final put ffff9524fb549000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074004.988230:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb549000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783074004.988234:0:36249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074004.988326:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb548000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783074004.988331:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074004.988335:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c4e78800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783074004.988339:0:36249:0:(genops.c:906:class_export_put()) final put ffff9524fb54c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074004.988341:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783074004.988344:0:36249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074004.988368:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4406000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783074004.988374:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783074004.990723:0:84453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783074004.990731:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783074004.990735:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411437 gen 5 00000100:00100000:2.0:1783074004.990742:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074004.990799:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074004.990812:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074004.990869:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c6020000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783074004.990878:0:36249:0:(genops.c:906:class_export_put()) final put ffff9524fb54a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074004.990881:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783074004.990887:0:36249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074004.990925:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074004.990931:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074004.990934:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524f4945800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074004.990936:0:84453:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f4945800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783074004.990943:0:84453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074004.991041:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de0f7 00000020:00000080:2.0:1783074004.991048:0:84453:0:(genops.c:906:class_export_put()) final put ffff9523c2e03800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783074004.991057:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783074004.991061:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074004.991066:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783074004.991069:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9523c338b380) has no exports 00000020:00000080:2.0:1783074004.991091:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074004.991095:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783074004.991099:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de0fe 00000020:00000080:2.0:1783074004.991102:0:84453:0:(genops.c:906:class_export_put()) final put ffff9523c2e04800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783074004.991109:0:84453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524f49f8000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783074004.991112:0:84453:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49f8000 3 00000020:01000004:2.0:1783074004.991115:0:84453:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524f49f8000 from lustre-MDT0000 00000020:00000080:2.0:1783074004.991131:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074004.991135:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783074004.991138:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c6024800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783074004.991140:0:84453:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6024800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783074004.991147:0:84453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783074004.991177:0:84453:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783074004.991181:0:84453:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783074004.991184:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783074004.991187:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074004.991189:0:84453:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00000080:3.0:1783074004.991249:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2e03800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783074004.991253:0:36249:0:(genops.c:906:class_export_put()) final put ffff9524c6021800/lustre-MDD0000_UUID 00000020:00000080:3.0:1783074004.991254:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6021800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783074004.991264:0:36249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783074004.991403:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2e04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1783074004.991456:0:84453:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524d2ca3800 da924155-7591-4a6a-a2d2-c0d2908d0bfb 192.168.204.26@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074004.991619:0:84453:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524df207000 522b6a34-04f4-4017-ab45-61a21d19bfef 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074004.991630:0:84453:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9523c2c33380) has exports, disconnecting them 00000020:00080000:2.0:1783074004.991634:0:84453:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.26@tcp (ffff9524d2ca3800), last request at 1783073805 00000020:00000080:2.0:1783074004.991652:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de27f 00000020:00010000:2.0:1783074004.991655:0:84453:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524d2ca3800: total 0 00000100:00080000:2.0:1783074004.991658:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca7800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074004.991665:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524d2ca3800): rc 0 00000020:00080000:2.0:1783074004.991668:0:84453:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9524df207000), last request at 1783073801 00000020:00000080:2.0:1783074004.991712:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de09c 00000020:00010000:2.0:1783074004.991718:0:84453:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524df207000: total 0 00000100:00080000:2.0:1783074004.991721:0:84453:0:(import.c:65:import_set_state_nolock()) ffff9524df202000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074004.991728:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524df207000): rc 0 00000020:00080000:2.0:1783074004.991737:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9523c2c33380) has no exports 00000100:00100000:2.0:1783074004.991792:0:83236:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9524fb53ee00:83236] 1 exiting: rc = 0 00000020:00010000:3.0:1783074004.991800:0:8460:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524d2ca3800: total 0 00010000:00010000:3.0:1783074004.991803:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074004.991825:0:8460:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524d2ca3800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783074004.991853:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158a00/0x5fb609b3016de2b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aeec expref: 5 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.991869:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158800/0x5fb609b3016de2a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aed7 expref: 4 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.991880:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298600/0x5fb609b3016de2b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aee5 expref: 3 pid: 83239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.991891:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086dc00/0x5fb609b3016de2a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aede expref: 2 pid: 83236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.991899:0:8460:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524d2ca3800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1783074004.991918:0:8460:0:(genops.c:906:class_export_put()) final put ffff9524d2ca3800/da924155-7591-4a6a-a2d2-c0d2908d0bfb 00000020:00010000:3.0:1783074004.991932:0:8460:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524df207000: total 1 00010000:00010000:3.0:1783074004.991953:0:8460:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524df207000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783074004.991969:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53000/0x5fb609b3016de278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de271 expref: 14 pid: 83236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074004.991973:0:83237:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9524f4632e00:83237] 2 exiting: rc = 0 00010000:00010000:3.0:1783074004.991983:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298200/0x5fb609b3016de208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de201 expref: 13 pid: 83239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.991993:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa52e00/0x5fb609b3016de26a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de263 expref: 12 pid: 83235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992033:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159800/0x5fb609b3016de1fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de1f3 expref: 11 pid: 83235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074004.992036:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783074004.992046:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca3800/da924155-7591-4a6a-a2d2-c0d2908d0bfb for MGS 00010000:00010000:3.0:1783074004.992047:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53400/0x5fb609b3016de216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de20f expref: 10 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992057:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa52400/0x5fb609b3016de224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de21d expref: 9 pid: 83239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074004.992065:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d2ca7800 for MGS 00010000:00010000:3.0:1783074004.992067:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158600/0x5fb609b3016de232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de22b expref: 8 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992077:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d400/0x5fb609b3016de240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de239 expref: 7 pid: 83239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992087:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c400/0x5fb609b3016de1d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de1c9 expref: 6 pid: 83236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992097:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299600/0x5fb609b3016de1de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de1d7 expref: 5 pid: 83239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074004.992102:0:83235:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9524fb6e4200:83235] 0 exiting: rc = 1 00010000:00010000:3.0:1783074004.992109:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298c00/0x5fb609b3016de25c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de255 expref: 4 pid: 83236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992121:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53a00/0x5fb609b3016de1ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de1e5 expref: 3 pid: 83236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992133:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159600/0x5fb609b3016de24e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de247 expref: 2 pid: 83235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074004.992159:0:8460:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524df207000, canceled 13 locks, left on hash table 0. 00000100:00100000:2.0:1783074004.992162:0:83239:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9523c23cb400:83239] 3 exiting: rc = 0 00000020:00000080:3.0:1783074004.992184:0:8460:0:(genops.c:906:class_export_put()) final put ffff9524df207000/522b6a34-04f4-4017-ab45-61a21d19bfef 00010000:00010000:3.0:1783074004.992193:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074004.992195:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074004.992197:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783074004.992205:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524df207000/522b6a34-04f4-4017-ab45-61a21d19bfef for MGS 00000020:00000080:3.0:1783074004.992223:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524df202000 for MGS 00000100:00100000:2.0:1783074004.992243:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992251:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992257:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992263:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992268:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992278:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992284:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992289:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992294:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992299:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992305:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992338:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992344:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992349:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992355:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992360:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992365:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992370:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992375:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992380:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992386:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992391:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992397:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992402:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992407:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992412:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992419:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992424:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992429:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992435:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992440:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992445:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992450:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992455:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992460:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992466:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992535:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992543:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992548:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992553:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992559:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992565:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992571:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992576:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992582:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992587:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992606:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992612:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992618:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992624:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992629:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992635:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992640:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992645:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992750:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992760:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992768:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992775:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992783:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992790:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992795:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992800:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992805:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074004.992810:0:84453:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783074004.993662:0:84453:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c45a1c60 - data ffff9524df912288/ffff9524c8bcdc00 00000020:01000000:2.0:1783074004.993776:0:84453:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524fb677060 - data ffff9524df9fe798/ffff9523c6af1800 00000020:00000080:2.0:1783074004.994211:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de095 00000020:00000080:2.0:1783074004.994217:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524df203800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783074004.994233:0:84453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524f49f8000 from MGS, refs=2 00000020:01000004:2.0:1783074004.994236:0:84453:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49f8000 2 00000020:01000004:2.0:1783074004.994239:0:84453:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524f49f8000 from MGS 00000020:00000080:2.0:1783074004.994288:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074004.994294:0:84453:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783074004.994296:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524df201800/MGS 00000020:00000080:2.0:1783074004.994299:0:84453:0:(genops.c:865:class_export_destroy()) destroying export ffff9524df201800/MGS for MGS 00000020:01000000:2.0:1783074004.994303:0:84453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1783074004.994341:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524df203800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783074004.994382:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783074004.994386:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074004.994395:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783074004.994401:0:84453:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9524c2b7c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074004.994413:0:84453:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9523c2c319c0) has exports, disconnecting them 00000020:00080000:2.0:1783074004.994417:0:84453:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9524c2b7c000), last request at 1783073801 00000020:00000080:2.0:1783074004.994422:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de1ad 00000020:00080000:2.0:1783074004.994433:0:84453:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c2b7c000): rc 0 00000020:00000080:2.0:1783074004.994437:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524c2b7c000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783074004.994533:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c2b7c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783074004.997359:0:84453:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783074004.997366:0:84453:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783074004.997371:0:84453:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783074004.997377:0:84453:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783074004.997398:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c86b3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783074004.997645:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074004.997657:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783074004.997662:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524fb739000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783074004.997666:0:84453:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb739000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783074004.997672:0:84453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783074004.997740:0:84453:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49f8000 1 00000020:00000080:3.0:1783074004.997745:0:84453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de087 00000020:00000080:3.0:1783074004.997751:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524df200800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783074004.997759:0:84453:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783074004.997767:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524df200800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074004.997775:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074004.997779:0:84453:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783074004.997783:0:84453:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9524fa8619c0) has no exports 00000020:00000080:3.0:1783074005.013097:0:84453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074005.013119:0:84453:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783074005.013125:0:84453:0:(genops.c:906:class_export_put()) final put ffff9524f49fc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783074005.013130:0:84453:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f49fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783074005.013210:0:84453:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783074005.013389:0:84453:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524f49fd800 00000020:02000400:3.0:1783074005.013456:0:84453:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783074005.614514:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074006.638478:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783074006.963539:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074006.963547:0:8438:0:(genops.c:906:class_export_put()) final put ffff9523c2c2a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074006.963617:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c2a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783074006.963787:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c2c29800 for lustre-OST0000 00010000:00010000:2.0:1783074007.662639:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074008.494660:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723464576:0@lo:400:kworker.0 00000100:00100000:0.0:1783074008.494704:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723464704:0@lo:400:kworker.0 00000100:00100000:3.0:1783074008.494738:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074008.494796:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723464320:0@lo:400:kworker.0 00000100:00100000:2.0:1783074008.494850:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723464448:0@lo:400:kworker.0 00000100:00100000:0.0:1783074008.497227:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464576 00000100:00100000:0.0:1783074008.497241:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464576 00000100:00100000:0.0:1783074008.499482:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1783074008.499498:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723464576:12345-0@lo:400:kworker.0 00000400:00000100:1.0:1783074008.500499:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723464320 offset 0 length 224: 4 00000100:00100000:1.0:1783074008.500547:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723464832:0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.500658:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074008.500687:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723465344:0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.500709:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074008.500755:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464832 00000100:00100000:1.0:1783074008.500762:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464832 00000100:00100000:1.0:1783074008.500795:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465344 00000100:00100000:1.0:1783074008.500798:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465344 00000100:00100000:1.0:1783074008.500812:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1783074008.500819:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723464832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.500861:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723464832:12345-0@lo:400:kworker.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074008.500869:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1783074008.500887:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1783074008.500907:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3660:x1869685723465344:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783074008.500913:0:66200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783074008.500940:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3660:x1869685723465344:12345-0@lo:400:kworker.0 Request processed in 33us (230us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783074008.500958:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1783074008.501003:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723464832:0@lo:400:kworker.0 00000100:00080000:1.0:1783074008.501015:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783074008.501021:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783074008.501025:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783074008.501030:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074008.501033:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2645 00000100:00080000:1.0:1783074008.501039:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074008.501067:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6cf4a80 x1869685723465472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074008.501089:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723465344:0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.501115:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723465472:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783074008.501140:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074008.501163:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465472 00000100:00100000:1.0:1783074008.501167:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465472 00000100:00100000:1.0:1783074008.501183:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1783074008.501187:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723465472:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1783074008.501207:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074008.501237:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723465472:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 48us (96us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074008.501254:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00080000:1.0:1783074008.501283:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074008.501288:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074008.501291:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723465472:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783074008.501406:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074008.501419:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074008.501455:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723465088:0@lo:400:kworker.0 00000100:00100000:0.0:1783074008.504059:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723464576:12345-0@lo:400:kworker.0 Request processed in 4558us (9313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074008.504072:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1783074008.504105:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464704 00000100:00100000:0.0:1783074008.504113:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464704 00000100:00100000:0.0:1783074008.504149:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1783074008.504155:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1869685723464704:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783074008.504161:0:66201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074008.504194:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1869685723464704:12345-0@lo:400:kworker.0 Request processed in 39us (2775us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074008.504200:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00080000:1.0:1783074008.504469:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783074008.504476:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783074008.504479:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783074008.504485:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074008.504488:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2645 00000100:00080000:1.0:1783074008.504493:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074008.504521:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6cf5880 x1869685723465600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074008.504542:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723464704:0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.504551:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fb348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723465216:0@lo:400:kworker.0 00000100:00100000:0.0:1783074008.504678:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723465600:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783074008.504858:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074008.504898:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465600 00000100:00100000:0.0:1783074008.504903:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465600 00000100:00100000:0.0:1783074008.504925:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1783074008.504931:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723465600:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783074008.504961:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1783074008.504962:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074008.504992:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723465600:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (135us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074008.504999:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1783074008.505021:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465216 00000100:00100000:1.0:1783074008.505025:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465216 00000100:00080000:0.0:1783074008.505029:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074008.505033:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074008.505036:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723465600:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783074008.505061:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00080000:0.0:1783074008.505063:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074008.505068:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723465216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.505116:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723465216:12345-0@lo:400:kworker.0 Request processed in 49us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074008.505122:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1783074008.505242:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fb348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723465216:0@lo:400:kworker.0 00000100:00100000:3.0:1783074008.506035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074008.506086:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723464576:0@lo:400:kworker.0 00000100:00100000:2.0:1783074008.506153:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074008.506185:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723464960:0@lo:400:kworker.0 00000100:00100000:2.0:1783074008.506215:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074008.506294:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464448 00000100:00100000:3.0:1783074008.506299:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464448 00000100:00100000:0.0:1783074008.506399:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465088 00000100:00100000:0.0:1783074008.506404:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465088 00000100:00100000:0.0:1783074008.506438:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:0.0:1783074008.506445:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074008.506488:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723465088:12345-0@lo:400:kworker.0 Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074008.506495:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1783074008.506499:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723464960 00000100:00100000:1.0:1783074008.506502:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723464960 00000100:00080000:0.0:1783074008.506511:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074008.506526:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577 00000100:00100000:1.0:1783074008.506530:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3661:x1869685723464960:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783074008.506536:0:23954:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074008.506705:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1783074008.506711:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1869685723464448:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783074008.506716:0:66202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074008.506749:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1869685723464448:12345-0@lo:400:kworker.0 Request processed in 37us (596us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074008.506755:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1783074008.506783:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3661:x1869685723464960:12345-0@lo:400:kworker.0 Request processed in 91us (406us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783074008.506790:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577 00000100:00080000:0.0:1783074008.506894:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074008.506899:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783074008.506902:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074008.506917:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074008.506922:0:3661:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2827 00000100:00080000:0.0:1783074008.506926:0:3661:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074008.506963:0:3661:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fb348000 x1869685723465728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074008.506991:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723464960:0@lo:400:kworker.0 00000100:00080000:0.0:1783074008.507013:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074008.507016:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783074008.507019:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074008.507022:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074008.507025:0:3661:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2645 00000100:00080000:0.0:1783074008.507029:0:3661:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074008.507042:0:3661:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c48e4380 x1869685723465856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074008.507052:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723464448:0@lo:400:kworker.0 00000100:00100000:0.0:1783074008.507091:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723465088:0@lo:400:kworker.0 00000100:00100000:1.0:1783074008.507159:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fb348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723465728:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783074008.507189:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074008.507215:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723465856:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783074008.507237:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074008.507292:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465728 00000100:00100000:0.0:1783074008.507295:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465728 00000100:00100000:0.0:1783074008.507336:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3578 00000100:00100000:0.0:1783074008.507340:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723465728:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1783074008.507357:0:8454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074008.507385:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723465728:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (196us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074008.507398:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3578 00000100:00080000:1.0:1783074008.507581:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074008.507586:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074008.507589:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fb348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723465728:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783074008.507782:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465856 00000100:00100000:2.0:1783074008.507788:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465856 00000100:00100000:2.0:1783074008.507823:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1783074008.507828:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723465856:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1783074008.507840:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074008.507877:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723465856:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 48us (639us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074008.507884:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00080000:2.0:1783074008.507909:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074008.507912:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074008.507915:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723465856:0@lo:38:ptlrpcd_00_03.0 00000400:00000100:1.0:1783074008.560044:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708016512 offset 0 length 224: 4 00000100:00100000:1.0:1783074008.560092:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074008.560126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074008.560156:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074008.560185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074008.560215:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708017024 00000100:00100000:1.0:1783074008.560229:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708017024 00000100:00100000:1.0:1783074008.560289:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016896 00000100:00100000:1.0:1783074008.560292:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016896 00000100:00100000:1.0:1783074008.560353:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2041 00000100:00100000:1.0:1783074008.560363:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708017024:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074008.560430:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708017024:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074008.560450:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2041 00000100:00100000:1.0:1783074008.560479:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2042 00000100:00100000:1.0:1783074008.560486:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708016896:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074008.560518:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708016896:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074008.560524:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2042 00000100:00080000:1.0:1783074008.560554:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074008.560558:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074008.560626:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016768 00000100:00100000:0.0:1783074008.560630:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016768 00000100:00100000:0.0:1783074008.560720:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016640 00000100:00100000:0.0:1783074008.560724:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016640 00000100:00080000:1.0:1783074008.560759:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074008.561237:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 710 00000100:00100000:3.0:1783074008.561248:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708016768:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074008.561299:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708016768:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 54us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074008.561305:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 710 00000100:00100000:3.0:1783074008.561348:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1019 00000100:00100000:3.0:1783074008.561352:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2404:x1869685708016640:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:3.0:1783074008.561365:0:68632:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:3.0:1783074008.561387:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2404:x1869685708016640:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (1231us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074008.561394:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1019 00000100:00100000:1.0:1783074008.579528:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074008.579632:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708017152 00000100:00100000:0.0:1783074008.579642:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708017152 00000100:00100000:0.0:1783074008.579705:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1020 00000100:00100000:0.0:1783074008.579714:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869685708017152:12345-192.168.204.26@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1783074008.579857:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074008.579937:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869685708017152:12345-192.168.204.26@tcp:38:ptlrpcd_01_00.0 Request processed in 214us (410us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074008.579955:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1020 00010000:00010000:3.0:1783074008.686469:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074009.520809:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723465984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074009.520964:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074009.520995:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723465984 00000100:00100000:1.0:1783074009.521003:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723465984 00000100:00100000:1.0:1783074009.521063:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:1.0:1783074009.521073:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723465984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074009.521100:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074009.521152:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723465984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074009.521160:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:3.0:1783074009.521199:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723465984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074009.521337:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723466112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074009.521371:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074009.521488:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723466112 00000100:00100000:0.0:1783074009.521493:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723466112 00000100:00100000:0.0:1783074009.521623:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:0.0:1783074009.521633:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fababb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723466112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074009.521651:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074009.521697:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fababb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723466112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074009.521703:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:3.0:1783074009.521762:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723466112:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783074009.710460:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783074010.545793:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074010.545802:0:9524:0:(genops.c:906:class_export_put()) final put ffff9523c2c29000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074010.546367:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c29000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783074010.546415:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d08ce000 for lustre-OST0001 00000001:00100000:3.0:1783074010.546578:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783074010.546588:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411438 is committed 00000020:00000080:3.0:1783074010.546591:0:75594:0:(genops.c:906:class_export_put()) final put ffff9524f49fe800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074010.546709:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f49fe800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1783074010.546764:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f08dc800 for lustre-MDT0001 00010000:00010000:3.0:1783074010.734460:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074011.760861:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074012.782457:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074013.615068:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723466240:0@lo:400:kworker.0 00000400:00000100:0.0:1783074013.615117:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723466240 offset 0 length 224: 4 00000100:00080000:1.0:1783074013.615182:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074013.615188:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074013.615193:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074013.615198:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783074013.615203:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074013.615226:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074013.615250:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4bbe300 x1869685723466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074013.615294:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074013.615297:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074013.615299:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074013.615302:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783074013.615304:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074013.615307:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074013.615344:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c643b800 x1869685723466624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074013.615359:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074013.615363:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074013.615365:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074013.615368:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783074013.615380:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074013.615383:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074013.615399:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e4108e00 x1869685723466880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074013.615462:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723466368:0@lo:38:kworker.0 00000100:00100000:2.0:1783074013.615501:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074013.615522:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c643b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723466624:0@lo:38:kworker.0 00000100:00100000:2.0:1783074013.615543:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074013.615559:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723466880:0@lo:38:kworker.0 00000100:00100000:2.0:1783074013.615580:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074013.615615:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723466880 00000100:00100000:2.0:1783074013.615621:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723466880 00000100:00100000:2.0:1783074013.615658:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579 00000100:00100000:2.0:1783074013.615665:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723466880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074013.615685:0:26189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074013.615723:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723466880:12345-0@lo:38:kworker.0 Request processed in 57us (141us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074013.615729:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579 00000100:00100000:2.0:1783074013.615749:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723466368 00000100:00100000:2.0:1783074013.615752:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723466368 00000100:00100000:2.0:1783074013.615767:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723466624 00000100:00100000:2.0:1783074013.615769:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723466624 00000100:00100000:2.0:1783074013.615781:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1783074013.615785:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723466368:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074013.615795:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074013.615818:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723466368:12345-0@lo:38:kworker.0 Request processed in 32us (318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074013.615824:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1783074013.615841:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1783074013.615845:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723466624:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074013.615867:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074013.615889:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723466624:12345-0@lo:38:kworker.0 Request processed in 43us (346us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074013.615894:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00080000:2.0:1783074013.615920:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074013.615925:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074013.615928:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723466368:0@lo:38:kworker.0 00000100:00080000:2.0:1783074013.615935:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074013.615938:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074013.615941:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c643b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723466624:0@lo:38:kworker.0 00000100:00080000:2.0:1783074013.615947:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074013.615949:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074013.615952:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723466880:0@lo:38:kworker.0 00000100:00100000:3.0:1783074013.616129:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723466496:0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616159:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074013.616212:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074013.616218:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723466752:0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616236:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074013.616263:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723466496 00000100:00100000:3.0:1783074013.616266:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723466496 00000100:00100000:3.0:1783074013.616297:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723466752 00000100:00100000:3.0:1783074013.616299:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723466752 00000100:00100000:3.0:1783074013.616330:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1783074013.616336:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723466496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616387:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723466496:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074013.616399:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1783074013.616411:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1783074013.616417:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723466752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616450:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723466752:12345-0@lo:400:kworker.0 Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074013.616456:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1783074013.616486:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723466752:0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616496:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723466496:0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616513:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723467008:0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616541:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074013.616577:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467008 00000100:00100000:3.0:1783074013.616581:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467008 00000100:00100000:3.0:1783074013.616606:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1783074013.616612:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723467008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.616649:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723467008:12345-0@lo:400:kworker.0 Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074013.616655:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1783074013.616679:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723467008:0@lo:400:kworker.0 00000100:00080000:3.0:1783074013.616703:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074013.616707:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074013.620899:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074013.620908:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074013.620911:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074013.620919:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783074013.620924:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074013.620944:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074013.620968:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e4109180 x1869685723467264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074013.621025:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723467264:0@lo:38:kworker.0 00000100:00100000:2.0:1783074013.621093:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074013.621166:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074013.621177:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723467136:0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.621209:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074013.621267:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467136 00000100:00100000:3.0:1783074013.621280:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467136 00000100:00100000:3.0:1783074013.621346:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1783074013.621356:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723467136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074013.621409:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723467136:12345-0@lo:400:kworker.0 Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074013.621417:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00080000:3.0:1783074013.621439:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074013.621466:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723467136:0@lo:400:kworker.0 00000100:00100000:0.0:1783074013.621619:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467264 00000100:00100000:0.0:1783074013.621630:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467264 00000100:00100000:0.0:1783074013.621655:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1783074013.621660:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723467264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074013.621679:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074013.621873:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723467264:12345-0@lo:38:kworker.0 Request processed in 210us (779us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074013.621880:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00080000:2.0:1783074013.621929:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074013.621934:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074013.621937:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723467264:0@lo:38:kworker.0 00000100:00100000:1.0:1783074013.680184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074013.680228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074013.680382:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708017536 00000100:00100000:2.0:1783074013.680392:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708017536 00000400:00000100:1.0:1783074013.680485:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708017280 offset 0 length 224: 4 00000100:00100000:1.0:1783074013.680502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074013.680558:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 713 00000100:00100000:2.0:1783074013.680568:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e410aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708017536:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074013.680652:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e410aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708017536:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 86us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074013.680659:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 713 00000100:00080000:0.0:1783074013.681102:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074013.681724:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074013.681741:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708017792 00000100:00100000:3.0:1783074013.681749:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708017792 00000100:00080000:1.0:1783074013.681801:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074013.681835:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708017408 00000100:00100000:0.0:1783074013.681840:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708017408 00000100:00100000:0.0:1783074013.682734:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1024 00000100:00100000:0.0:1783074013.682742:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e410bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869685708017408:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:0.0:1783074013.682765:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074013.682815:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708017664 00000100:00100000:2.0:1783074013.682821:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708017664 00000100:00100000:0.0:1783074013.682823:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e410bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869685708017408:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 79us (1099us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074013.682833:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1024 00000100:00100000:2.0:1783074013.682882:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2045 00000100:00100000:2.0:1783074013.682891:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708017792:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074013.682929:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708017792:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074013.682935:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2045 00000100:00100000:2.0:1783074013.682949:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2046 00000100:00100000:2.0:1783074013.682955:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708017664:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074013.682979:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708017664:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (2476us total) trans 0 rc 0/0 00000100:00080000:3.0:1783074013.683232:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074013.683237:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2046 00010000:00010000:2.0:1783074013.806483:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074014.638882:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723467392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074014.638961:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074014.639060:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723467520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074014.639094:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074014.639129:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467392 00000100:00100000:2.0:1783074014.639136:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467392 00000100:00100000:2.0:1783074014.639176:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467520 00000100:00100000:2.0:1783074014.639179:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467520 00000100:00100000:2.0:1783074014.639203:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:2.0:1783074014.639212:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c48e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723467392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074014.639219:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1783074014.639233:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723467520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783074014.639247:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783074014.639255:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074014.639304:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c48e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723467392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074014.639339:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1783074014.639369:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723467520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074014.639377:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:2.0:1783074014.639390:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723467520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074014.639761:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723467392:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783074014.830926:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074015.854860:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074016.878836:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074017.902439:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074018.735559:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723467648:0@lo:400:kworker.0 00000400:00000100:1.0:1783074018.735616:0:3658:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723467648 offset 0 length 224: 4 00000100:00080000:0.0:1783074018.735675:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074018.735680:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074018.735683:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074018.735688:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2852 00000100:00080000:0.0:1783074018.735698:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783074018.735704:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074018.735727:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c8d9c700 x1869685723467776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074018.735816:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723467904:0@lo:400:kworker.0 00000100:00100000:2.0:1783074018.735857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074018.735948:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723467776:0@lo:38:kworker.0 00000100:00100000:1.0:1783074018.735977:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074018.736020:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467904 00000100:00100000:1.0:1783074018.736027:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467904 00000100:00100000:1.0:1783074018.736074:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723467776 00000100:00100000:1.0:1783074018.736077:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723467776 00000100:00100000:1.0:1783074018.736107:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1783074018.736119:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723467904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074018.736170:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723467904:12345-0@lo:400:kworker.0 Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074018.736177:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1783074018.736194:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1783074018.736199:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723467776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074018.736216:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074018.736256:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723467776:12345-0@lo:38:kworker.0 Request processed in 55us (277us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074018.736263:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:1.0:1783074018.736278:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074018.736308:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074018.736331:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074018.736335:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723467776:0@lo:38:kworker.0 00000100:00100000:1.0:1783074018.736365:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723467904:0@lo:400:kworker.0 00000100:00080000:0.0:1783074018.736614:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074018.736619:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074018.736621:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074018.736625:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2852 00000100:00080000:0.0:1783074018.736628:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783074018.736632:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074018.736648:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f469f800 x1869685723468032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074018.736688:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723468032:0@lo:38:kworker.0 00000100:00100000:1.0:1783074018.736714:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074018.736776:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468032 00000100:00100000:2.0:1783074018.736781:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468032 00000100:00100000:2.0:1783074018.736804:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1783074018.736809:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723468032:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074018.736820:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1783074018.736878:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074018.736881:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074018.736882:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074018.736886:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2852 00000100:00080000:0.0:1783074018.736889:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783074018.736893:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074018.736905:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4384380 x1869685723468288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074018.736947:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723468288:0@lo:38:kworker.0 00000100:00100000:1.0:1783074018.736973:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074018.737026:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723468032:12345-0@lo:38:kworker.0 Request processed in 215us (310us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074018.737033:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:1.0:1783074018.737087:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074018.737091:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074018.737094:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723468032:0@lo:38:kworker.0 00000100:00100000:1.0:1783074018.737121:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783074018.737128:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723468160:0@lo:400:kworker.0 00000100:00100000:1.0:1783074018.737152:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074018.737198:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468288 00000100:00100000:1.0:1783074018.737202:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468288 00000100:00100000:1.0:1783074018.737221:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580 00000100:00100000:1.0:1783074018.737225:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723468288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074018.737236:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074018.737264:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723468288:12345-0@lo:38:kworker.0 Request processed in 37us (290us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074018.737276:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580 00000100:00080000:1.0:1783074018.737299:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074018.737302:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074018.737305:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723468288:0@lo:38:kworker.0 00000100:00100000:2.0:1783074018.737397:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468160 00000100:00100000:2.0:1783074018.737401:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468160 00000100:00100000:2.0:1783074018.737441:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1783074018.737448:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723468160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074018.737483:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723468160:12345-0@lo:400:kworker.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074018.737490:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1783074018.737514:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723468160:0@lo:400:kworker.0 00000100:00080000:1.0:1783074018.737559:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074018.737775:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723468416:0@lo:400:kworker.0 00000100:00100000:2.0:1783074018.737804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074018.738024:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074018.738027:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074018.738029:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074018.738033:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2852 00000100:00080000:0.0:1783074018.738043:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783074018.738047:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074018.738062:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524edc4dc00 x1869685723468672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074018.738095:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074018.738103:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723468544:0@lo:400:kworker.0 00000100:00100000:0.0:1783074018.738132:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074018.738233:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723468672:0@lo:38:kworker.0 00000100:00100000:0.0:1783074018.738255:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074018.738278:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468672 00000100:00100000:0.0:1783074018.738281:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468672 00000100:00100000:0.0:1783074018.738301:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1783074018.738305:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723468672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074018.738338:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074018.738367:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723468672:12345-0@lo:38:kworker.0 Request processed in 60us (111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074018.738373:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:0.0:1783074018.738411:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074018.738415:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074018.738419:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723468672:0@lo:38:kworker.0 00000100:00100000:1.0:1783074018.738991:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468416 00000100:00100000:1.0:1783074018.738997:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468416 00000100:00100000:2.0:1783074018.739182:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468544 00000100:00100000:2.0:1783074018.739191:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468544 00000100:00080000:3.0:1783074018.740774:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074018.740780:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074018.740854:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1783074018.740865:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723468544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074018.740936:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723468544:12345-0@lo:400:kworker.0 Request processed in 76us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074018.740941:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1783074018.740955:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1783074018.740960:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723468416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074018.740985:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723468416:12345-0@lo:400:kworker.0 Request processed in 27us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074018.740989:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1783074018.741024:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723468544:0@lo:400:kworker.0 00000100:00100000:2.0:1783074018.741123:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723468416:0@lo:400:kworker.0 00000400:00000100:2.0:1783074018.799500:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708017920 offset 0 length 224: 4 00000100:00100000:2.0:1783074018.799530:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074018.799584:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074018.799602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074018.799671:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018176 00000100:00100000:1.0:1783074018.799682:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018176 00000100:00100000:1.0:1783074018.799764:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 716 00000100:00100000:1.0:1783074018.799777:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708018176:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074018.799928:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708018176:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 153us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074018.799938:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 716 00000100:00100000:2.0:1783074018.799944:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074018.799960:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018048 00000100:00100000:1.0:1783074018.799965:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018048 00000100:00100000:1.0:1783074018.799989:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1028 00000100:00100000:1.0:1783074018.799994:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708018048:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:1.0:1783074018.800015:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1783074018.800045:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074018.800053:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708018048:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 55us (116us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074018.800061:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1028 00000100:00100000:3.0:1783074018.800168:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018304 00000100:00100000:3.0:1783074018.800174:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018304 00000100:00100000:0.0:1783074018.800177:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018432 00000100:00100000:0.0:1783074018.800181:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018432 00000100:00100000:0.0:1783074018.800224:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2049 00000100:00100000:0.0:1783074018.800232:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708018432:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1783074018.800234:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074018.800545:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2050 00000100:00100000:2.0:1783074018.800552:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708018304:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074018.800633:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708018432:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 401us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074018.800650:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2049 00000100:00080000:3.0:1783074018.800655:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074018.800720:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708018304:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 168us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074018.800728:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2050 00010000:00010000:2.0:1783074018.927187:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074019.758556:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723468800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074019.758630:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074019.758676:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468800 00000100:00100000:2.0:1783074019.758684:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468800 00000100:00100000:2.0:1783074019.758745:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:2.0:1783074019.758756:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723468800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074019.758784:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074019.758828:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723468800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074019.758835:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1783074019.758899:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723468800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074019.758958:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723468928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074019.758988:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074019.759092:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723468928 00000100:00100000:1.0:1783074019.759096:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723468928 00000100:00100000:1.0:1783074019.759132:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:1.0:1783074019.759150:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723468928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074019.759165:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074019.759202:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723468928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074019.759207:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1783074019.759268:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723468928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074019.950777:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783074020.790880:0:85070:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783074020.790884:0:85070:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783074020.790885:0:85070:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783074020.790962:0:85070:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9524c6cad800 00000020:01000004:1.0:1783074020.790972:0:85070:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783074020.790983:0:85070:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783074020.790994:0:85070:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9523c338b380) 00000020:00000080:1.0:1783074020.791006:0:85070:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783074020.854756:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783074020.857409:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783074020.858257:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.858853:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783074020.859285:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.859462:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.859670:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.860166:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783074020.860374:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783074020.860626:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783074020.860862:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783074020.861032:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.862071:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.862335:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783074020.863689:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.868147:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.868617:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.868888:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.869077:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.869262:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.869590:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.869894:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.870125:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.870353:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.870592:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.870828:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.871040:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.871271:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.871586:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.871811:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.872088:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.872334:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.872528:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.872783:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.872979:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.873165:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.873488:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.873689:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.873889:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.874128:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.874360:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.874602:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.874760:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.874966:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.875147:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.875307:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783074020.875577:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783074020.875950:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.876259:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.876412:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.876847:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.877038:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783074020.877217:0:85070:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783074020.878525:0:85070:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783074020.878740:0:85070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783074020.878749:0:85070:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783074020.878759:0:85070:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de5a4 00000020:01000004:3.0:1783074020.878765:0:85070:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783074020.878777:0:85070:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783074020.878782:0:85070:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524c6cad800 from MGS 00000020:01000004:3.0:1783074020.878786:0:85070:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783074020.878804:0:85070:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9524fa8619c0) 00000020:00000080:3.0:1783074020.878816:0:85070:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1783074020.878871:0:85070:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cad800 from MGS, refs=2 00080000:01000000:3.0:1783074020.878876:0:85070:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783074020.878880:0:85070:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de5b2 00010000:00010000:3.0:1783074020.878987:0:85070:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783074020.881745:0:85070:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783074020.882506:0:85074:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783074020.882627:0:85070:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783074020.882659:0:85070:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074020.883242:0:85070:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783074020.883607:0:85070:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783074020.883786:0:85070:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783074020.883793:0:85070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783074020.884980:0:85070:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783074020.884988:0:85070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783074020.885294:0:85070:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783074020.885299:0:85070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783074020.885818:0:85070:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783074020.885841:0:85070:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783074020.885843:0:85070:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783074020.885846:0:85070:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1783074020.885851:0:85070:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783074020.885857:0:85070:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783074020.885861:0:85070:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783074020.885863:0:85070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783074020.885928:0:85070:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524e4068a80 x1869685723464320/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074020.885945:0:85070:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524f4bbca80 x1869685723466240/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074020.885997:0:85070:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c4ae8e00 x1869685723467648/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783074020.886005:0:85070:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783074020.886008:0:85070:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783074020.886009:0:85070:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783074020.886011:0:85070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1783074020.886041:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723466240:0@lo:400:kworker.0 00000100:00100000:0.0:1783074020.886074:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723467648:0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.886125:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723464320:0@lo:400:kworker.0 10000000:01000000:2.0:1783074020.886188:0:85070:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1783074020.886200:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa53e00/0x5fb609b3016de263 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de26a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074020.886209:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa53e00/0x5fb609b3016de263 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de26a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074020.886213:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1783074020.886281:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886289:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa53e00/0x5fb609b3016de263 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de26a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886303:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016de1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de1d0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886307:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016de1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de1d0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886325:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886396:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886399:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016de1c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de1d0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886405:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016de1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de1ec expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886410:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016de1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de1ec expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886413:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886742:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886748:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016de1e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de1ec expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886760:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016de20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de216 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886767:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016de20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de216 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886773:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886784:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886788:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016de20f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de216 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886799:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016de21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de224 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886806:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016de21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de224 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886811:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886816:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886821:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016de21d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de224 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886833:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa53800/0x5fb609b3016de239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de240 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886840:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa53800/0x5fb609b3016de239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de240 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886857:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886867:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886872:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa53800/0x5fb609b3016de239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de240 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886883:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016de247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de24e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886890:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016de247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de24e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886895:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886899:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886903:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016de247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de24e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886913:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa53200/0x5fb609b3016de271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de278 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886919:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa53200/0x5fb609b3016de271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de278 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886924:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886928:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886931:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa53200/0x5fb609b3016de271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de278 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.886946:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3158000/0x5fb609b3016de1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de1de expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.886963:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3158000/0x5fb609b3016de1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de1de expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.886969:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.886982:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.886987:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3158000/0x5fb609b3016de1d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de1de expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.887003:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016de1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de1fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.887009:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016de1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de1fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.887015:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074020.887018:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.887022:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016de1f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de1fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.887038:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52000/0x5fb609b3016de201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de208 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.887044:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52000/0x5fb609b3016de201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de208 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.887050:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074020.887055:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.887059:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52000/0x5fb609b3016de201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de208 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.887080:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016de22b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de232 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.887087:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016de22b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de232 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.887093:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074020.887104:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.887109:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016de22b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de232 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.887119:0:85070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016de255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de25c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.887125:0:85070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016de255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de25c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.887129:0:85070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074020.887133:0:85070:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074020.887136:0:85070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016de255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de25c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074020.887151:0:85070:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 50, was 0): DISCONN 00000100:00080000:1.0:1783074020.887157:0:85070:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074020.887162:0:85070:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 2640 00000100:00080000:1.0:1783074020.887168:0:85070:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074020.887194:0:85070:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e410ad80 x1869685723469056/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074020.887229:0:85070:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1783074020.887281:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723469056:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783074020.887568:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.887927:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469056 00000100:00100000:2.0:1783074020.887933:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469056 00000100:00100000:2.0:1783074020.887961:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783074020.887968:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1869685723469056:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783074020.887991:0:85076:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo t0 exp 0000000000000000 cur 2860 last 0 00000020:00000080:2.0:1783074020.888019:0:85076:0:(genops.c:1406:class_connect()) connect: client 522b6a34-04f4-4017-ab45-61a21d19bfef, cookie 0x5fb609b3016de5b9 00000100:00080000:2.0:1783074020.888103:0:85076:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074020.888150:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3657:x1869685723469056:12345-0@lo:250:mount.lustre.0 Request processed in 182us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.888155:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783074020.888194:0:3657:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 24 00000100:00080000:0.0:1783074020.888203:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1783074020.888209:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783074020.888213:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783074020.888216:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783074020.888219:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783074020.888242:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783074020.888254:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723469056:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1783074020.888266:0:85070:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1783074020.888276:0:85070:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:0.0:1783074020.888295:0:36249:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.126@tcp 00000020:01000004:1.0:1783074020.888308:0:85070:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783074020.888330:0:36249:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 10000000:01000000:1.0:1783074020.888331:0:85070:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:0.0:1783074020.888336:0:36249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783074020.888339:0:36249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783074020.888340:0:36249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074020.888341:0:36249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074020.888343:0:36249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074020.888344:0:36249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074020.888346:0:36249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783074020.888348:0:36249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074020.888349:0:36249:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783074020.888391:0:36249:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783074020.888399:0:36249:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1783074020.888401:0:36249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783074020.888409:0:36249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783074020.888410:0:36249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074020.888411:0:36249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074020.888413:0:36249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074020.888415:0:36249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074020.888416:0:36249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783074020.888417:0:36249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074020.888418:0:36249:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000040:01000000:1.0:1783074020.888432:0:85070:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000000:0.0:1783074020.888443:0:36249:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783074020.888450:0:36249:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1783074020.888453:0:36249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783074020.888454:0:36249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783074020.888456:0:36249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074020.888457:0:36249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074020.888459:0:36249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074020.888460:0:36249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074020.888461:0:36249:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074020.888462:0:36249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074020.888463:0:36249:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:1.0:1783074020.888470:0:85070:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000000:0.0:1783074020.888477:0:36249:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000020:01000004:1.0:1783074020.888483:0:85070:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783074020.888485:0:85070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074020.888487:0:85070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074020.888488:0:85070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074020.888490:0:85070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074020.888491:0:85070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074020.888493:0:85070:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074020.888495:0:85070:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074020.888496:0:85070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074020.888497:0:85070:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074020.888500:0:85070:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783074020.888503:0:85070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783074020.888504:0:85070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074020.888507:0:85070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:0.0:1783074020.888507:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723469184:0@lo:253:kworker.0 00000020:01000004:1.0:1783074020.888510:0:85070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074020.888513:0:85070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074020.888516:0:85070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074020.888517:0:85070:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074020.888518:0:85070:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074020.888519:0:85070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074020.888521:0:85070:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074020.888534:0:85070:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783074020.888545:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783074020.888705:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.888744:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469184 00000100:00100000:2.0:1783074020.888750:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469184 00000100:00100000:2.0:1783074020.888787:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783074020.888795:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3661:x1869685723469184:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783074020.888815:0:85077:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1783074020.888834:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723469312:0@lo:253:kworker.0 00000100:00100000:0.0:1783074020.888871:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074020.888895:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074020.888902:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723469440:0@lo:253:kworker.0 00000100:00100000:0.0:1783074020.888937:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.888976:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.888992:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074020.888994:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469312 00000100:00100000:0.0:1783074020.889000:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469312 00000100:00100000:2.0:1783074020.889001:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469440 00000100:00100000:2.0:1783074020.889006:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469440 00000100:00100000:0.0:1783074020.889025:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469568 00000100:00100000:0.0:1783074020.889029:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469568 00000100:00100000:2.0:1783074020.889036:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783074020.889070:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3658:x1869685723469312:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783074020.889090:0:85078:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1783074020.889110:0:85079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783074020.889202:0:85077:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 103 20000000:01000000:0.0:1783074020.891674:0:85080:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783074020.891687:0:85080:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783074020.891690:0:85080:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783074020.891693:0:85080:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783074020.891866:0:85080:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783074020.891993:0:85077:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783074020.892010:0:85077:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783074020.893577:0:85078:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783074020.893595:0:85077:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783074020.893608:0:85077:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783074020.893672:0:85079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783074020.893685:0:85079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783074020.893705:0:85079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893734:0:85079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074020.893743:0:85079:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000059515s 00010000:00010000:1.0:1783074020.893749:0:85079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893756:0:85079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893763:0:85079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893770:0:85079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893776:0:85079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074020.893780:0:85079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893788:0:85079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893801:0:85079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893808:0:85079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.893825:0:85079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b24a00/0x5fb609b3016de5c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074020.893948:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3661:x1869685723469184:12345-0@lo:253:kworker.0 Request processed in 5152us (5241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.893958:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783074020.893988:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783074020.893995:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3658:x1869685723469440:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783074020.894016:0:85077:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:2.0:1783074020.894072:0:3661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783074020.894074:0:3661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783074020.894075:0:3661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074020.894076:0:3661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074020.894077:0:3661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074020.894078:0:3661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074020.894079:0:3661:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783074020.894080:0:3661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074020.894081:0:3661:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074020.894084:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723469184:0@lo:253:kworker.0 20000000:01000000:0.0:1783074020.896041:0:85078:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783074020.896049:0:85078:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783074020.896071:0:85079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783074020.896076:0:85079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783074020.896094:0:85079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896109:0:85079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074020.896117:0:85079:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000059515s 00010000:00010000:1.0:1783074020.896121:0:85079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896127:0:85079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896133:0:85079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896140:0:85079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896146:0:85079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074020.896149:0:85079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896157:0:85079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896179:0:85079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896186:0:85079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896192:0:85079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b24e00/0x5fb609b3016de5c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074020.896409:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3658:x1869685723469312:12345-0@lo:253:kworker.0 Request processed in 7363us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.896419:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1783074020.896423:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783074020.896426:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783074020.896428:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074020.896430:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074020.896431:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074020.896433:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074020.896435:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074020.896436:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074020.896437:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783074020.896442:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723469312:0@lo:253:kworker.0 00000100:00100000:0.0:1783074020.896456:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783074020.896465:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:85070:x1869685723469568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783074020.896494:0:85078:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783074020.896497:0:85078:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783074020.896499:0:85078:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1783074020.896504:0:85078:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783074020.896589:0:85077:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783074020.896653:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:85070:x1869685723469568:12345-0@lo:253:mount.lustre.0 Request processed in 190us (7681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.896659:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783074020.896735:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783074020.896744:0:85070:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783074020.896746:0:85070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783074020.896747:0:85070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074020.896747:0:85070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074020.896748:0:85070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074020.896749:0:85070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074020.896750:0:85070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074020.896751:0:85070:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074020.896752:0:85070:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074020.896752:0:85070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074020.896753:0:85070:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783074020.896765:0:85070:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524c6cad800 from lustre-MDT0000 10000000:01000000:1.0:1783074020.896786:0:85070:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783074020.896792:0:85070:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074020.896799:0:85070:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9524c6cad800 10000000:01000000:1.0:1783074020.896802:0:85070:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783074020.896805:0:85070:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9524c6cad800 10000000:01000000:1.0:1783074020.896806:0:85070:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783074020.896809:0:85070:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524c6cad800 from 1 10000000:01000000:1.0:1783074020.896811:0:85070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074020.896832:0:85070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896845:0:85070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.896852:0:85070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.896865:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074020.896888:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.896935:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074020.896995:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469696 00000100:00100000:0.0:1783074020.896999:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469696 00000100:00100000:0.0:1783074020.897022:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783074020.897029:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:85070:x1869685723469696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074020.897035:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074020.897045:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb361600/0x5fb609b3016de5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de5ce expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.897057:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb361600/0x5fb609b3016de5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de5ce expref: 7 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.897071:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb361600/0x5fb609b3016de5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de5ce expref: 7 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.897076:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb361600, rc 0) 00000100:00100000:0.0:1783074020.897097:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+7:85070:x1869685723469696:12345-0@lo:101:mount.lustre.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.897103:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783074020.897119:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074020.897132:0:85070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.897141:0:85070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.897153:0:85070:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783074020.897173:0:85070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.897191:0:85070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.897197:0:85070:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074020.897200:0:85070:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783074020.897204:0:85070:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9524c6cad800 10000000:01000000:1.0:1783074020.897206:0:85070:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783074020.897209:0:85070:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783074020.897211:0:85070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074020.897224:0:85070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.897231:0:85070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.897238:0:85070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.897249:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074020.897279:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.897297:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074020.897307:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469824 00000100:00100000:0.0:1783074020.897337:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469824 00000100:00100000:0.0:1783074020.897361:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783074020.897365:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:85070:x1869685723469824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074020.897370:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074020.897376:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb360a00/0x5fb609b3016de5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de5dc expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.897385:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb360a00/0x5fb609b3016de5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de5dc expref: 8 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.897391:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb360a00/0x5fb609b3016de5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de5dc expref: 8 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.897398:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360a00, rc 0) 00000100:00100000:0.0:1783074020.897430:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:85070:x1869685723469824:12345-0@lo:101:mount.lustre.0 Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.897437:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783074020.897572:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074020.897580:0:85070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.897585:0:85070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.897626:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074020.897655:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.897673:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.897690:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723469952 00000100:00100000:2.0:1783074020.897694:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723469952 00000100:00100000:2.0:1783074020.897734:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783074020.897740:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:85070:x1869685723469952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074020.897841:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723469952:12345-0@lo:501:mount.lustre.0 Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.897854:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783074020.897862:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723469952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074020.897888:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723470080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074020.897923:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.897939:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.897960:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470080 00000100:00100000:2.0:1783074020.897964:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470080 00000100:00100000:2.0:1783074020.897990:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783074020.897997:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723470080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074020.898811:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723470080:12345-0@lo:503:mount.lustre.0 Request processed in 813us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.898819:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783074020.898921:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723470080:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1783074020.899762:0:85077:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:1.0:1783074020.899776:0:85081:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85081:1869685723470208:0@lo:502:llog_process_th.0 20000000:01000000:0.0:1783074020.899777:0:85077:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1783074020.899823:0:85079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:1.0:1783074020.899823:0:85081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1783074020.899827:0:85079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783074020.899846:0:85079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899859:0:85079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074020.899867:0:85079:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000059515s 00010000:00010000:2.0:1783074020.899871:0:85079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899877:0:85079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899883:0:85079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899890:0:85079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899896:0:85079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074020.899906:0:85079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899914:0:85079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899925:0:85079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899933:0:85079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.899939:0:85079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298400/0x5fb609b3016de5ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074020.900012:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470208 00000100:00100000:3.0:1783074020.900017:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470208 00000100:00100000:3.0:1783074020.900042:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783074020.900050:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85081:x1869685723470208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074020.900241:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:3658:x1869685723469440:12345-0@lo:253:kworker.0 Request processed in 6245us (11302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.900255:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783074020.900274:0:85081:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482840 going to sleep for 11 seconds 00000020:01000004:0.0:1783074020.900303:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783074020.900305:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783074020.900307:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074020.900308:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074020.900333:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074020.900334:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074020.900335:0:3658:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074020.900337:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074020.900339:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783074020.900342:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723469440:0@lo:253:kworker.0 00000100:00100000:3.0:1783074020.900604:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:85081:x1869685723470208:12345-0@lo:502:llog_process_th.0 Request processed in 554us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.900616:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783074020.900676:0:85081:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85081:1869685723470208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074020.900699:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074020.900710:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.900724:0:85081:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783074020.900733:0:85081:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783074020.900737:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074020.900749:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9523c33899c0) 00000020:00000080:1.0:1783074020.900763:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1783074020.900768:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783074020.900820:0:85081:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783074020.900825:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de5f8 00000020:00000080:1.0:1783074020.900986:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783074020.900989:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074020.900991:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.900992:0:85081:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783074020.900994:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074020.901000:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.901001:0:85081:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783074020.901004:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074020.901009:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9523c338cd40) 00000020:00000080:1.0:1783074020.901017:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1783074020.901019:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783074020.901021:0:85081:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783074020.901023:0:85081:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783074020.901026:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783074020.901063:0:85081:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cad800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783074020.901076:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9524fab719c0) 00000020:00000080:1.0:1783074020.901085:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1783074020.901140:0:85081:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783074020.901198:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de60d 00000020:00000080:1.0:1783074020.901282:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783074020.901287:0:85081:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783074020.901290:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb609b3016de614 00080000:01000000:1.0:1783074020.901293:0:85081:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783074020.901295:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de61b 00010000:00010000:1.0:1783074020.947564:0:85081:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783074020.947689:0:85081:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0510a7c0-d9c1-4de9-a6c3-ede973deaaff idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:1.0:1783074020.947737:0:85081:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:1.0:1783074020.947759:0:85081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:1.0:1783074020.947855:0:85081:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783074020.947908:0:85081:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524df15e0c0: xid 1869685708012032, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:1.0:1783074020.948426:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9524fb4dcd40) 00000020:00000080:1.0:1783074020.948447:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783074020.948518:0:85081:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783074020.948523:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de637 00000020:00000080:1.0:1783074020.948957:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783074020.951893:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb609b3016de63e 00000020:00000080:3.0:1783074020.952374:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783074020.952387:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074020.952392:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.952394:0:85081:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783074020.952396:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783074020.952398:0:85081:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1783074020.952399:0:85081:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074020.952400:0:85081:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074020.952401:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783074020.952402:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.952403:0:85081:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783074020.952405:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074020.952407:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.952408:0:85081:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783074020.952411:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783074020.952688:0:85081:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783074020.952707:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074020.952709:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.952710:0:85081:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783074020.952723:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074020.952727:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.952728:0:85081:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783074020.952730:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783074020.952734:0:85081:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:3.0:1783074020.952752:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783074020.952763:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9524fa863380) 00000020:00000080:3.0:1783074020.952776:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783074020.952780:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783074020.952827:0:85081:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783074020.952831:0:85081:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783074020.952845:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de64c 00010000:00080000:3.0:1783074020.952880:0:85081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c16e5800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1783074020.954509:0:85081:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783074020.957598:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074020.957610:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783074020.957648:0:85081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783074020.957671:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de653 00000100:00080000:3.0:1783074020.957681:0:85081:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783074020.957687:0:85081:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9523c16e5800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074020.957729:0:85081:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c2140e00 x1869685723470336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074020.957756:0:85081:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783074020.957859:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074020.957863:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.957865:0:85081:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783074020.957868:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783074020.957870:0:85081:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1783074020.957872:0:85081:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074020.957873:0:85081:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074020.957875:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783074020.957878:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.957879:0:85081:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783074020.957881:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783074020.957886:0:85081:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783074020.957888:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.957890:0:85081:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783074020.957893:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783074020.957897:0:85081:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:3.0:1783074020.957918:0:85081:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783074020.957921:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783074020.957933:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9524fa860000) 00000020:00000080:3.0:1783074020.957948:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783074020.957959:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783074020.958028:0:85081:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783074020.958035:0:85081:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783074020.958043:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de661 00010000:00080000:3.0:1783074020.958073:0:85081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c7838000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:0.0:1783074020.958102:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723470336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074020.958174:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074020.958238:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470336 00000100:00100000:0.0:1783074020.958245:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470336 00000100:00100000:0.0:1783074020.958278:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1783074020.958286:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723470336:12345-0@lo:38:llog_process_th.0 00010000:00010000:3.0:1783074020.958295:0:85081:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00010000:00080000:0.0:1783074020.958343:0:23954:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2860 last 0 00000020:00000080:0.0:1783074020.958379:0:23954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de668 00000004:00100000:0.0:1783074020.958394:0:23954:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783074020.958488:0:23954:0:(import.c:65:import_set_state_nolock()) ffff9523c316a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074020.958540:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723470336:12345-0@lo:38:llog_process_th.0 Request processed in 253us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.958548:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1783074020.958598:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783074020.958605:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783074020.958613:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783074020.958618:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783074020.958627:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c16e5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074020.958638:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723470336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074020.958731:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723470464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074020.958760:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.958839:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470464 00000100:00100000:1.0:1783074020.958844:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470464 00000100:00100000:1.0:1783074020.958880:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582 00000100:00100000:1.0:1783074020.958888:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723470464:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783074020.958897:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074020.958903:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074020.958905:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074020.958911:0:36249:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2857 00000004:00000024:1.0:1783074020.958913:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00080000:2.0:1783074020.958914:0:36249:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074020.958921:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074020.958942:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524edc4ca80 x1869685723470592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074020.959018:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723470720:0@lo:400:kworker.0 00000100:00100000:3.0:1783074020.959049:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.959253:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723470464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 366us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.959260:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:1.0:1783074020.959287:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723470592:0@lo:38:kworker.0 00000100:00100000:1.0:1783074020.959326:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.959363:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470720 00000100:00100000:1.0:1783074020.959367:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470720 00000100:00100000:1.0:1783074020.959396:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470592 00000100:00100000:1.0:1783074020.959398:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470592 00000100:00100000:1.0:1783074020.959414:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783074020.959421:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723470720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.959454:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723470720:12345-0@lo:400:kworker.0 Request processed in 33us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.959460:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783074020.959471:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1783074020.959475:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e410ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723470592:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074020.959506:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e410ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723470592:12345-0@lo:38:kworker.0 Request processed in 30us (194us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783074020.959512:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:1.0:1783074020.959538:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074020.959542:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074020.959546:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723470592:0@lo:38:kworker.0 00000100:00080000:3.0:1783074020.959644:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074020.959663:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723470720:0@lo:400:kworker.0 00000040:01000000:1.0:1783074020.959774:0:85081:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783074020.959796:0:85081:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:2.0:1783074020.959854:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074020.959859:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074020.959861:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074020.959865:0:36249:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2857 00000100:00080000:2.0:1783074020.959869:0:36249:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074020.959879:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074020.959894:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524edc4fb80 x1869685723470848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074020.959929:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074020.959933:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074020.959935:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074020.959940:0:36249:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2857 00000100:00080000:2.0:1783074020.959942:0:36249:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074020.959945:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074020.959950:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723470848:0@lo:38:kworker.0 00000100:00100000:2.0:1783074020.959958:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c6438a80 x1869685723471104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074020.959985:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074020.959994:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074020.959998:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074020.960000:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074020.960004:0:36249:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2857 00000100:00080000:2.0:1783074020.960007:0:36249:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074020.960012:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074020.960012:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723471104:0@lo:38:kworker.0 00000100:00100000:2.0:1783074020.960028:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4bbca80 x1869685723471488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074020.960057:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.960071:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723471232:0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.960081:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723471488:0@lo:38:kworker.0 00000100:00100000:2.0:1783074020.960115:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.960117:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.960148:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783074020.960154:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470848 00000100:00100000:2.0:1783074020.960159:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723470976:0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.960159:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470848 00000100:00100000:1.0:1783074020.960177:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471488 00000100:00100000:1.0:1783074020.960180:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471488 00000100:00100000:2.0:1783074020.960190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.960198:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1783074020.960204:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723470848:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074020.960240:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471232 00000100:00100000:1.0:1783074020.960245:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723470848:12345-0@lo:38:kworker.0 Request processed in 39us (261us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074020.960247:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471232 00000100:00100000:1.0:1783074020.960252:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1783074020.960263:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723470976 00000100:00100000:1.0:1783074020.960265:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723470976 00000100:00100000:2.0:1783074020.960288:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1783074020.960300:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723471232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.960306:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783074020.960336:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723470976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074020.960382:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723471232:12345-0@lo:400:kworker.0 Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.960383:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723470976:12345-0@lo:400:kworker.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.960398:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783074020.960408:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1783074020.960412:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:1.0:1783074020.960413:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723471488:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074020.960449:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723471488:12345-0@lo:38:kworker.0 Request processed in 35us (336us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074020.960453:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723470976:0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.960466:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1783074020.960490:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723471232:0@lo:400:kworker.0 00000100:00080000:1.0:1783074020.960504:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074020.960509:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074020.960513:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723471488:0@lo:38:kworker.0 00000100:00080000:2.0:1783074020.960515:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074020.960522:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074020.960529:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074020.960534:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074020.960538:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723470848:0@lo:38:kworker.0 00000100:00100000:2.0:1783074020.960549:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471104 00000100:00100000:2.0:1783074020.960554:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471104 00000100:00100000:2.0:1783074020.960586:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583 00000100:00100000:2.0:1783074020.960591:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723471104:12345-0@lo:38:kworker.0 00000040:00080000:1.0:1783074020.960608:0:85081:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000100:00100000:2.0:1783074020.960628:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723471104:12345-0@lo:38:kworker.0 Request processed in 35us (571us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074020.960635:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583 00000100:00080000:2.0:1783074020.960659:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074020.960663:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783074020.960667:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723471104:0@lo:38:kworker.0 00000100:00100000:3.0:1783074020.960749:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074020.960759:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c643b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723471360:0@lo:400:kworker.0 00000100:00100000:3.0:1783074020.960784:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074020.960832:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723470464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074020.960888:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471360 00000100:00100000:1.0:1783074020.960892:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471360 00000100:00100000:1.0:1783074020.960948:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1783074020.960955:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723471360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074020.960991:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723471360:12345-0@lo:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.960997:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00080000:3.0:1783074020.961034:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074020.961055:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c643b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723471360:0@lo:400:kworker.0 00000040:00080000:2.0:1783074020.963037:0:85081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074020.963072:0:85081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:2.0:1783074020.965904:0:85081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:0.0:1783074020.966231:0:85087:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1783074020.966237:0:85087:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783074020.967185:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074020.967197:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783074020.967293:0:85081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783074020.967341:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de66f 00000100:00080000:1.0:1783074020.967352:0:85081:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783074020.967358:0:85081:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9524c7838000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074020.967385:0:85081:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4bbca80 x1869685723471616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074020.967407:0:85081:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783074020.967493:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074020.967502:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.967504:0:85081:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783074020.967509:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783074020.967512:0:85081:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783074020.967514:0:85081:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074020.967516:0:85081:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074020.967518:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:2.0:1783074020.967522:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723471616:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1783074020.967523:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.967526:0:85081:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783074020.967532:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783074020.967536:0:85081:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783074020.967541:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.967543:0:85081:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783074020.967547:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783074020.967550:0:85081:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1783074020.967567:0:85081:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783074020.967568:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074020.967586:0:85081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9524fb4d8000) 00000020:00000080:1.0:1783074020.967597:0:85081:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783074020.967600:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783074020.967642:0:85081:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783074020.967647:0:85081:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783074020.967650:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016de67d 00010000:00080000:1.0:1783074020.967671:0:85081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524ee2c0000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:2.0:1783074020.967750:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074020.967779:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471616 00000100:00100000:3.0:1783074020.967786:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471616 00000100:00100000:3.0:1783074020.967822:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4868 00000100:00100000:3.0:1783074020.967830:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3657:x1869685723471616:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783074020.967854:0:26173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2860 last 0 00010000:00010000:1.0:1783074020.967862:0:85081:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000020:00000080:3.0:1783074020.967873:0:26173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de684 00002000:00100000:3.0:1783074020.967885:0:26173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9524c783a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783074020.967889:0:26173:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783074020.967892:0:26173:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000040:01000000:1.0:1783074020.967916:0:85081:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783074020.967927:0:85081:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00002000:00080000:3.0:1783074020.967960:0:26173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783074020.967981:0:26173:0:(import.c:65:import_set_state_nolock()) ffff9524c783d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074020.968071:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723471616:12345-0@lo:8:llog_process_th.0 Request processed in 230us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.968074:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783074020.968091:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1783074020.968094:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4868 00000100:00080000:2.0:1783074020.968100:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783074020.968107:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783074020.968110:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c7838000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783074020.968128:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783074020.968135:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723471616:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783074020.968187:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074020.968199:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723471744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074020.968236:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783074020.968267:0:85087:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 3 count 2 00000100:00100000:2.0:1783074020.968279:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723471872:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1783074020.968290:0:85087:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1783074020.968295:0:85087:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1783074020.968333:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783074020.968346:0:85087:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783074020.968375:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471872 00000100:00100000:0.0:1783074020.968380:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471872 00000004:00080000:1.0:1783074020.968395:0:85087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2860186082654ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783074020.968407:0:85087:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783074020.968430:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4869 00000100:00100000:0.0:1783074020.968438:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723471872:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1783074020.968440:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1783074020.968456:0:26169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1698 count 1 00000100:00100000:3.0:1783074020.968487:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723471744 00000100:00100000:3.0:1783074020.968500:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723471744 00000100:00100000:3.0:1783074020.968525:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:0.0:1783074020.968532:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3658:x1869685723471872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 93us (218us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783074020.968533:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1869685723471744:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074020.968546:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4869 00002000:00000024:3.0:1783074020.968552:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074020.968601:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723471744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.968609:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000004:00080000:1.0:1783074020.968643:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9524f4bbca80, transno 0 00000004:00080000:1.0:1783074020.968648:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9524f4bbca80/1, rc -2, transno 0 00000040:00080000:3.0:1783074020.968651:0:85081:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:1.0:1783074020.968658:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723471872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783074020.968691:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723471744:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783074020.968781:0:85087:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1783074020.969655:0:85087:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783074020.970428:0:85081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783074020.970447:0:85081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:3.0:1783074020.970555:0:85081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:3.0:1783074020.971003:0:85089:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:3.0:1783074020.971007:0:85089:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074020.971119:0:85089:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1783074020.971137:0:85089:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1783074020.971157:0:85071:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:2.0:1783074020.971744:0:85081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074020.971753:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074020.971783:0:85081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074020.971800:0:85081:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de68b 00000100:00080000:2.0:1783074020.971808:0:85081:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074020.971812:0:85081:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9524ee2c0000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074020.971836:0:85081:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df2e8700 x1869685723472000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074020.971861:0:85081:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783074020.971901:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074020.971903:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074020.971905:0:85081:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783074020.971907:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074020.971909:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074020.971910:0:85081:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783074020.971912:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783074020.971913:0:85081:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783074020.971914:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074020.971915:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074020.971921:0:85081:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783074020.971922:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074020.971924:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074020.971925:0:85081:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783074020.971927:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783074020.971950:0:85081:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85081:1869685723472128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074020.972006:0:85081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.972031:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472128 00000100:00100000:2.0:1783074020.972035:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472128 00000100:00100000:2.0:1783074020.972059:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783074020.972064:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:85081:x1869685723472128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074020.972127:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:85081:x1869685723472128:12345-0@lo:502:llog_process_th.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.972132:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:00080000:3.0:1783074020.972198:0:85089:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1783074020.972200:0:85089:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1783074020.972246:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723472000:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783074020.972271:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.972398:0:85081:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc457900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.972418:0:85081:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85081:1869685723472128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074020.972440:0:85081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074020.972444:0:85081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074020.972446:0:85081:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783074020.972448:0:85081:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783074020.972583:0:85070:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783074020.972604:0:85070:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1783074020.972641:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472000 00000100:00100000:3.0:1783074020.972646:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472000 00010000:00010000:0.0:1783074020.972662:0:85070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.972671:0:85070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074020.972677:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4870 00000100:00100000:3.0:1783074020.972685:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869685723472000:12345-0@lo:8:llog_process_th.0 10000000:01000000:0.0:1783074020.972689:0:85070:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6cad800 from 1 10000000:01000000:0.0:1783074020.972693:0:85070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00080000:3.0:1783074020.972721:0:8443:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2860 last 0 00010000:00010000:0.0:1783074020.972724:0:85070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.972738:0:85070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783074020.972745:0:8443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016de699 00010000:00010000:0.0:1783074020.972747:0:85070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1783074020.972758:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9524c7839000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:0.0:1783074020.972764:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472256:0@lo:101:mount.lustre.0 00002000:00080000:3.0:1783074020.972773:0:8443:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783074020.972777:0:8443:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783074020.972794:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074020.972828:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654540 going to sleep for 11 seconds 00002000:00080000:3.0:1783074020.972833:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783074020.972856:0:8443:0:(import.c:65:import_set_state_nolock()) ffff9524c783b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074020.972882:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472256 00000100:00100000:2.0:1783074020.972886:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472256 00000100:00100000:2.0:1783074020.972914:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783074020.972920:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:85070:x1869685723472256:12345-0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074020.972922:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723472000:12345-0@lo:8:llog_process_th.0 Request processed in 239us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.972928:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4870 00010000:00010000:2.0:1783074020.972929:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074020.972940:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de692 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.972965:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de692 expref: 9 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.972981:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de692 expref: 9 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.972984:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:2.0:1783074020.972990:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298400, rc 0) 00000100:00080000:1.0:1783074020.972990:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783074020.972996:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783074020.973000:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783074020.973002:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783074020.973011:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783074020.973015:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723472000:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783074020.973021:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723472256:12345-0@lo:101:mount.lustre.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.973027:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783074020.973067:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074020.973080:0:85070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.973088:0:85070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074020.973456:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723472384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074020.973482:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.973583:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472384 00000100:00100000:2.0:1783074020.973589:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472384 00000100:00080000:1.0:1783074020.973621:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074020.973652:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:2.0:1783074020.973658:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723472384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074020.973672:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074020.973702:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723472384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.973706:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1783074020.973740:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723472384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074020.973749:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472512:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783074020.973782:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074020.974094:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2eecb40 going to sleep for 11 seconds 00000004:00080000:3.0:1783074020.974110:0:85089:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783074020.974125:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472512 00000100:00100000:0.0:1783074020.974129:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472512 00000004:00080000:3.0:1783074020.974157:0:85089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2860191844721ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783074020.974163:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00080000:00080000:3.0:1783074020.974165:0:85089:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783074020.974173:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723472512:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783074020.974188:0:85077:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783074020.974203:0:85077:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783074020.974207:0:85077:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783074020.974210:0:85077:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783074020.974212:0:85077:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 106 00000100:00100000:0.0:1783074020.974287:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723472512:12345-0@lo:256:mount.lustre.0 Request processed in 117us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.974302:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783074020.974373:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472512:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783074020.974934:0:85070:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783074020.974953:0:85070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.974964:0:85070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074020.974972:0:85070:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524c6cad800 from 1 10000000:01000000:0.0:1783074020.974974:0:85070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783074020.975011:0:85070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.975019:0:85070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.975027:0:85070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074020.975042:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783074020.975070:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074020.975097:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.975128:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472640 00000100:00100000:2.0:1783074020.975133:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472640 00000100:00100000:2.0:1783074020.975168:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783074020.975176:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:85070:x1869685723472640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074020.975185:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074020.975196:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298000/0x5fb609b3016de6ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de6a7 expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.975214:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298000/0x5fb609b3016de6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de6a7 expref: 10 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.975223:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298000/0x5fb609b3016de6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de6a7 expref: 10 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.975239:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298000, rc 0) 00000100:00100000:2.0:1783074020.975276:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85070:x1869685723472640:12345-0@lo:101:mount.lustre.0 Request processed in 102us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.975283:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1783074020.975429:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074020.975482:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074020.975494:0:85070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074020.975501:0:85070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074020.975555:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074020.975579:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783074020.975882:0:85071:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783074020.975953:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.976054:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472768 00000100:00100000:2.0:1783074020.976058:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472768 00000100:00100000:2.0:1783074020.976129:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783074020.976137:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85070:x1869685723472768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074020.976252:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85070:x1869685723472768:12345-0@lo:501:mount.lustre.0 Request processed in 115us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.976259:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783074020.976292:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074020.976344:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074020.976384:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.976937:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb3943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074020.977063:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723472896 00000100:00100000:0.0:1783074020.977069:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723472896 00000100:00100000:0.0:1783074020.977095:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783074020.977101:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85070:x1869685723472896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074020.977269:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85070:x1869685723472896:12345-0@lo:503:mount.lustre.0 Request processed in 167us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074020.977277:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783074020.977380:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723472896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074020.978139:0:85091:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85091:1869685723473024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074020.978181:0:85091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.978245:0:85091:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.978332:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473024 00000100:00100000:2.0:1783074020.978337:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473024 00000100:00100000:2.0:1783074020.978405:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783074020.978412:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85091:x1869685723473024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074020.978720:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85091:x1869685723473024:12345-0@lo:502:llog_process_th.0 Request processed in 299us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.978731:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783074020.978762:0:85091:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85091:1869685723473024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074020.978786:0:85091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074020.978906:0:85091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.978908:0:85091:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783074020.978915:0:85091:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524c6cad800 00000020:00000080:1.0:1783074020.978916:0:85091:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783074020.978923:0:85091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074020.978925:0:85091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.978926:0:85091:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783074020.978927:0:85091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074020.978929:0:85091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074020.978930:0:85091:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783074020.978931:0:85091:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524c6cad800 00000020:00000080:1.0:1783074020.978932:0:85091:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783074020.979009:0:85091:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85091:1869685723473152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074020.979042:0:85091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.979069:0:85091:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074020.979098:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473152 00000100:00100000:3.0:1783074020.979103:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473152 00000100:00100000:3.0:1783074020.979138:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783074020.979145:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85091:x1869685723473152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074020.979253:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85091:x1869685723473152:12345-0@lo:502:llog_process_th.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.979261:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783074020.979304:0:85091:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85091:1869685723473152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783074020.979520:0:85091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074020.979526:0:85091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074020.979528:0:85091:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783074020.979533:0:85091:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783074020.979679:0:85070:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783074020.979709:0:85070:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074020.979738:0:85070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.979749:0:85070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.979807:0:85070:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783074020.979813:0:85070:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9524c6cad800 10000000:01000000:1.0:1783074020.979816:0:85070:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9524c6cad800 10000000:01000000:1.0:1783074020.979820:0:85070:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783074020.979825:0:85070:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6cad800 from 1 10000000:01000000:1.0:1783074020.979828:0:85070:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074020.979851:0:85070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.979860:0:85070:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.979868:0:85070:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.979880:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723473280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074020.979906:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.979930:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074020.979941:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473280 00000100:00100000:3.0:1783074020.979947:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473280 00000100:00100000:3.0:1783074020.979976:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783074020.979984:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:85070:x1869685723473280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074020.979993:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074020.980007:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671400/0x5fb609b3016de6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de6b5 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.980030:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671400/0x5fb609b3016de6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de6b5 expref: 11 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.980041:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671400/0x5fb609b3016de6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de6b5 expref: 11 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.980049:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671400, rc 0) 00000100:00100000:3.0:1783074020.980089:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723473280:12345-0@lo:101:mount.lustre.0 Request processed in 106us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.980095:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783074020.980130:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723473280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074020.980142:0:85070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.980150:0:85070:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074020.980211:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723473408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783074020.980243:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074020.980267:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9525020493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074020.980286:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473408 00000100:00100000:1.0:1783074020.980291:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473408 00000100:00100000:1.0:1783074020.980332:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783074020.980340:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723473408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074020.980512:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723473408:12345-0@lo:501:mount.lustre.0 Request processed in 172us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.980513:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723473408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074020.980527:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783074020.980752:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723473536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074020.980789:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074020.980832:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9525020493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074020.980858:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473536 00000100:00100000:1.0:1783074020.980863:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473536 00000100:00100000:1.0:1783074020.980886:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783074020.980892:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723473536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074020.980973:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723473536:12345-0@lo:503:mount.lustre.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.981051:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723473536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074020.981507:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783074020.981911:0:85093:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85093:1869685723473664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074020.982117:0:85093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.982152:0:85093:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc4570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074020.982514:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473664 00000100:00100000:1.0:1783074020.982520:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473664 00000100:00100000:1.0:1783074020.982553:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783074020.982560:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85093:x1869685723473664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074020.982656:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85093:x1869685723473664:12345-0@lo:502:llog_process_th.0 Request processed in 96us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.982664:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783074020.982690:0:85093:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85093:1869685723473664:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783074020.982764:0:85093:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783074020.982785:0:85093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9523c2c33380) 00000020:00000080:2.0:1783074020.982809:0:85093:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783074020.985677:0:85093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cad800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074020.985685:0:85093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6cad800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074020.985688:0:85093:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cad800 4 00010000:00080000:2.0:1783074020.985739:0:85093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524f7805000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1783074020.988786:0:85093:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783074020.988905:0:85093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783074020.988969:0:85093:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783074020.988985:0:85093:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb609b3016de6ca 00000100:00080000:2.0:1783074020.988996:0:85093:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074020.989002:0:85093:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524f7805000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074020.989036:0:85093:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df2eb480 x1869685723473792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074020.989064:0:85093:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783074020.989252:0:85093:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85093:1869685723473920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074020.989346:0:85093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.989368:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723473792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074020.989376:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473920 00000100:00100000:2.0:1783074020.989381:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473920 00000100:00100000:1.0:1783074020.989404:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.989413:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783074020.989421:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85093:x1869685723473920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074020.989452:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723473792 00000100:00100000:1.0:1783074020.989457:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723473792 00000100:00100000:1.0:1783074020.989483:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1783074020.989489:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723473792:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074020.989512:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85093:x1869685723473920:12345-0@lo:502:llog_process_th.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074020.989517:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783074020.989541:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723473792:12345-0@lo:38:llog_process_th.0 Request processed in 49us (134us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074020.989547:0:85093:0:(client.c:2701:ptlrpc_set_wait()) set ffff9525020493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074020.989551:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1783074020.989565:0:85093:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85093:1869685723473920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074020.989588:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1783074020.989596:0:85093:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85093:1869685723474048:0@lo:502:llog_process_th.0 00000100:00080000:1.0:1783074020.989596:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f7805000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074020.989603:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074020.989609:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723473792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074020.989626:0:85093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074020.989639:0:85093:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074020.989649:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474048 00000100:00100000:1.0:1783074020.989654:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474048 00000100:00100000:1.0:1783074020.989690:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783074020.989703:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85093:x1869685723474048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074020.989795:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85093:x1869685723474048:12345-0@lo:502:llog_process_th.0 Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.989803:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783074020.989833:0:85093:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:85093:1869685723474048:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074020.989916:0:85093:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783074020.990014:0:85070:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783074020.990039:0:85070:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074020.990056:0:85070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.990066:0:85070:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783074020.990112:0:85070:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783074020.990115:0:85070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783074020.990116:0:85070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074020.990117:0:85070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074020.990118:0:85070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074020.990120:0:85070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074020.990122:0:85070:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074020.990123:0:85070:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783074020.990125:0:85070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074020.990127:0:85070:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783074020.990130:0:85070:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783074020.990133:0:85070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783074020.990135:0:85070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783074020.990136:0:85070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074020.990141:0:85070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074020.990142:0:85070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074020.990143:0:85070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074020.990144:0:85070:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074020.990145:0:85070:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783074020.990146:0:85070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074020.990146:0:85070:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783074020.990159:0:85070:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783074020.990168:0:85070:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723474176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783074020.990199:0:85070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074020.990257:0:85070:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2a01540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074020.991139:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474176 00000100:00100000:2.0:1783074020.991144:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474176 00000100:00100000:2.0:1783074020.991187:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783074020.991196:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723474176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783074020.991218:0:85078:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783074020.991231:0:85078:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783074020.997141:0:85078:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783074020.997173:0:85078:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783074020.997189:0:85079:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783074020.997195:0:85079:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783074020.997216:0:85079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.997234:0:85079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074020.997243:0:85079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.997725:0:85079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.997741:0:85079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 2960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074020.997754:0:85079:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85079:1869685723474304:0@lo:104: 00000100:00100000:3.0:1783074020.997812:0:85079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.997858:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474304 00000100:00100000:1.0:1783074020.997864:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474304 00000100:00100000:3.0:1783074020.997887:0:85079:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074020.997907:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783074020.997917:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:85079:x1869685723474304:12345-0@lo:104: 00010000:00010000:1.0:1783074020.997929:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.997988:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783074020.997995:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:85070:x1869685723474176:12345-0@lo:253:mount.lustre.0 Request processed in 6798us (7793us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.997997:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:85079:x1869685723474304:12345-0@lo:104: Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074020.998015:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1783074020.998015:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783074020.998051:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074020.998056:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998064:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074020.998067:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998075:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074020.998081:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074020.998086:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783074020.998089:0:85070:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:85070:1869685723474176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783074020.998100:0:85070:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783074020.998103:0:85070:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783074020.998104:0:85070:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074020.998106:0:85070:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074020.998107:0:85070:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074020.998108:0:85070:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074020.998109:0:85070:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074020.998111:0:85070:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074020.998117:0:85070:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074020.998119:0:85070:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074020.998120:0:85070:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1783074020.998125:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998131:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:02000000:2.0:1783074020.998133:0:85070:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783074020.998147:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998153:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb361a00/0x5fb609b3016de692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016de6a0 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998165:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074020.998167:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074020.998169:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074020.998179:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723474432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074020.998206:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074020.998239:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474432 00000100:00100000:1.0:1783074020.998243:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474432 00010000:00010000:1.0:1783074020.998256:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 2960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.998275:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1783074020.998280:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3660:x1869685723474432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074020.998291:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074020.998296:0:19655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 2960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998305:0:19655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 2960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998337:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998351:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074020.998363:0:19655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001169296s 00010000:00010000:1.0:1783074020.998368:0:19655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998375:0:19655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998382:0:19655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998388:0:19655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998394:0:19655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074020.998398:0:19655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998406:0:19655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998415:0:19655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074020.998424:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074020.998455:0:85079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298400/0x5fb609b3016de6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016de692 expref: 11 pid: 85078 timeout: 2960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074020.998465:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3660:x1869685723474432:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074020.998469:0:85079:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85079:1869685723474304:0@lo:104: 00000100:00100000:1.0:1783074020.998476:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00010000:00010000:3.0:1783074020.998495:0:85079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.998506:0:85079:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.998514:0:85079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074020.998528:0:85079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298800/0x5fb609b3016de6d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074020.998586:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723474432:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783074021.003953:0:85070:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:2.0:1783074021.004244:0:85070:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783074021.004254:0:85099:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:0.0:1783074021.004258:0:85099:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:0.0:1783074021.004759:0:85100:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1783074021.004806:0:85100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1783074021.005280:0:85070:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1783074021.005752:0:85101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85101:1869685723474560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074021.005823:0:85101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074021.005869:0:85101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3318f00 going to sleep for 11 seconds 00000040:00080000:0.0:1783074021.006729:0:85100:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783074021.006794:0:85100:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1783074021.006932:0:85070:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:1.0:1783074021.006949:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474560 00000100:00100000:1.0:1783074021.006957:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474560 00000040:00080000:3.0:1783074021.006975:0:85070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783074021.007002:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:1.0:1783074021.007013:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85101:x1869685723474560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074021.007105:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85101:x1869685723474560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074021.007112:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:2.0:1783074021.007460:0:85101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85101:1869685723474560:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783074021.007493:0:85101:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783074021.007526:0:85101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85101:1869685723474688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074021.007564:0:85101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074021.007586:0:85101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074021.007598:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474688 00000100:00100000:0.0:1783074021.007602:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474688 00000100:00100000:0.0:1783074021.007661:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:0.0:1783074021.007669:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85101:x1869685723474688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074021.007785:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85101:x1869685723474688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074021.007795:0:85101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85101:1869685723474688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074021.007808:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:2.0:1783074021.007863:0:85101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85101:1869685723474816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074021.007887:0:85101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074021.007903:0:85101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074021.007921:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474816 00000100:00100000:1.0:1783074021.007925:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474816 00000100:00100000:1.0:1783074021.007948:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586 00000100:00100000:1.0:1783074021.007952:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c643b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85101:x1869685723474816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074021.008022:0:85101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85101:1869685723474816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074021.008049:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c643b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85101:x1869685723474816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074021.008055:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586 00000040:00080000:0.0:1783074021.008057:0:85101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783074021.008591:0:85070:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783074021.008602:0:85070:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783074021.008666:0:85070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074021.011284:0:85101:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783074021.011384:0:85101:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783074021.011389:0:85101:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1783074021.012199:0:85070:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783074021.012824:0:85070:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783074021.012860:0:85070:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783074021.012971:0:85070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783074021.013520:0:85070:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:2.0:1783074021.015136:0:85070:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:0.0:1783074021.015772:0:85102:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85102 00010000:02000000:0.0:1783074021.015788:0:85102:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1783074021.015791:0:85102:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783074021.015794:0:85102:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783074021.016084:0:85070:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783074021.016100:0:85070:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783074021.016119:0:85070:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783074021.016138:0:85070:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783074021.017077:0:85070:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074021.017257:0:85070:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783074021.999412:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783074022.894409:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783074022.894418:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6cad800 from 107 10000000:01000000:0.0:1783074022.894423:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783074022.894480:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.894493:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.894505:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.894530:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723474944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.894593:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.894637:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.894696:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723474944 00000100:00100000:1.0:1783074022.894704:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723474944 00000100:00100000:1.0:1783074022.894760:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783074022.894770:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:6527:x1869685723474944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.894784:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074022.894797:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c4b25200/0x5fb609b3016de6df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de6d8 expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.894821:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b25200/0x5fb609b3016de6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de6d8 expref: 11 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.894831:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c4b25200/0x5fb609b3016de6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de6d8 expref: 11 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.894852:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25200, rc 0) 00000100:00100000:1.0:1783074022.894889:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723474944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.894896:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783074022.894976:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723474944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.894998:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.895006:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.895049:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.895078:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.895100:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.895146:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475072 00000100:00100000:1.0:1783074022.895150:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475072 00000100:00100000:1.0:1783074022.895179:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783074022.895186:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723475072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783074022.895199:0:85078:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783074022.895214:0:85078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783074022.895218:0:85078:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 107 00000100:00100000:1.0:1783074022.895284:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723475072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.895291:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783074022.895383:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783074022.895430:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783074022.895437:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.895445:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074022.895454:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074022.895456:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 52 10000000:01000000:0.0:1783074022.895458:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074022.895474:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.895481:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.895488:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.895510:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.895535:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.895562:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.895602:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475200 00000100:00100000:1.0:1783074022.895606:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475200 00000100:00100000:1.0:1783074022.895635:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783074022.895642:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723475200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.895649:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074022.895657:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c4b25400/0x5fb609b3016de6ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de6e6 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.895669:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b25400/0x5fb609b3016de6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de6e6 expref: 12 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.895690:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c4b25400/0x5fb609b3016de6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de6e6 expref: 12 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.895708:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25400, rc 0) 00000100:00100000:1.0:1783074022.895735:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723475200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.895741:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783074022.895796:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.895805:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.895813:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.895855:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.895877:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.895896:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.895936:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475328 00000100:00100000:1.0:1783074022.895940:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475328 00000100:00100000:1.0:1783074022.895968:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783074022.895974:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723475328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.896070:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723475328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.896076:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783074022.896259:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.896284:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.896351:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.896365:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.896423:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475456 00000100:00100000:1.0:1783074022.896427:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475456 00000100:00100000:1.0:1783074022.896453:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783074022.896460:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723475456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.896537:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723475456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.896543:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783074022.896565:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074022.897558:0:85315:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783074022.897727:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783074022.897758:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074022.897767:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.897776:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074022.897784:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783074022.897786:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 104 10000000:01000000:3.0:1783074022.897789:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783074022.897815:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.897823:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.897842:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.897860:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.897900:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.897957:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.898000:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475584 00000100:00100000:1.0:1783074022.898005:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475584 00000100:00100000:1.0:1783074022.898038:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783074022.898045:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723475584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.898055:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074022.898067:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c4b24800/0x5fb609b3016de6fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de6f4 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.898093:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b24800/0x5fb609b3016de6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de6f4 expref: 13 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.898102:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c4b24800/0x5fb609b3016de6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de6f4 expref: 13 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.898108:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24800, rc 0) 00000100:00100000:1.0:1783074022.898187:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723475584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.898194:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783074022.898249:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074022.898261:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.898270:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.898380:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.898420:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.898490:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.898525:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475712 00000100:00100000:1.0:1783074022.898530:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475712 00000100:00100000:1.0:1783074022.898598:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783074022.898607:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723475712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783074022.898621:0:85076:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783074022.898637:0:85076:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783074022.898641:0:85076:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783074022.898644:0:85076:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783074022.898647:0:85076:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783074022.898650:0:85076:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:1.0:1783074022.898750:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723475712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.898758:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783074022.898809:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783074022.898882:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783074022.898888:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.898896:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074022.898902:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783074022.898905:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783074022.898912:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783074022.898927:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.898936:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.898944:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.898956:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.898982:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.899105:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c12ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.899151:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475840 00000100:00100000:0.0:1783074022.899156:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475840 00000100:00100000:0.0:1783074022.899180:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783074022.899187:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723475840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.899194:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074022.899203:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb360c00/0x5fb609b3016de709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de702 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.899225:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb360c00/0x5fb609b3016de709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de702 expref: 14 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.899233:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb360c00/0x5fb609b3016de709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de702 expref: 14 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.899239:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360c00, rc 0) 00000100:00100000:0.0:1783074022.899270:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723475840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.899277:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783074022.899422:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074022.899432:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.899441:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.899492:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.899515:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.899592:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c12ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.899721:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723475968 00000100:00100000:0.0:1783074022.899725:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723475968 00000100:00100000:0.0:1783074022.899782:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783074022.899790:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723475968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.899910:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723475968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.899916:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783074022.899990:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.900018:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.900056:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.900122:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c12ed840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.900159:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476096 00000100:00100000:1.0:1783074022.900163:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476096 00000100:00100000:1.0:1783074022.900183:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783074022.900190:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723476096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.903024:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723476096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2805us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074022.903039:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783074022.903192:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074022.904247:0:85317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1783074022.904494:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1783074022.904519:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783074022.904530:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.904542:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074022.904551:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1783074022.904554:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9523c6b72800 from 1 10000000:01000000:1.0:1783074022.904557:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074022.904590:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.904599:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.904608:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074022.904627:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.904687:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.904754:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.904791:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476224 00000100:00100000:2.0:1783074022.904797:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476224 00000100:00100000:2.0:1783074022.904892:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783074022.904903:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723476224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.904917:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074022.904930:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299a00/0x5fb609b3016de717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de710 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.904953:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299a00/0x5fb609b3016de717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de710 expref: 15 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.904964:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299a00/0x5fb609b3016de717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de710 expref: 15 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.904973:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299a00, rc 0) 00000100:00100000:2.0:1783074022.905022:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723476224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.905030:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783074022.905098:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.905113:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.905132:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074022.905146:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783074022.905150:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.905157:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074022.905164:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783074022.905166:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c6b72800 from 7 10000000:01000000:1.0:1783074022.905168:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783074022.905182:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.905189:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.905196:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074022.905208:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.905235:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.905352:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074022.905423:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476352 00000100:00100000:3.0:1783074022.905428:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476352 00000100:00100000:3.0:1783074022.905451:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783074022.905458:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723476352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074022.905465:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074022.905474:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670200/0x5fb609b3016de725 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de71e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.905488:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670200/0x5fb609b3016de725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de71e expref: 16 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.905496:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670200/0x5fb609b3016de725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de71e expref: 16 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.905502:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:3.0:1783074022.905597:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723476352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074022.905603:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783074022.905719:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.905730:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.905749:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074022.905801:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.905827:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.905892:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074022.905924:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476480 00000100:00100000:3.0:1783074022.905928:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476480 00000100:00100000:3.0:1783074022.905988:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783074022.905997:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723476480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.906108:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723476480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074022.906116:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783074022.906189:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.906219:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.906259:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.906286:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.906338:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476608 00000100:00100000:0.0:1783074022.906344:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476608 00000100:00100000:0.0:1783074022.906562:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783074022.906572:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723476608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.906662:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723476608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.906670:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783074022.906688:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074022.907627:0:85318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783074022.907796:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783074022.907820:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074022.907829:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.907838:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074022.907848:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074022.907850:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 52 10000000:01000000:1.0:1783074022.907853:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074022.907876:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.907885:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.907900:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074022.907916:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.907960:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.908052:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b300 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.908083:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476736 00000100:00100000:0.0:1783074022.908095:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476736 00000100:00100000:0.0:1783074022.908164:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783074022.908173:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723476736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.908183:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074022.908194:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb360e00/0x5fb609b3016de733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de72c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.908215:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb360e00/0x5fb609b3016de733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de72c expref: 17 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.908224:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb360e00/0x5fb609b3016de733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de72c expref: 17 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.908234:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360e00, rc 0) 00000100:00100000:0.0:1783074022.908269:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723476736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.908275:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783074022.908353:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.908367:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.908376:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074022.908422:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.908447:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.908467:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b300 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.908513:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476864 00000100:00100000:0.0:1783074022.908517:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476864 00000100:00100000:0.0:1783074022.908577:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783074022.908585:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723476864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.908693:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723476864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.908700:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783074022.908755:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.908780:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.908818:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.908835:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.908847:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723476992 00000100:00100000:1.0:1783074022.908850:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723476992 00000100:00100000:1.0:1783074022.908871:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783074022.908876:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723476992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.908947:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb4cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723476992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.908961:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783074022.909005:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723476992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074022.909855:0:85320:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783074022.910018:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783074022.910038:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074022.910045:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.910053:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074022.910060:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783074022.910062:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783074022.910064:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783074022.910084:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.910090:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.910095:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.910107:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.910145:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074022.910182:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477120 00000100:00100000:2.0:1783074022.910187:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477120 00000100:00100000:3.0:1783074022.910198:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.910225:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783074022.910234:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723477120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.910242:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074022.910250:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299000/0x5fb609b3016de741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de73a expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.910266:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299000/0x5fb609b3016de741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de73a expref: 18 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.910273:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299000/0x5fb609b3016de741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de73a expref: 18 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.910292:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299000, rc 0) 00000100:00100000:2.0:1783074022.910343:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb4cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723477120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.910349:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783074022.910365:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074022.910379:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.910388:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.910447:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.910476:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074022.910513:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477248 00000100:00100000:2.0:1783074022.910517:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477248 00000100:00100000:3.0:1783074022.910519:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.910540:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783074022.910547:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c579d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723477248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.910725:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c579d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723477248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.910733:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783074022.910747:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.910772:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.910807:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.910830:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.910889:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477376 00000100:00100000:2.0:1783074022.910893:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477376 00000100:00100000:2.0:1783074022.910915:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783074022.910921:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c579f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723477376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.911559:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c579f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723477376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 635us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.911566:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783074022.911597:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074022.912282:0:85322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783074022.912404:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783074022.912434:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783074022.912442:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.912453:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074022.912461:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783074022.912464:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49f9000 from 7 10000000:01000000:3.0:1783074022.912466:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074022.912490:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.912498:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.912507:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.912530:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.912568:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.912612:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.912721:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477504 00000100:00100000:2.0:1783074022.912726:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477504 00000100:00100000:2.0:1783074022.912768:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783074022.912777:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723477504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.912790:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074022.912801:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298600/0x5fb609b3016de74f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de748 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.912831:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298600/0x5fb609b3016de74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de748 expref: 19 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.912841:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298600/0x5fb609b3016de74f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de748 expref: 19 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.912849:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298600, rc 0) 00000100:00100000:2.0:1783074022.912951:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723477504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074022.912952:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.912959:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1783074022.912966:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074022.912974:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074022.913033:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.913071:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074022.913096:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.913132:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477632 00000100:00100000:2.0:1783074022.913136:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477632 00000100:00100000:2.0:1783074022.913166:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783074022.913173:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723477632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.913268:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723477632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.913275:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783074022.913277:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.913306:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.913448:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074022.913465:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477760 00000100:00100000:3.0:1783074022.913468:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.913469:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477760 00000100:00100000:2.0:1783074022.913491:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783074022.913497:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723477760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.913702:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.913703:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723477760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.913709:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:1.0:1783074022.914784:0:85324:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074022.914938:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074022.914959:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074022.914968:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.914990:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074022.914999:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074022.915002:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 52 10000000:01000000:0.0:1783074022.915004:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074022.915030:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.915038:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.915047:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.915065:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.915111:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.915157:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.915213:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723477888 00000100:00100000:2.0:1783074022.915220:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723477888 00000100:00100000:2.0:1783074022.915303:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783074022.915363:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723477888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.915373:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074022.915384:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298200/0x5fb609b3016de75d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de756 expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.915404:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298200/0x5fb609b3016de75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de756 expref: 20 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.915414:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298200/0x5fb609b3016de75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de756 expref: 20 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.915422:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298200, rc 0) 00000100:00100000:2.0:1783074022.915456:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723477888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.915462:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783074022.915550:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723477888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.915563:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.915571:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.915625:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.915650:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.915772:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478016 00000100:00100000:1.0:1783074022.915777:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478016 00000100:00100000:1.0:1783074022.915800:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783074022.915807:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723478016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.915906:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723478016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.915913:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783074022.915990:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.916003:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.916026:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.916058:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.916110:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.916143:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478144 00000100:00100000:1.0:1783074022.916147:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478144 00000100:00100000:1.0:1783074022.916206:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783074022.916214:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723478144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.916299:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723478144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074022.916307:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783074022.916404:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074022.918948:0:85325:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783074022.919064:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783074022.919089:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074022.919098:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.919108:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074022.919117:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783074022.919120:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783074022.919124:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783074022.919167:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.919187:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.919196:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074022.919214:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.919259:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074022.919292:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3213d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074022.919302:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478272 00000100:00100000:0.0:1783074022.920137:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478272 00000100:00100000:0.0:1783074022.920375:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783074022.920589:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723478272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.920605:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074022.920621:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb361400/0x5fb609b3016de76b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de764 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.920645:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb361400/0x5fb609b3016de76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de764 expref: 21 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.920656:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb361400/0x5fb609b3016de76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de764 expref: 21 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.920666:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb361400, rc 0) 00000100:00100000:0.0:1783074022.920741:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723478272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 357us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.920749:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783074022.920836:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.920851:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.920860:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074022.921048:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.921082:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074022.921116:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3213d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074022.921134:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478400 00000100:00100000:3.0:1783074022.921140:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478400 00000100:00100000:3.0:1783074022.921174:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783074022.921181:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723478400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074022.921435:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723478400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074022.921450:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783074022.921652:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6438a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.921711:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.921753:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.921790:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.921792:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478528 00000100:00100000:2.0:1783074022.921857:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478528 00000100:00100000:2.0:1783074022.921901:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783074022.921909:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723478528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.923166:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723478528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1253us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.923178:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783074022.923186:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074022.923982:0:85328:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783074022.924121:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783074022.924150:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783074022.924160:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.924170:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074022.924179:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783074022.924181:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f4a91000 from 7 10000000:01000000:0.0:1783074022.924184:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783074022.924213:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.924221:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.924231:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.924249:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.924291:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.924405:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.924470:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478656 00000100:00100000:2.0:1783074022.924477:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478656 00000100:00100000:2.0:1783074022.924547:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783074022.924556:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723478656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.924568:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074022.924580:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298c00/0x5fb609b3016de779 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de772 expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.924602:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298c00/0x5fb609b3016de779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de772 expref: 22 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.924610:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298c00/0x5fb609b3016de779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de772 expref: 22 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.924616:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298c00, rc 0) 00000100:00100000:2.0:1783074022.924706:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723478656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.924714:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783074022.924769:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.924785:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.924794:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074022.924836:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.924860:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.924874:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0a966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.924902:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478784 00000100:00100000:2.0:1783074022.924908:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478784 00000100:00100000:2.0:1783074022.924937:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783074022.924945:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723478784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.925038:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723478784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.925047:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783074022.925053:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.925081:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.925109:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074022.925129:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0a966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.925161:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723478912 00000100:00100000:2.0:1783074022.925163:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723478912 00000100:00100000:2.0:1783074022.925183:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783074022.925189:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723478912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074022.925280:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723478912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.925285:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783074022.925386:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723478912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074022.926075:0:85329:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074022.926192:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074022.926209:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074022.926216:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926232:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074022.926241:0:6527:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783074022.926243:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074022.926246:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783074022.926269:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926277:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926285:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.926296:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723479040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.926347:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.926374:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.926395:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479040 00000100:00100000:1.0:1783074022.926400:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479040 00000100:00100000:1.0:1783074022.926426:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783074022.926433:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723479040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074022.926441:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074022.926453:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c4b25000/0x5fb609b3016de787 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de780 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.926471:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b25000/0x5fb609b3016de787 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de780 expref: 23 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.926479:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c4b25000/0x5fb609b3016de787 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de780 expref: 23 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074022.926487:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25000, rc 0) 00000100:00100000:1.0:1783074022.926565:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723479040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074022.926565:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723479040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.926572:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:0.0:1783074022.926577:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926584:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074022.926597:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783074022.926601:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926697:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074022.926703:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783074022.926704:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074022.926705:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783074022.926716:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926721:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926725:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.926736:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723479168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.926754:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.926768:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074022.926784:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479168 00000100:00100000:2.0:1783074022.926788:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479168 00000100:00100000:2.0:1783074022.926809:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783074022.926816:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723479168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074022.926823:0:85076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074022.926830:0:85076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299e00/0x5fb609b3016de795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016de78e expref: -99 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.926842:0:85076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299e00/0x5fb609b3016de795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016de78e expref: 24 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.926850:0:85076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299e00/0x5fb609b3016de795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016de78e expref: 24 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074022.926857:0:85076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299e00, rc 0) 00000100:00100000:2.0:1783074022.926885:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723479168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074022.926891:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783074022.926897:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723479168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074022.926906:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.926914:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074022.926953:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723479296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074022.926971:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074022.926990:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783074022.927003:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479296 00000100:00100000:1.0:1783074022.927007:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479296 00000100:00100000:1.0:1783074022.927034:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783074022.927040:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723479296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074022.927100:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723479296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074022.927107:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783074022.927109:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723479296:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783074022.927131:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783074022.927136:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074022.927144:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074023.022874:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074023.026263:0:85353:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1783074023.475823:0:85405:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074023.475961:0:85405:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1783074023.909012:0:85455:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074023.909210:0:85455:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783074023.919758:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074023.919824:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074023.919837:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018560 00000100:00100000:1.0:1783074023.919847:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018560 00000100:00100000:1.0:1783074023.919885:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1783074023.919893:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1869685708018560:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:1.0:1783074023.919901:0:85076:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:1.0:1783074023.919967:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1869685708018560:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 73us (218us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783074023.919975:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1783074023.920016:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018816 00000100:00100000:0.0:1783074023.920022:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018816 00000100:00080000:1.0:1783074023.920054:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074023.920074:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 719 00000100:00100000:0.0:1783074023.920084:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708018816:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074023.920136:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708018816:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074023.920143:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 719 00000100:00100000:3.0:1783074023.921445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074023.921491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074023.921512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074023.921536:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074023.921770:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018688 00000100:00100000:0.0:1783074023.921777:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018688 00000100:00100000:0.0:1783074023.921862:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1033 00000100:00100000:0.0:1783074023.921881:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708018688:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:1.0:1783074023.921882:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708018944 00000100:00100000:1.0:1783074023.921887:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708018944 00010000:00080000:0.0:1783074023.921912:0:66201:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0510a7c0-d9c1-4de9-a6c3-ede973deaaff' at ffff9524fb548000, cookie 0x5fb609b3016de622 00010000:00080000:0.0:1783074023.921920:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp recovering/t98784247810 exp ffff9524fb548000 cur 2863 last 1783074020 00000100:00100000:1.0:1783074023.921928:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019072 00010000:02000400:0.0:1783074023.921930:0:66201:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:1.0:1783074023.921933:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019072 00000100:00100000:1.0:1783074023.921963:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4871 00000100:00100000:1.0:1783074023.921970:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708018944:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:1.0:1783074023.921989:0:26176:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016ddaa6 00000100:00080000:1.0:1783074023.921997:0:26176:0:(import.c:65:import_set_state_nolock()) ffff9524c356a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783074023.922033:0:26176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968711 00000100:00100000:1.0:1783074023.922153:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+2:2401:x1869685708018944:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 184us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074023.922168:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4871 00000100:00100000:1.0:1783074023.922182:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4872 00000100:00100000:1.0:1783074023.922188:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c640a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708019072:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:1.0:1783074023.922198:0:26176:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de48c 00000100:00080000:1.0:1783074023.922202:0:26176:0:(import.c:65:import_set_state_nolock()) ffff9523c6a62000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783074023.922224:0:26176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968706 00010000:00010000:3.0:1783074023.922261:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074023.922269:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074023.922287:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c640a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+2:2401:x1869685708019072:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 98us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074023.922291:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019200 00000100:00100000:1.0:1783074023.922296:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4872 00000100:00100000:3.0:1783074023.922297:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019200 00000100:00100000:3.0:1783074023.922349:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:3.0:1783074023.922356:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1869685708019200:12345-192.168.204.26@tcp:250:kworker.0 00000100:00080000:2.0:1783074023.922372:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074023.922377:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783074023.922379:0:85078:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from da924155-7591-4a6a-a2d2-c0d2908d0bfb@192.168.204.26@tcp t0 exp 0000000000000000 cur 2863 last 0 00000020:00000080:3.0:1783074023.922407:0:85078:0:(genops.c:1406:class_connect()) connect: client da924155-7591-4a6a-a2d2-c0d2908d0bfb, cookie 0x5fb609b3016de79c 00000100:00080000:3.0:1783074023.922648:0:85078:0:(import.c:65:import_set_state_nolock()) ffff9524f0837000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074023.922702:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:2401:x1869685708019200:12345-192.168.204.26@tcp:250:kworker.0 Request processed in 345us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074023.922709:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00010000:00080000:0.0:1783074023.934798:0:66201:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1783074023.934840:0:66201:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783074023.934978:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524c6020000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074023.935048:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708018688:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 13176us (13606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074023.935058:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1033 00000100:00100000:0.0:1783074023.937295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074023.937603:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708013824 00000100:00100000:0.0:1783074023.937612:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708013824 00000100:00100000:0.0:1783074023.937668:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1034 00000100:00100000:0.0:1783074023.937678:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708013824:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00080000:0.0:1783074023.937693:0:66202:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:0.0:1783074023.937716:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708013824:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 40us (425us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074023.937722:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1034 00010000:00080000:0.0:1783074023.937737:0:85102:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1783074024.046803:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074024.879343:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723479424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074024.879429:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074024.879822:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479424 00000100:00100000:2.0:1783074024.879830:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479424 00000100:00100000:2.0:1783074024.879896:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:2.0:1783074024.879906:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723479424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074024.879935:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074024.879978:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723479424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074024.879985:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:2.0:1783074024.880035:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723479424:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783074024.880049:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074024.880949:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723479552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074024.880988:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074024.881058:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479552 00000100:00100000:0.0:1783074024.881063:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479552 00000100:00100000:0.0:1783074024.881111:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:0.0:1783074024.881119:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723479552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074024.881138:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783074024.881218:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074024.882213:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723479552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1091us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074024.882224:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:2.0:1783074024.882537:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723479552:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074025.070630:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074025.524059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074025.524854:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019456 00000100:00100000:0.0:1783074025.524865:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019456 00000100:00100000:0.0:1783074025.524960:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1783074025.524984:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:42363:x1869685708019456:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074025.525001:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074025.525018:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb361a00/0x5fb609b3016de7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af47 expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.525047:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb361a00/0x5fb609b3016de7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af47 expref: 6 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.525058:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb361a00/0x5fb609b3016de7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af47 expref: 6 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.525067:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb361a00, rc 0) 00000100:00100000:0.0:1783074025.525124:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708019456:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 142us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074025.525132:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1783074025.526645:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074025.526696:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019584 00000100:00100000:3.0:1783074025.526703:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019584 00000100:00100000:3.0:1783074025.526744:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1783074025.526760:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708019584:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783074025.526779:0:85078:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783074025.526800:0:85078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783074025.526803:0:85078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783074025.526806:0:85078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783074025.526808:0:85078:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783074025.526810:0:85078:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:3.0:1783074025.528683:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708019584:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 1921us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074025.528696:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:1.0:1783074025.530516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074025.530595:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019712 00000100:00100000:0.0:1783074025.530603:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019712 00000100:00100000:0.0:1783074025.530661:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1783074025.530670:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708019712:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074025.530683:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074025.530701:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb361c00/0x5fb609b3016de7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af4e expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.530728:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb361c00/0x5fb609b3016de7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af4e expref: 7 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.530738:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb361c00/0x5fb609b3016de7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af4e expref: 7 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.530833:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb361c00, rc 0) 00000100:00100000:0.0:1783074025.530882:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708019712:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 213us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074025.530889:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1783074025.533381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074025.533437:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019840 00000100:00100000:3.0:1783074025.533445:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019840 00000100:00100000:3.0:1783074025.533493:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:3.0:1783074025.533502:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708019840:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074025.533651:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708019840:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074025.533660:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:1.0:1783074025.536464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074025.536552:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019968 00000100:00100000:0.0:1783074025.536560:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019968 00000100:00100000:0.0:1783074025.536660:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1783074025.536671:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708019968:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074025.537541:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708019968:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 869us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074025.537551:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:1.0:1783074025.542496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074025.542709:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020096 00000100:00100000:3.0:1783074025.542719:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020096 00000100:00100000:3.0:1783074025.542779:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:3.0:1783074025.542789:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708020096:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074025.542805:0:85078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074025.542822:0:85078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671600/0x5fb609b3016de7b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af55 expref: -99 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074025.542849:0:85078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671600/0x5fb609b3016de7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af55 expref: 9 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074025.542860:0:85078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671600/0x5fb609b3016de7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af55 expref: 9 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074025.542898:0:85078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671600, rc 0) 00000100:00100000:3.0:1783074025.542962:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708020096:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 175us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074025.542969:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1783074025.544863:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074025.545233:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020224 00000100:00100000:0.0:1783074025.545241:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020224 00000100:00100000:0.0:1783074025.545303:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:0.0:1783074025.545346:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708020224:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074025.545490:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708020224:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 179us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074025.545499:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1783074025.547767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074025.547868:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020352 00000100:00100000:3.0:1783074025.547875:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020352 00000100:00100000:3.0:1783074025.547955:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1783074025.547964:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708020352:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074025.548087:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708020352:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 124us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074025.548094:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1783074025.552636:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074025.552803:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020480 00000100:00100000:0.0:1783074025.552812:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020480 00000100:00100000:0.0:1783074025.552872:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:0.0:1783074025.552882:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708020480:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074025.552903:0:85077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074025.552931:0:85077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb360000/0x5fb609b3016de7b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af5c expref: -99 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.552960:0:85077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb360000/0x5fb609b3016de7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af5c expref: 10 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.552970:0:85077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb360000/0x5fb609b3016de7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af5c expref: 10 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074025.552980:0:85077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb360000, rc 0) 00000100:00100000:0.0:1783074025.553040:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708020480:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074025.553047:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1783074025.555542:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074025.555605:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020608 00000100:00100000:3.0:1783074025.555614:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020608 00000100:00100000:3.0:1783074025.555679:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:3.0:1783074025.555690:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708020608:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074025.555797:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708020608:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 109us (262us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783074025.555805:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00010000:00010000:3.0:1783074026.094627:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074026.414781:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723479680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074026.414856:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074026.414924:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074026.414930:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074026.414934:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074026.414942:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074026.414964:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524edc5f800 x1869685723479936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074026.414976:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783074026.414989:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723479808:0@lo:400:kworker.0 00000100:00080000:0.0:1783074026.414997:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074026.415001:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074026.415003:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074026.415009:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074026.415024:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524edc5df80 x1869685723480192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074026.415030:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074026.415059:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783074026.415060:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723480064:0@lo:400:kworker.0 00000100:00080000:0.0:1783074026.415076:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074026.415079:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783074026.415082:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074026.415088:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074026.415108:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524edc5c380 x1869685723480448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074026.415111:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723480320:0@lo:400:kworker.0 00000100:00100000:2.0:1783074026.415134:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.415157:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480064 00000100:00100000:2.0:1783074026.415163:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480064 00000100:00080000:0.0:1783074026.415171:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074026.415175:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074026.415177:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074026.415182:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074026.415198:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4589f80 x1869685723480832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074026.415201:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480320 00000100:00100000:2.0:1783074026.415209:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480320 00000100:00080000:0.0:1783074026.415231:0:36249:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1783074026.415236:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00080000:0.0:1783074026.415238:0:36249:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074026.415241:0:36249:0:(import.c:65:import_set_state_nolock()) ffff9524f7805000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783074026.415245:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723480064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783074026.415251:0:36249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524f7805000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074026.415266:0:36249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c52cb800 x1869685723481216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074026.415285:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723480064:12345-0@lo:400:kworker.0 Request processed in 41us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074026.415293:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1783074026.415299:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1783074026.415330:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723480320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074026.415344:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074026.415362:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c52c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723481088:0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.415381:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723480320:12345-0@lo:400:kworker.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074026.415391:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074026.415399:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1783074026.415426:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723480320:0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.415429:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723480960:0@lo:400:kworker.0 00000100:00100000:2.0:1783074026.415440:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783074026.415446:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723480576:0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.415463:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.415473:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481088 00000100:00100000:2.0:1783074026.415476:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481088 00000100:00100000:2.0:1783074026.415510:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480960 00000100:00100000:0.0:1783074026.415513:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723480064:0@lo:400:kworker.0 00000100:00100000:2.0:1783074026.415514:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480960 00000100:00100000:0.0:1783074026.415532:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074026.415540:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723480704:0@lo:400:kworker.0 00000100:00100000:2.0:1783074026.415545:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1783074026.415560:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723481088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.415570:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.415605:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723481088:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074026.415619:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480704 00000100:00100000:0.0:1783074026.415624:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480704 00000100:00100000:2.0:1783074026.415625:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1783074026.415643:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:2.0:1783074026.415651:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723480960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074026.415688:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723480960:12345-0@lo:400:kworker.0 Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.415690:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479680 00000100:00100000:3.0:1783074026.415696:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479680 00000100:00100000:3.0:1783074026.415724:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3587 00000100:00100000:3.0:1783074026.415733:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723479680:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074026.415740:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723479936:0@lo:38:kworker.0 00000004:00000024:3.0:1783074026.415771:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074026.415778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.415800:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723480192:0@lo:38:kworker.0 00000100:00100000:1.0:1783074026.415897:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.415914:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723480448:0@lo:38:kworker.0 00000100:00100000:1.0:1783074026.415934:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.415947:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723480832:0@lo:38:kworker.0 00000100:00100000:1.0:1783074026.415973:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.415986:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c52cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723481216:0@lo:38:kworker.0 00000100:00100000:1.0:1783074026.416004:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.416027:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480448 00000100:00100000:1.0:1783074026.416031:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480448 00000100:00100000:3.0:1783074026.416046:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723479680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 313us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074026.416053:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588 00000100:00100000:1.0:1783074026.416059:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723480448:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074026.416063:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3587 00010000:00080000:1.0:1783074026.416080:0:8453:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9524fb54c000, cookie 0x5fb609b3016de629 00010000:00080000:1.0:1783074026.416088:0:8453:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9524fb54c000 cur 2865 last 1783074020 00000004:00100000:1.0:1783074026.416104:0:8453:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783074026.416113:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074026.416118:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074026.416151:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723480960:0@lo:400:kworker.0 00000100:00100000:3.0:1783074026.416201:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479936 00000100:00100000:3.0:1783074026.416205:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479936 00000100:00100000:3.0:1783074026.416223:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480192 00000100:00100000:3.0:1783074026.416226:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480192 00000100:00100000:3.0:1783074026.416238:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480832 00000100:00100000:3.0:1783074026.416240:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480832 00000100:00080000:1.0:1783074026.416248:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074026.416250:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481216 00000100:00100000:3.0:1783074026.416254:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481216 00000100:00100000:3.0:1783074026.416268:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1783074026.416273:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723479936:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783074026.416289:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2865 last 0 00000100:00100000:1.0:1783074026.416298:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723480448:12345-0@lo:38:kworker.0 Request processed in 236us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074026.416305:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588 00010000:00080000:1.0:1783074026.416346:0:85102:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000080:3.0:1783074026.416352:0:68632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016de7bf 00010000:00080000:1.0:1783074026.416352:0:85102:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:1.0:1783074026.416359:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000004:00100000:3.0:1783074026.416362:0:68632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1783074026.416364:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:1.0:1783074026.416369:0:85102:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:1.0:1783074026.416372:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.416383:0:85102:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708013824 t98784247810 from 192.168.204.26@tcp req@ffff9524edc5ca80 x1869685708013824/t0(98784247810) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:349/0 lens 528/0 e 0 to 0 dl 1783074034 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074026.416385:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524c8098000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074026.416425:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723479936:12345-0@lo:38:kworker.0 Request processed in 150us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.416431:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1783074026.416450:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1783074026.416455:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723480192:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074026.416458:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783074026.416466:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723480832:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783074026.416473:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2865 last 0 00010000:00080000:1.0:1783074026.416483:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2865 last 0 00000020:00000080:3.0:1783074026.416526:0:68632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb609b3016de7c6 00000020:00000080:1.0:1783074026.416530:0:66202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb609b3016de7cd 00000004:00100000:3.0:1783074026.416534:0:68632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:1.0:1783074026.416540:0:66202:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783074026.416556:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524c8099000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783074026.416564:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524d08c8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074026.416654:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869685723480832:12345-0@lo:38:kworker.0 Request processed in 186us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074026.416661:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783074026.416675:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1783074026.416678:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723481216:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783074026.416691:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2865 last 0 00000020:00000080:1.0:1783074026.416711:0:66202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb609b3016de7d4 00000004:00100000:1.0:1783074026.416716:0:66202:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783074026.416728:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524f08db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074026.416752:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723481216:12345-0@lo:38:kworker.0 Request processed in 73us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074026.416758:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00010000:00080000:1.0:1783074026.416781:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524edc5f800 x1869685723479936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074026.416792:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:0.0:1783074026.417406:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1783074026.417415:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723480704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.417468:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723480704:12345-0@lo:400:kworker.0 Request processed in 55us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074026.417474:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1783074026.417500:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074026.417547:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c52c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723481088:0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.417571:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723480576 00000100:00080000:1.0:1783074026.417573:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9524edc5f800 x1869685723479936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074051 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074026.417576:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723480576 00000100:00080000:1.0:1783074026.417585:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783074026.417589:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074026.417594:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783074026.417599:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723479936:0@lo:38:kworker.0 00010000:00080000:1.0:1783074026.417629:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524edc5df80 x1869685723480192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074026.417647:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00100000:3.0:1783074026.417669:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869685723480192:12345-0@lo:38:kworker.0 Request processed in 1211us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.417676:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1783074026.417718:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723479680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074026.417748:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723479808 00000100:00100000:3.0:1783074026.417752:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723479808 00000100:00100000:3.0:1783074026.417777:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783074026.417783:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723479808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074026.417821:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723479808:12345-0@lo:400:kworker.0 Request processed in 38us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.417827:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783074026.417830:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:0.0:1783074026.417837:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723480576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.417870:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723480576:12345-0@lo:400:kworker.0 Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074026.417876:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00080000:3.0:1783074026.417996:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074026.418020:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723480704:0@lo:400:kworker.0 00000100:00100000:3.0:1783074026.418030:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723479808:0@lo:400:kworker.0 00000100:00100000:0.0:1783074026.418037:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723480576:0@lo:400:kworker.0 00000100:00080000:1.0:1783074026.418430:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9524edc5df80 x1869685723480192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074051 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074026.418438:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783074026.418441:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074026.418445:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783074026.418449:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723480192:0@lo:38:kworker.0 00000100:00080000:1.0:1783074026.418464:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:1.0:1783074026.418470:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783074026.418473:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1783074026.418475:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:1.0:1783074026.418479:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9524f0d24800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:1.0:1783074026.418482:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1783074026.418542:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1783074026.420680:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723480448:0@lo:38:kworker.0 00010000:00080000:0.0:1783074026.420711:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9523c4589f80 x1869685723480832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783074026.420719:0:85468:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1783074026.420725:0:85468:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00000100:00080000:0.0:1783074026.420727:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00010000:00010000:2.0:1783074026.420730:0:85468:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:1.0:1783074026.421576:0:85102:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5144us 00000100:00080000:0.0:1783074026.423636:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9523c4589f80 x1869685723480832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074051 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074026.423646:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074026.423650:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074026.423653:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074026.423658:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723480832:0@lo:38:kworker.0 00010000:00080000:0.0:1783074026.423687:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9523c52cb800 x1869685723481216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074026.423699:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:0.0:1783074026.423705:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783074026.423709:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783074026.423710:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f7805000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074026.423713:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c52cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723481216:0@lo:38:kworker.0 00000100:00080000:2.0:1783074026.423734:0:85468:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1783074026.423787:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723481344:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783074026.423849:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.423945:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481344 00000100:00100000:1.0:1783074026.423951:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481344 00000100:00100000:1.0:1783074026.424032:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589 00000100:00100000:1.0:1783074026.424040:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723481344:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783074026.424053:0:8454:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524e41c1c00 x1869685723481344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:352/0 lens 224/0 e 0 to 0 dl 1783074037 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074026.424061:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723481344:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 23us (214us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074026.424065:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589 00010000:00010000:0.0:1783074026.427144:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427166:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427182:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427209:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427226:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427234:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427942:0:85102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427952:0:85102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427959:0:85102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427964:0:85102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074026.427968:0:85102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427975:0:85102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.427988:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1200) 00010000:00010000:0.0:1783074026.427991:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074026.427995:0:85102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.428001:0:85102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb361e00/0x5fb609b3016de7db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074026.428017:0:85102:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2668a2f reply state 00000000dc8b301e transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.428035:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.428042:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1000) 00010000:00010000:0.0:1783074026.428044:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074026.428047:0:85102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074026.428675:0:85102:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1783074026.428693:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.428697:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:0.0:1783074026.428701:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.428703:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000001:00080000:1.0:1783074026.430222:0:85071:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:0.0:1783074026.430257:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.430268:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.430276:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.430283:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074026.430287:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.430294:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.430338:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1000) 00010000:00010000:0.0:1783074026.430342:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074026.430352:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.430359:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016de7e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074026.430701:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074026.430805:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708014336 00000100:00100000:1.0:1783074026.430813:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708014336 00000100:00100000:1.0:1783074026.430910:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1039 00000100:00100000:1.0:1783074026.430921:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708014336:12345-192.168.204.26@tcp:36:rm.0 00010000:00080000:1.0:1783074026.430938:0:66202:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:1.0:1783074026.430968:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708014336:12345-192.168.204.26@tcp:36:rm.0 Request processed in 50us (270us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074026.430975:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1039 00000020:00080000:0.0:1783074026.431006:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.431010:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:0.0:1783074026.431013:0:85102:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:0.0:1783074026.431015:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.431021:0:85102:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708014336 t98784247811 from 192.168.204.26@tcp req@ffff9524edc5df80 x1869685708014336/t0(98784247811) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 512/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074026.431081:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431092:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431101:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431112:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431119:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431125:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431201:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431217:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431226:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431572:0:85102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431578:0:85102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431582:0:85102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431586:0:85102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074026.431589:0:85102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431596:0:85102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431605:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9524fb6f1400) 00010000:00010000:0.0:1783074026.431619:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783074026.431623:0:85102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431629:0:85102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016de7f7 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431646:0:85102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431659:0:85102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431665:0:85102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431670:0:85102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074026.431673:0:85102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431679:0:85102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431687:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1500) 00010000:00010000:0.0:1783074026.431689:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074026.431692:0:85102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431698:0:85102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016de7e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074026.431709:0:85102:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bbd7744 reply state 0000000064d0ae96 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431720:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.431727:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1700) 00010000:00010000:0.0:1783074026.431729:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074026.431731:0:85102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074026.431910:0:85102:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783074026.431931:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.431934:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:0.0:1783074026.431937:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.431939:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:1.0:1783074026.434508:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.434578:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015488 00000100:00100000:3.0:1783074026.434586:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015488 00000100:00100000:3.0:1783074026.434658:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1040 00000100:00100000:3.0:1783074026.434668:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708015488:12345-192.168.204.26@tcp:101:lfs.0 00010000:00080000:3.0:1783074026.434690:0:66200:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:3.0:1783074026.434705:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708015488:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 40us (205us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074026.434713:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1040 00000020:00080000:0.0:1783074026.434726:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.434731:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:0.0:1783074026.434744:0:85102:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:0.0:1783074026.434748:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.434757:0:85102:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708015488 t98784247812 from 192.168.204.26@tcp req@ffff9524df291c00 x1869685708015488/t0(98784247812) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 536/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1783074026.434779:0:85102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074026.434799:0:85102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016de7fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af32 expref: -99 pid: 85102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.434957:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.434969:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.434980:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.434993:0:85102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.434999:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435005:0:85102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074026.435370:0:85102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:0.0:1783074026.435398:0:85102:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x5fb609b3016de581 00000004:00080000:0.0:1783074026.435402:0:85102:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x5fb609b3016de581 in new mfd 00010000:00010000:0.0:1783074026.435412:0:85102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435419:0:85102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435425:0:85102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435431:0:85102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074026.435435:0:85102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435443:0:85102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435455:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1c00) 00010000:00010000:0.0:1783074026.435458:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074026.435462:0:85102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435468:0:85102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145400/0x5fb609b3016de805 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074026.435483:0:85102:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002693f58d reply state 00000000b9e0e494 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435493:0:85102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435506:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9524fc2ff100) 00010000:00010000:0.0:1783074026.435509:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074026.435512:0:85102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074026.435537:0:85102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016de7fe lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 10 pid: 85102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435549:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fb6f1c00) 00010000:00010000:0.0:1783074026.435551:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074026.435556:0:85102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016de7fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af32 expref: 10 pid: 85102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.435572:0:85102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144c00, rc 0) 00010000:00080000:0.0:1783074026.435641:0:85102:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783074026.435655:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.435658:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:0.0:1783074026.435662:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.435664:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:1.0:1783074026.450508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.450645:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708015744 00000100:00100000:3.0:1783074026.450656:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708015744 00000100:00100000:3.0:1783074026.450719:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1041 00000100:00100000:3.0:1783074026.450730:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c57eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708015744:12345-192.168.204.26@tcp:101:lfs.0 00010000:00080000:3.0:1783074026.450752:0:66201:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:3.0:1783074026.450776:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c57eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708015744:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 49us (279us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074026.450783:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1041 00000020:00080000:1.0:1783074026.450798:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.450803:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:1.0:1783074026.450808:0:85102:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:1.0:1783074026.450811:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.450821:0:85102:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708015744 t98784247813 from 192.168.204.26@tcp req@ffff9523c57eea00 x1869685708015744/t0(98784247813) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 736/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074026.450845:0:85102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074026.450878:0:85102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016de81a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af39 expref: -99 pid: 85102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074026.450971:0:85102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:1.0:1783074026.451118:0:85102:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x5fb609b3016de596 00000004:00080000:1.0:1783074026.451121:0:85102:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x5fb609b3016de596 in new mfd 00010000:00010000:1.0:1783074026.451157:0:85102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016de81a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af39 expref: 12 pid: 85102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.451170:0:85102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc299100) 00010000:00010000:1.0:1783074026.451184:0:85102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783074026.451189:0:85102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016de81a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af39 expref: 12 pid: 85102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.451204:0:85102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24400, rc 0) 00010000:00080000:1.0:1783074026.451261:0:85102:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783074026.451274:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.451276:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:1.0:1783074026.451279:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.451292:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:2.0:1783074026.453501:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.453758:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016128 00000100:00100000:3.0:1783074026.453766:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016128 00000100:00100000:3.0:1783074026.453843:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 214 00000100:00100000:3.0:1783074026.453853:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2401:x1869685708016128:12345-192.168.204.26@tcp:35:lfs.0 00010000:00080000:3.0:1783074026.453872:0:66203:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1783074026.453890:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2401:x1869685708016128:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 39us (398us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074026.453898:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 214 00000020:00080000:1.0:1783074026.453943:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.453949:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:1.0:1783074026.453953:0:85102:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:1.0:1783074026.453956:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.453966:0:85102:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708016128 t98784247814 from 192.168.204.26@tcp req@ffff9524edc5f800 x1869685708016128/t0(98784247814) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 392/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074026.454201:0:85102:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783074026.454216:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.454218:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:1.0:1783074026.454221:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074026.454223:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:2.0:1783074026.457958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074026.458464:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708016384 00000100:00100000:1.0:1783074026.458475:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708016384 00000100:00100000:1.0:1783074026.458525:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:1.0:1783074026.458535:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2401:x1869685708016384:12345-192.168.204.26@tcp:35:lfs.0 00010000:00080000:1.0:1783074026.458553:0:66204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:1.0:1783074026.458579:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2401:x1869685708016384:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 46us (630us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074026.458588:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 215 00000020:00080000:0.0:1783074026.458655:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.458662:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:0.0:1783074026.458664:0:85102:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:0.0:1783074026.458667:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.458674:0:85102:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708016384 t98784247815 from 192.168.204.26@tcp req@ffff9524edc5ea00 x1869685708016384/t0(98784247815) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 392/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783074026.458967:0:85102:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783074026.458990:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.458993:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:0.0:1783074026.459002:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.459004:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:3.0:1783074026.461401:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074026.461481:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020736 00000100:00100000:1.0:1783074026.461488:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020736 00000100:00100000:1.0:1783074026.461541:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 722 00000100:00100000:1.0:1783074026.461551:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708020736:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783074026.461708:0:66202:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9523c6409f80 x1869685708020736/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 224/0 e 0 to 0 dl 1783074037 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074026.461737:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708020736:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 Request processed in 184us (339us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074026.461746:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 722 00000020:00080000:0.0:1783074026.461801:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.461805:0:85102:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:0.0:1783074026.461808:0:85102:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783074026.461810:0:85102:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074026.461817:0:85102:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783074026.461819:0:85102:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783074026.461930:0:85102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:1.0:1783074026.463843:0:85071:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:1.0:1783074026.463851:0:85071:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1783074026.463913:0:85071:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000001:00080000:0.0:1783074026.463978:0:85102:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1783074026.464006:0:85102:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1783074026.464017:0:85102:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9524e41c1c00 x1869685723481344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:352/0 lens 224/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783074026.464110:0:85102:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.26@tcp: req@ffff9523c6409f80 x1869685708020736/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:352/0 lens 224/0 e 0 to 0 dl 1783074037 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1783074026.464155:0:85102:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:3.0:1783074026.464853:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464866:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464874:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464880:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074026.464885:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464904:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464923:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fb6f1700) 00010000:00010000:3.0:1783074026.464926:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074026.464930:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464936:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016de7f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464962:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464969:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464975:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464980:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074026.464982:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464988:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.464994:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9524fc2ff100) 00010000:00010000:3.0:1783074026.464997:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074026.465000:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.465011:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016de80c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074026.465708:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783074026.465719:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9524edc5c380 x1869685723481344/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074042 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074026.465729:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9524edc5c380 x1869685723481344/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074042 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074026.465737:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074026.465755:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783074026.465760:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524edc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723481344:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783074026.465983:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723481472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074026.466043:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.466114:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481472 00000100:00100000:2.0:1783074026.466121:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481472 00000100:00100000:2.0:1783074026.466163:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590 00000100:00100000:2.0:1783074026.466172:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c57edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723481472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783074026.466365:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:2.0:1783074026.466418:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c57edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723481472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 247us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074026.466424:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590 00000100:00100000:1.0:1783074026.466597:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723481472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074026.466672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.467048:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708019328 00000100:00100000:3.0:1783074026.467053:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708019328 00000100:00100000:3.0:1783074026.467108:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1042 00000100:00100000:3.0:1783074026.467115:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:65163:x1869685708019328:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074026.467124:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074026.467142:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016de828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af40 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.467195:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016de82f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.467209:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016de82f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.467231:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016de82f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074026.467277:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074026.467281:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074026.467303:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016de82f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.467344:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016de828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af40 expref: 8 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.467360:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016de82f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af40 expref: 7 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.467377:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:3.0:1783074026.467380:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074026.467383:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671800, rc 0) 00000100:00100000:3.0:1783074026.467428:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65163:x1869685708019328:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 314us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.467434:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1042 00000100:00100000:2.0:1783074026.472337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.472423:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020864 00000100:00100000:3.0:1783074026.472432:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020864 00000100:00100000:3.0:1783074026.472487:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1043 00000100:00100000:3.0:1783074026.472497:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65163:x1869685708020864:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074026.472526:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:3.0:1783074026.472595:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65163:x1869685708020864:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.472602:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1043 00000100:00100000:2.0:1783074026.475535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074026.475596:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708020992 00000100:00100000:1.0:1783074026.475604:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708020992 00000100:00100000:1.0:1783074026.475669:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1044 00000100:00100000:1.0:1783074026.475676:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:65163:x1869685708020992:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074026.475701:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074026.475747:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:65163:x1869685708020992:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074026.475752:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1044 00000100:00080000:3.0:1783074026.475789:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074026.477908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.481142:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021120 00000100:00100000:3.0:1783074026.481156:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021120 00000100:00100000:3.0:1783074026.481213:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4873 00000100:00100000:3.0:1783074026.481222:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1869685708021120:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:3.0:1783074026.481337:0:8444:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2865 last 0 00000020:00000080:3.0:1783074026.481449:0:8444:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016de836 00002000:00100000:3.0:1783074026.481462:0:8444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9524c86af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783074026.481474:0:8444:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783074026.481680:0:8444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783074026.481730:0:8444:0:(import.c:65:import_set_state_nolock()) ffff9524c86a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074026.481945:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708021120:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 722us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.481953:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4873 00000004:00000080:1.0:1783074026.482767:0:85102:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc84dfe10 00100000:10000000:1.0:1783074026.482777:0:85102:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000001:00100000:2.0:1783074026.483854:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:2.0:1783074026.483862:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:2.0:1783074026.483865:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524c356e000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:2.0:1783074026.483891:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074026.483937:0:36249:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c356e000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0000 00000020:00000080:3.0:1783074026.483995:0:36249:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c356a800 for lustre-OST0000 00000004:00080000:2.0:1783074026.484075:0:85090:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x4b0:0x0] 00000100:00100000:2.0:1783074026.484119:0:85090:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85090:1869685723481600:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783074026.484180:0:85090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.484218:0:85090:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30780 going to sleep for 11 seconds 00000100:00100000:2.0:1783074026.484238:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481600 00000100:00100000:2.0:1783074026.484244:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481600 00000100:00100000:2.0:1783074026.484292:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874 00000100:00100000:2.0:1783074026.484302:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:85090:x1869685723481600:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783074026.484352:0:8487:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -561 00002000:02000040:2.0:1783074026.484356:0:8487:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1201 to 0x2c0000401:1761) 00000004:00080000:3.0:1783074026.484806:0:85088:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:3.0:1783074026.484825:0:85088:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c640bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85088:1869685723481728:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783074026.484859:0:85088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074026.484897:0:85088:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074026.485052:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481728 00000100:00100000:1.0:1783074026.485058:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481728 00000100:00100000:1.0:1783074026.485088:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875 00000100:00100000:1.0:1783074026.485099:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:85088:x1869685723481728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783074026.485115:0:26178:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -63 00002000:02000040:1.0:1783074026.485118:0:26178:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1761) 00000100:00100000:0.0:1783074026.485404:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.485463:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021248 00000100:00100000:3.0:1783074026.485468:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021248 00000100:00100000:3.0:1783074026.485506:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1621 00000100:00100000:3.0:1783074026.485513:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65163:x1869685708021248:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074026.485526:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074026.485582:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65163:x1869685708021248:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.485590:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1621 00000100:00080000:3.0:1783074026.485620:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074026.488932:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.489271:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021376 00000100:00100000:3.0:1783074026.489280:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021376 00000100:00100000:3.0:1783074026.489342:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4876 00000100:00100000:3.0:1783074026.489350:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1869685708021376:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:3.0:1783074026.489385:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2865 last 0 00000020:00000080:3.0:1783074026.489415:0:8445:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016de83d 00002000:00100000:3.0:1783074026.489426:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9524fb6b3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783074026.489449:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783074026.489524:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783074026.489558:0:8445:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074026.489627:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708021376:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 276us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.489635:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4876 00000001:00100000:0.0:1783074026.491154:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:0.0:1783074026.491163:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:0.0:1783074026.491166:0:9524:0:(genops.c:906:class_export_put()) final put ffff9523c6a60000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:0.0:1783074026.491197:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074026.491232:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6a60000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0001 00000020:00000080:3.0:1783074026.491279:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6a62000 for lustre-OST0001 00002000:00010000:2.0:1783074026.493519:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.493531:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493548:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.493554:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.493561:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493578:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493589:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493597:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493631:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.493735:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.493753:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493761:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.493764:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.493768:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493777:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493784:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493789:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493811:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783074026.493849:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.493853:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493861:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.493864:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.493868:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493876:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493891:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493899:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493914:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783074026.493926:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074026.493931:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493938:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.493943:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493952:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493969:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493977:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016de844 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.493996:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074026.494004:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494012:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.494016:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494023:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494033:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494040:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016de84b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494050:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074026.494053:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494059:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.494062:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494068:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494086:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494093:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016de852 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494106:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494108:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494110:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074026.494150:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.494155:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494162:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.494165:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.494169:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494177:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494185:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494192:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.494203:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494215:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074026.494222:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074026.494226:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494233:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.494236:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494244:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494255:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494262:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016de859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494275:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494276:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494278:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074026.494366:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.494372:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494378:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.494385:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.494389:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494397:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494404:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494410:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494420:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074026.494425:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074026.494428:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494434:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.494437:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494443:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494451:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494466:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016de860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494479:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494480:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.494482:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074026.494516:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.494521:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494529:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.494532:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.494536:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494544:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494552:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494560:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.494573:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.494578:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.494583:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.494591:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.494594:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.494602:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.494604:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.494625:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.494633:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016de867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.494646:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.494653:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.494655:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.494669:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074026.495200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074026.495373:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021504 00000100:00100000:3.0:1783074026.495381:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021504 00000100:00100000:3.0:1783074026.495432:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1622 00000100:00100000:3.0:1783074026.495441:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65163:x1869685708021504:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074026.495466:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074026.495523:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65163:x1869685708021504:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074026.495531:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1622 00000100:00080000:0.0:1783074026.495563:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783074026.495781:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495792:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.495795:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.495801:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495812:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495821:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495828:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495848:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.495908:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.495912:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495922:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.495925:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.495929:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495938:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495953:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495961:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.495981:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783074026.496017:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.496022:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496029:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.496032:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.496036:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496044:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496051:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496058:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074026.496058:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496062:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496069:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.496073:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496080:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783074026.496082:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496087:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074026.496091:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496095:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496097:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.496101:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496103:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016de86e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496109:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496118:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496125:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000172277df/0x5fb609b3016de875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496129:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.496133:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496136:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.496137:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496139:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.496139:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496142:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496150:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496159:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496167:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b3eb0a/0x5fb609b3016de87c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.496172:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.496177:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496179:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496180:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496182:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.496184:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.496192:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.496196:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496205:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496213:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496221:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496239:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.496275:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.496280:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496286:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.496288:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.496292:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496299:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496333:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496346:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496399:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783074026.496551:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.496556:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496565:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.496574:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496583:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496594:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496601:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008bb55b0/0x5fb609b3016de88a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496626:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496628:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496629:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074026.496687:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.496692:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496700:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:3.0:1783074026.496703:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.496703:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074026.496707:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.496710:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496716:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.496723:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.496724:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.496726:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.496735:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496736:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.496746:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496748:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074026.496753:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab7c118/0x5fb609b3016de883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496755:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.496758:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496764:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.496767:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.496767:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.496768:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.496770:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496774:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496784:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.496791:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a2dc10/0x5fb609b3016de891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496792:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496804:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496805:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.496807:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074026.496836:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.496841:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496849:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.496851:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.496855:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496863:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496871:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496879:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496898:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.496932:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.496942:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496950:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.496953:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.496957:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496966:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496975:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.496982:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497029:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783074026.497063:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.497068:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497077:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.497080:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.497083:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497092:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497105:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497113:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497136:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074026.497141:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497148:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.497151:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497159:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497175:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497182:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd579a06/0x5fb609b3016de898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497196:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074026.497199:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497206:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.497209:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497217:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497228:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497235:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018d9f405/0x5fb609b3016de89f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497247:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.497250:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497262:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.497266:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497274:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497284:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497292:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.497294:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.497296:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.497370:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.497466:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.497471:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92f1bdc/0x5fb609b3016de8a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.497522:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.497527:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497535:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.497539:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.497543:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497553:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497562:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497579:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497638:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.497677:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.497682:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497689:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.497691:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.497695:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497705:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497712:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497720:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497763:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074026.497768:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.497773:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.497775:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.497777:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497779:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.497785:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.497788:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497788:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.497796:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497799:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.497806:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497812:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000612f2668/0x5fb609b3016de8ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.497814:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.497816:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.497817:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.497825:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.497826:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.497828:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.497851:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.497855:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd31349/0x5fb609b3016de8b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.497900:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074026.497916:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.497921:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497929:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.497932:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.497936:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497945:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497952:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497960:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.497978:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.498012:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.498016:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498021:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.498023:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.498030:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498035:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498040:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498044:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498056:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074026.498075:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074026.498079:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498085:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:2.0:1783074026.498089:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.498089:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498094:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498097:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498100:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.498103:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.498107:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498108:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498116:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0dc95e3/0x5fb609b3016de8bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498117:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498125:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498129:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.498132:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498143:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498143:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.498146:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498153:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498155:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074026.498163:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498170:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f7e26f6/0x5fb609b3016de8c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.498189:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.498194:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498202:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.498205:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.498209:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498217:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498224:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498230:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498241:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783074026.498272:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.498277:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498290:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.498292:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.498296:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498297:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074026.498301:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498307:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.498333:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498341:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498351:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498363:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016de8c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498376:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.498379:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498386:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.498389:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498396:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.498396:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498406:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498413:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016de8d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.498425:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.498426:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.498428:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.498433:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.498436:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.498465:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498474:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498481:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498566:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.498605:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.498623:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498631:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.498634:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.498638:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498646:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498666:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.498674:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498729:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074026.498733:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498740:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.498743:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498751:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498795:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498802:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016de8d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498814:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.498817:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498822:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.498825:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498832:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498838:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.498844:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.498846:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.498847:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.498992:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.498997:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016de8de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.499041:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.499046:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499052:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.499055:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.499058:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499066:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499073:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499088:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499110:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.499121:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499127:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.499130:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499137:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499147:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499153:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.499155:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.499156:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.499206:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.499210:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016de8e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.499261:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.499266:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499274:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.499277:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.499280:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499289:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499296:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499390:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499436:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.499440:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499446:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.499449:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499456:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499465:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499477:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.499478:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.499480:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.499524:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.499529:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822b6cb/0x5fb609b3016de8ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.499570:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.499574:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499581:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.499584:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.499587:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499595:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499601:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499618:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499642:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.499646:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499653:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.499655:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499662:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499672:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.499679:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.499681:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.499682:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.499736:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.499741:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009926c121/0x5fb609b3016de8f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.499794:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.499798:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499806:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.499809:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.499813:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499821:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499829:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.499836:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.499863:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.499868:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.499884:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.499887:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.499893:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.499903:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.499909:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.499911:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.499912:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.499963:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.499967:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000815c28fc/0x5fb609b3016de8fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.500009:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.500014:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500035:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.500037:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.500041:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500048:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500055:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500061:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500088:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.500092:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500097:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.500100:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500113:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500123:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500130:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500132:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500134:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.500189:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.500194:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016de901 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.500242:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.500247:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500254:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.500257:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.500261:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500276:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500285:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500292:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500423:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.500426:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500431:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.500433:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500438:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500445:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500449:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500450:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500451:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.500509:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074026.500513:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c823d5cb/0x5fb609b3016de908 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074026.500548:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.500551:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500556:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.500558:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.500560:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500566:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500578:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500582:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500603:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.500606:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500622:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.500625:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500636:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500644:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074026.500647:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500654:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016de90f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500667:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500669:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500670:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074026.500680:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.500685:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500692:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.500694:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074026.500698:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.500698:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500707:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500715:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500723:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500748:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074026.500783:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.500788:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500796:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.500799:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.500802:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500812:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500819:0:8487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500826:0:8487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500829:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.500833:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500840:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.500843:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.500847:0:8487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074026.500861:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500871:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500878:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9753411/0x5fb609b3016de916 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500889:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.500892:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500899:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.500902:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500909:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500918:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500925:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003824507b/0x5fb609b3016de91d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.500946:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500948:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.500950:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.500980:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074026.502935:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.502947:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.502965:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.502970:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.502977:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503008:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503021:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503031:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503059:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074026.503158:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.503164:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503173:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.503177:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.503182:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503191:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503200:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503220:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.503244:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783074026.503297:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.503382:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074026.503390:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503399:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.503404:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503413:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503440:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503446:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f897c7e5/0x5fb609b3016de924 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503464:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.503468:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503475:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.503478:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503486:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503496:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503503:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebd52af/0x5fb609b3016de92b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.503513:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.503514:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.503521:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.503719:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.504057:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504066:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.504069:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.504074:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504083:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504091:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504099:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504120:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074026.504171:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.504177:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504191:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.504194:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.504198:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504207:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504215:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504222:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504235:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074026.504372:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074026.504378:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504386:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.504390:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504398:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504411:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504420:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b8d57c0/0x5fb609b3016de932 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504437:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.504441:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504447:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.504458:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504467:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504480:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504488:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016de939 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.504503:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.504505:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.504508:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074026.504650:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.504657:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504666:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.504670:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.504674:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504685:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504706:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504714:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504733:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074026.504787:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.504793:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504802:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.504806:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.504810:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504819:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504827:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504835:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504859:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783074026.504914:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.504920:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504929:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.504932:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.504936:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504945:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504951:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504958:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.504970:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783074026.505028:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.505033:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505041:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.505050:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.505055:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505065:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505073:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505080:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505089:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783074026.505130:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.505135:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505143:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.505146:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.505149:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505157:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505166:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505178:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505185:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783074026.505223:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.505227:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505234:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.505237:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.505241:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505249:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505257:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505266:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505282:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783074026.505301:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783074026.505307:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505335:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.505338:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505347:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505359:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505374:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ce7cdc4/0x5fb609b3016de940 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505389:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783074026.505392:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505398:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.505401:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505409:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505419:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505427:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016de947 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505438:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783074026.505441:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505447:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.505455:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505464:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505474:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505480:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016de94e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505493:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074026.505496:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505502:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.505505:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505513:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505522:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505529:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfb9beb/0x5fb609b3016de955 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505547:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074026.505551:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.505553:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.505562:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505562:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.505568:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.505578:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.505583:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.505584:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.505605:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505617:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.505629:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505630:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016de95c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.505649:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006187a3f/0x5fb609b3016de963 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.505656:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.505660:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.505663:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.505667:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.505671:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.505672:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.505677:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.505679:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074026.505803:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.505809:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505822:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.505825:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.505828:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505836:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505843:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505849:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505862:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074026.505902:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.505907:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505914:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.505917:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.505921:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505929:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505950:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.505959:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506274:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074026.506275:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074026.506278:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.506280:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506284:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506297:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.506302:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506331:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.506338:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506355:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.506356:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.506360:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506372:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506372:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506376:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506385:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.506386:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb01159d/0x5fb609b3016de96a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506393:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074026.506395:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016de971 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506398:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506402:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.506404:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.506406:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.506419:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.506422:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.506423:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.506426:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506435:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506441:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506460:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.506472:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.506476:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506482:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.506484:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.506488:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.506490:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506493:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506505:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:3.0:1783074026.506506:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506508:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.506515:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506526:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506544:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506547:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a085cf2a/0x5fb609b3016de978 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506551:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506573:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.506575:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.506579:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506587:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.506591:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506595:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.506602:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.506618:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.506627:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506634:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.506641:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.506644:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506650:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506655:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506659:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506669:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074026.506685:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.506689:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506696:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.506700:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.506703:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.506707:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506715:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.506717:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.506717:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506721:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506727:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506729:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506736:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506748:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506760:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074026.506795:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.506801:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506802:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506812:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3940f16/0x5fb609b3016de986 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506822:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:3.0:1783074026.506827:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002baabf1e/0x5fb609b3016de97f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506827:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.506833:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506833:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.506838:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506847:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bda00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074026.506849:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506851:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506853:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.506858:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.506861:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506861:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.506862:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.506869:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.506871:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506888:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074026.506921:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.506926:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506938:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.506941:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.506941:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506945:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506948:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016de98d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506955:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506963:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506970:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506970:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.506973:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.506980:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074026.506980:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.506983:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506990:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.506999:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507006:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016de994 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.507012:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074026.507016:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507017:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074026.507020:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507023:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.507027:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.507027:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.507030:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507031:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507040:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507049:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507052:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.507058:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507059:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507065:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.507069:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507071:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2d48aa/0x5fb609b3016de99b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507082:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074026.507084:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074026.507085:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507091:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.507092:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.507095:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507104:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507112:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.507117:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.507120:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016de9a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507122:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507129:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.507132:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074026.507136:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507143:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.507144:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.507145:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507146:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.507152:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507159:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507217:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.507219:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.507224:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507234:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bcc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.507238:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074026.507246:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.507247:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507253:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507268:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.507270:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074026.507272:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507274:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507292:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016de9a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.507294:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507348:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.507351:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507352:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.507355:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.507363:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507397:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.507414:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.507419:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507426:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.507430:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.507441:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.507444:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507449:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507459:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507460:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.507468:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074026.507474:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016de9b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507476:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507495:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507498:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.507501:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.507505:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.507505:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507515:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507528:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.507536:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.507541:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507549:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.507553:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507561:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.507568:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074026.507572:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507574:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507588:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.507595:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074026.507604:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016de9b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507604:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507637:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507641:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.507644:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.507647:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.507647:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507657:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507676:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783074026.507722:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.507727:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507736:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.507741:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507747:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.507750:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507757:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507767:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507773:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016de9be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507798:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.507802:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.507806:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.507812:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074026.507813:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.507818:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507830:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507851:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507860:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507916:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.507934:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.507940:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507948:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.507951:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.507952:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.507960:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507967:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507969:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.507975:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.507982:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.507989:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.507991:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508010:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016de9c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508018:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508028:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.508028:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508032:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.508036:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.508062:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074026.508069:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.508074:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508082:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.508085:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508106:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.508108:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.508118:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508124:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508126:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.508133:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.508142:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508143:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016de9cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508160:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508166:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508170:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.508171:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508174:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.508188:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074026.508209:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074026.508214:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.508222:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074026.508226:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.508228:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.508233:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508242:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:1.0:1783074026.508243:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508250:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.508253:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074026.508256:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508263:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.508266:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508277:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508284:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508372:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783074026.508430:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.508437:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508446:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.508449:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.508454:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508464:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508471:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.508486:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508515:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074026.508521:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508529:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.508533:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508541:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508554:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508574:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016de9da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508594:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074026.508599:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508615:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074026.508620:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508629:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508640:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074026.508649:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.508652:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074026.508654:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.508706:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074026.508712:0:26178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016de9e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783074026.508869:0:8487:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1200 00000100:00100000:2.0:1783074026.508949:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:85090:x1869685723481600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24646us (24767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074026.508959:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874 00000100:00100000:2.0:1783074026.509007:0:85090:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85090:1869685723481600:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783074026.509027:0:85090:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x4b0:0x0] 00000100:00100000:2.0:1783074026.509088:0:85090:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85090:1869685723481984:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783074026.509119:0:85090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.509139:0:85090:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074026.509152:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723481856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074026.509172:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.509203:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481856 00000100:00100000:2.0:1783074026.509208:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481856 00000100:00100000:2.0:1783074026.509240:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:2.0:1783074026.509247:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723481856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074026.509266:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1783074026.509288:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074026.509294:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723481856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074026.509301:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:2.0:1783074026.509350:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723481856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074026.509355:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723481984 00000100:00100000:3.0:1783074026.509361:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723481984 00010000:00010000:1.0:1783074026.509385:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016de9d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074026.509403:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4877 00010000:00010000:1.0:1783074026.509407:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.509410:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074026.509414:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074026.509415:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:85090:x1869685723481984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783074026.509446:0:8487:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00002000:00010000:0.0:1783074026.509730:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.509802:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509814:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.509817:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.509823:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509834:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509843:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509850:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509887:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074026.509910:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074026.509917:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.509925:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.509927:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074026.509931:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.509933:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509943:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.509950:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074026.509953:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509953:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509973:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509983:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.509995:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510001:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510009:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074026.510011:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016de9e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510031:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074026.510032:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.510038:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.510044:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074026.510046:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.510051:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510053:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510069:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510071:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:2.0:1783074026.510081:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510084:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.510093:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510095:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016de9ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510115:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510123:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.510124:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510127:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.510132:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510137:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074026.510152:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074026.510160:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074026.510166:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510174:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.510177:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510185:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074026.510191:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074026.510197:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510204:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=2865s v=(0 0) 00010000:00010000:0.0:1783074026.510206:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074026.510210:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510218:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510225:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510237:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074026.510259:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074026.510260:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510270:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016de9f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510297:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074026.510302:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510435:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074026.510440:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510449:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510472:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510480:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016de9fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074026.510497:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.510499:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074026.510501:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783074026.510605:0:26178:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00000100:00100000:0.0:1783074026.510680:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:85088:x1869685723481728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25582us (25817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074026.510690:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875 00000100:00100000:2.0:1783074026.510715:0:85088:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c640bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85088:1869685723481728:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783074026.510730:0:85088:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x6a2:0x0] 00000100:00100000:2.0:1783074026.510812:0:85088:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85088:1869685723482240:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783074026.510825:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074026.510853:0:85088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074026.510885:0:85088:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074026.510899:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783074026.510909:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e7602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723482112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783074026.510921:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482240 00000100:00100000:1.0:1783074026.510927:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482240 00000100:00100000:2.0:1783074026.510940:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074026.510967:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878 00000100:00100000:2.0:1783074026.510971:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482112 00000100:00100000:2.0:1783074026.510976:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482112 00000100:00100000:1.0:1783074026.510977:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:85088:x1869685723482240:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783074026.510998:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1783074026.511006:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723482112:12345-0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1783074026.511009:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00002000:00000024:2.0:1783074026.511016:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074026.511042:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723482112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074026.511055:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1783074026.511082:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e7602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723482112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074026.512855:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:85090:x1869685723481984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3440us (3730us total) trans 4294968707 rc 0/0 00000100:00100000:2.0:1783074026.512863:0:85090:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85090:1869685723481984:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783074026.512869:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4877 00000004:00080000:2.0:1783074026.512878:0:85090:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00000100:00100000:1.0:1783074026.513105:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:85088:x1869685723482240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2130us (2251us total) trans 4294968712 rc 0/0 00000100:00100000:1.0:1783074026.513111:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878 00000100:00100000:2.0:1783074026.513149:0:85088:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85088:1869685723482240:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783074026.513157:0:85088:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00000001:00100000:3.0:1783074026.928400:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783074027.118516:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074028.142419:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074029.040086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074029.040124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074029.040147:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074029.040169:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074029.040213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074029.040242:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022016 00000100:00100000:0.0:1783074029.040252:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022016 00000100:00100000:0.0:1783074029.040298:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022144 00000100:00100000:0.0:1783074029.040300:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022144 00000100:00100000:0.0:1783074029.040341:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2057 00000100:00100000:0.0:1783074029.040349:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708022016:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074029.040414:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708022016:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074029.040421:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2057 00000100:00100000:0.0:1783074029.040440:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2058 00000100:00100000:0.0:1783074029.040448:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708022144:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074029.040476:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708022144:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074029.040480:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2058 00000100:00080000:0.0:1783074029.040495:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074029.040498:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074029.040557:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021760 00000100:00100000:2.0:1783074029.040572:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021760 00000100:00100000:2.0:1783074029.040611:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021888 00000100:00100000:2.0:1783074029.040615:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021888 00000100:00100000:1.0:1783074029.040627:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708021632 00000100:00100000:1.0:1783074029.040633:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708021632 00000100:00100000:2.0:1783074029.040644:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 723 00000100:00100000:2.0:1783074029.040655:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708021760:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074029.040673:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:1.0:1783074029.040683:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708021632:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074029.040691:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708021760:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 38us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074029.040702:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 723 00000100:00100000:2.0:1783074029.040718:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 724 00000100:00100000:1.0:1783074029.040726:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708021632:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074029.040729:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708021888:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074029.040768:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708021888:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 43us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074029.040773:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 724 00000100:00100000:1.0:1783074029.040797:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00080000:2.0:1783074029.040864:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074029.040867:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783074029.167753:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783074029.186670:0:85651:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:0.0:1783074029.999471:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c640b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723482368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074029.999539:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074029.999589:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723482496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074029.999606:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482368 00000100:00100000:0.0:1783074029.999611:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074029.999615:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482368 00000100:00100000:0.0:1783074029.999646:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482496 00000100:00100000:0.0:1783074029.999649:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482496 00000100:00100000:1.0:1783074029.999719:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1783074029.999731:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723482368:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074029.999757:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00002000:00000024:1.0:1783074029.999761:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074029.999765:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723482496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074029.999779:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074029.999808:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723482368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074029.999809:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723482496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074029.999816:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00080000:3.0:1783074029.999845:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074029.999850:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074029.999863:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c640b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723482368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074029.999880:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723482496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074029.999883:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000001:02000400:2.0:1783074030.054709:0:85699:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1783074030.190572:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074031.214572:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074031.518633:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074031.518821:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022272 00000100:00100000:2.0:1783074031.518831:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022272 00000100:00080000:3.0:1783074031.518889:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074031.518907:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1045 00000100:00100000:2.0:1783074031.518917:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65634:x1869685708022272:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074031.518954:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:2.0:1783074031.519021:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65634:x1869685708022272:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 105us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074031.519028:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1045 00000100:00100000:2.0:1783074031.522745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074031.522919:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022400 00000100:00100000:0.0:1783074031.522928:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022400 00000100:00080000:3.0:1783074031.522985:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074031.523579:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1046 00000100:00100000:2.0:1783074031.523591:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:65634:x1869685708022400:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074031.523632:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074031.523703:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:65634:x1869685708022400:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 114us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074031.523711:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1046 00000100:00100000:0.0:1783074031.526405:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074031.526495:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022528 00000100:00100000:3.0:1783074031.526503:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022528 00000100:00100000:3.0:1783074031.526630:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1627 00000100:00100000:3.0:1783074031.526639:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65634:x1869685708022528:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074031.526664:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074031.526727:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65634:x1869685708022528:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074031.526733:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1627 00000100:00080000:2.0:1783074031.526782:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074031.529009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074031.529100:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022656 00000100:00100000:0.0:1783074031.529122:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022656 00000100:00100000:0.0:1783074031.529183:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1628 00000100:00100000:0.0:1783074031.529194:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65634:x1869685708022656:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074031.529214:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074031.529285:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:65634:x1869685708022656:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074031.529292:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1628 00000100:00080000:2.0:1783074031.529497:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074031.535020:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723482752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074031.535100:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074031.535142:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074031.535149:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723482880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074031.535175:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074031.535214:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723482624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074031.535239:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.535301:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482880 00000100:00100000:0.0:1783074031.535672:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074031.535680:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c640b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723483008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074031.535706:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.535723:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482880 00000100:00100000:1.0:1783074031.535768:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483008 00000100:00100000:1.0:1783074031.535772:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483008 00000100:00100000:1.0:1783074031.535800:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591 00000100:00100000:1.0:1783074031.535811:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723482880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074031.535835:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723483392:0@lo:400:kworker.0 00000004:00000024:1.0:1783074031.535838:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074031.535887:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.535900:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723482880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.535908:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591 00000100:00100000:2.0:1783074031.535914:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c6400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723483904:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.535927:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:1.0:1783074031.535934:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723483008:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074031.535946:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1783074031.535956:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444757504 avail 1298518016 00000100:00100000:2.0:1783074031.535969:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783074031.535978:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723483264:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.535994:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723483008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.536000:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:2.0:1783074031.536009:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.536033:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483392 00000100:00100000:1.0:1783074031.536037:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483392 00000100:00100000:2.0:1783074031.536044:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723483776:0@lo:400:kworker.0 00000100:00100000:2.0:1783074031.536074:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.536074:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483264 00000100:00100000:1.0:1783074031.536079:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483264 00000100:00100000:1.0:1783074031.536103:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1783074031.536109:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723483392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074031.536118:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1783074031.536129:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723483264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.536144:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723483392:12345-0@lo:400:kworker.0 Request processed in 35us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.536151:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1783074031.536170:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723483264:12345-0@lo:400:kworker.0 Request processed in 43us (161us total) trans 0 rc 0/0 00000100:00080000:1.0:1783074031.536171:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783074031.536177:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074031.536182:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1783074031.536209:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483904 00000100:00100000:2.0:1783074031.536212:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483904 00000100:00100000:2.0:1783074031.536247:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483776 00000100:00100000:2.0:1783074031.536250:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483776 00000100:00100000:1.0:1783074031.536730:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723483520:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.536761:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.536783:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723484032:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.536803:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.536820:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783074031.536826:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723483136:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.536962:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.536990:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723483648:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537012:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.537028:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723484160:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537050:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074031.537073:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483520 00000100:00100000:1.0:1783074031.537076:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483520 00000100:00100000:1.0:1783074031.537104:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484032 00000100:00100000:1.0:1783074031.537105:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484032 00000100:00100000:1.0:1783074031.537112:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483648 00000100:00100000:1.0:1783074031.537113:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483648 00000100:00100000:1.0:1783074031.537120:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484160 00000100:00100000:1.0:1783074031.537121:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484160 00000100:00100000:1.0:1783074031.537128:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1783074031.537132:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723483520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537221:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723483520:12345-0@lo:400:kworker.0 Request processed in 87us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.537226:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1783074031.537235:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1783074031.537239:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723484032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537255:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723484032:12345-0@lo:400:kworker.0 Request processed in 17us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.537259:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1783074031.537267:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1783074031.537273:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723483648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537297:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723483648:12345-0@lo:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.537303:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1783074031.537330:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1783074031.537337:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723484160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537363:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723484160:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.537369:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00080000:1.0:1783074031.537384:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074031.537393:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783074031.537396:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074031.537398:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074031.537430:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1783074031.537440:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723483904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074031.537474:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723483904:12345-0@lo:400:kworker.0 Request processed in 37us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074031.537480:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1783074031.537492:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1783074031.537499:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723483776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537539:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c640b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723483008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074031.537546:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723483776:12345-0@lo:400:kworker.0 Request processed in 47us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074031.537554:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:1.0:1783074031.537580:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723482880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074031.537616:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723483648:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537626:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723484160:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537635:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723483520:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537643:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723484032:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537688:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723483264:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537694:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723483776:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537700:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723483392:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.537706:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c6400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723483904:0@lo:400:kworker.0 00000100:00100000:0.0:1783074031.537760:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482752 00000100:00100000:0.0:1783074031.537763:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482752 00000100:00100000:0.0:1783074031.537792:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723482624 00000100:00100000:0.0:1783074031.537794:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723482624 00000100:00100000:0.0:1783074031.537806:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:0.0:1783074031.537810:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723482752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783074031.537821:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074031.537942:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723482752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074031.537955:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:0.0:1783074031.537969:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1783074031.537976:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723482624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074031.537985:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074031.538015:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723482624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074031.538019:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1783074031.538125:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723482752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783074031.538179:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074031.538182:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074031.538229:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723482624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074031.538340:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723483136 00000100:00100000:3.0:1783074031.538346:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723483136 00000100:00100000:3.0:1783074031.538377:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783074031.538383:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723483136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074031.538443:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723483136:12345-0@lo:400:kworker.0 Request processed in 60us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074031.538451:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783074031.538672:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723483136:0@lo:400:kworker.0 00000100:00100000:1.0:1783074031.558023:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074031.558212:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708022912 00000100:00100000:2.0:1783074031.558223:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708022912 00000100:00100000:2.0:1783074031.558289:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1047 00000100:00100000:2.0:1783074031.558300:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65650:x1869685708022912:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074031.558345:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074031.558383:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016dea04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af63 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558458:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558472:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558485:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558500:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558507:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558524:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558602:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558607:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558610:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558614:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558618:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074031.558626:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558631:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558640:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:2.0:1783074031.558643:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074031.558646:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558650:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016dea0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558661:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558664:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558667:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558670:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074031.558672:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558675:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558678:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9523c8d7cf00) 00010000:00010000:2.0:1783074031.558680:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074031.558685:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558688:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016dea12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558714:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016dea04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af63 expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558720:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:2.0:1783074031.558721:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074031.558724:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016dea04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af63 expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074031.558729:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868800, rc 0) 00000100:00100000:2.0:1783074031.558781:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65650:x1869685708022912:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 485us (930us total) trans 0 rc 301/301 00000100:00100000:2.0:1783074031.558786:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1047 00000100:00100000:3.0:1783074031.563154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074031.563244:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023040 00000100:00100000:1.0:1783074031.563254:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023040 00000100:00100000:1.0:1783074031.563346:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1048 00000100:00100000:1.0:1783074031.563356:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65650:x1869685708023040:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1783074031.563433:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563475:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563490:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563506:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563525:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563534:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563616:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563624:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563631:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074031.563674:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074031.563687:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563701:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563708:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563721:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563729:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563735:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074031.563739:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563746:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563758:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:1.0:1783074031.563761:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074031.563765:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.563772:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016dea19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564282:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564289:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564295:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564299:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074031.564360:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564368:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564378:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9524d31aca00) 00010000:00010000:1.0:1783074031.564381:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074031.564385:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564390:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016dea20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564404:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564408:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564412:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564415:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074031.564416:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564420:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564426:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9524d31ac100) 00010000:00010000:1.0:1783074031.564428:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074031.564438:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074031.564444:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016dea27 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074031.564544:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:65650:x1869685708023040:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1188us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074031.564554:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1048 00010000:00010000:2.0:1783074032.238717:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783074032.564538:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968712 is committed 00000001:00080000:0.0:1783074032.565524:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968707 is committed 00010000:00010000:0.0:1783074033.262610:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074034.159717:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.159780:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.159818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.159872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.159901:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.159936:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023552 00000100:00100000:1.0:1783074034.159936:0:85077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023168 00000100:00100000:3.0:1783074034.159947:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023552 00000100:00100000:1.0:1783074034.159948:0:85077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023168 00000100:00100000:0.0:1783074034.159977:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023680 00000100:00100000:0.0:1783074034.159984:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023680 00000100:00100000:1.0:1783074034.160009:0:85077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:3.0:1783074034.160014:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2061 00000100:00100000:1.0:1783074034.160024:0:85077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708023168:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074034.160030:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708023552:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074034.160031:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2062 00000100:00100000:0.0:1783074034.160046:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c640b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708023680:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074034.160098:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708023552:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074034.160106:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2061 00000100:00100000:1.0:1783074034.160367:0:85077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708023168:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 346us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074034.160369:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c640b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708023680:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 326us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074034.160384:0:85077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:0.0:1783074034.160385:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2062 00000100:00080000:0.0:1783074034.160417:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074034.160421:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074034.160554:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023296 00000100:00100000:0.0:1783074034.160558:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023296 00000100:00100000:2.0:1783074034.160567:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023424 00000100:00100000:2.0:1783074034.160573:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023424 00000100:00100000:0.0:1783074034.160610:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 731 00000100:00100000:0.0:1783074034.160616:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2404:x1869685708023296:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1783074034.160636:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074034.160641:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074034.160650:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2404:x1869685708023296:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074034.160667:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 731 00000100:00100000:0.0:1783074034.160681:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 732 00000100:00100000:0.0:1783074034.160687:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c640aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708023424:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074034.160713:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c640aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708023424:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 27us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074034.160720:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 732 00010000:00010000:1.0:1783074034.286515:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783074034.849253:0:85893:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 06:20:33 (1783074033) 00000100:00100000:2.0:1783074034.900422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.900533:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708023808 00000100:00100000:3.0:1783074034.900542:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708023808 00000100:00100000:3.0:1783074034.900597:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1049 00000100:00100000:3.0:1783074034.900607:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:66234:x1869685708023808:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074034.900626:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074034.900646:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016dea2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af6a expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900709:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900723:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900735:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900750:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900768:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900776:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900821:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900828:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900834:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900841:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900846:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074034.900850:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900857:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900868:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:3.0:1783074034.900871:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074034.900875:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900882:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900900:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900906:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900913:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900918:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074034.900921:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900927:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900934:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9524e3aa5f00) 00010000:00010000:3.0:1783074034.900937:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074034.900940:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900945:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900974:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016dea2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af6a expref: 8 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.900985:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:3.0:1783074034.900987:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074034.900996:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016dea2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af6a expref: 8 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.901005:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00000100:00100000:3.0:1783074034.901061:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:66234:x1869685708023808:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 454us (645us total) trans 0 rc 301/301 00000100:00100000:3.0:1783074034.901070:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1049 00000100:00100000:1.0:1783074034.910541:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074034.913198:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708024064 00000100:00100000:0.0:1783074034.913209:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708024064 00000100:00100000:0.0:1783074034.913268:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1050 00000100:00100000:0.0:1783074034.913277:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:66234:x1869685708024064:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:0.0:1783074034.913350:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074034.913375:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016de82f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af40 expref: 7 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.913391:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5c00) 00010000:00010000:0.0:1783074034.913402:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074034.913471:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.913483:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.913492:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.913501:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.913517:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.913523:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915720:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915739:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915748:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074034.915765:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0e4db61 reply state 000000003b593dfe transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915775:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915782:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:0.0:1783074034.915785:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074034.915788:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783074034.915793:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783074034.915800:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915805:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915811:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915823:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915828:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074034.915832:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915841:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915851:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3100) 00010000:00010000:0.0:1783074034.915854:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074034.915857:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915864:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074034.915880:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0e4db61 reply state 000000003b593dfe transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915888:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.915893:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9524d30b3500) 00010000:00010000:0.0:1783074034.915895:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074034.915897:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783074034.916027:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:66234:x1869685708024064:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 2748us (5491us total) trans 103079215105 rc 0/0 00000100:00100000:0.0:1783074034.916037:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1050 00000100:00100000:0.0:1783074034.929038:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.929128:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708024192 00000100:00100000:3.0:1783074034.929137:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708024192 00000100:00100000:3.0:1783074034.929302:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1051 00000100:00100000:3.0:1783074034.929334:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:66238:x1869685708024192:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074034.929361:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074034.929384:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016dea58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af71 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.929466:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.929480:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.929493:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074034.929542:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074034.929546:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074034.929563:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.929588:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016dea58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af71 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.929611:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af71 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.929620:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5f00) 00010000:00010000:3.0:1783074034.929623:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074034.929627:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670800, rc 0) 00000100:00100000:3.0:1783074034.929686:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:66238:x1869685708024192:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 375us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074034.929694:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1051 00000100:00100000:3.0:1783074034.934574:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074034.934622:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708024320 00000100:00100000:3.0:1783074034.934630:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708024320 00000100:00100000:3.0:1783074034.934688:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1052 00000100:00100000:3.0:1783074034.934698:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:66238:x1869685708024320:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074034.934718:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074034.934737:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af78 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934801:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934815:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934825:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934901:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934910:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934917:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.934992:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016dea7b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935002:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016dea7b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935008:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016dea7b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074034.935120:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783074034.935124:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074034.935147:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016dea7b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935160:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935166:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935172:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935188:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935194:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074034.935199:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935206:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935218:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5f00) 00010000:00010000:3.0:1783074034.935222:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074034.935227:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935233:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016dea6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935246:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935252:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935355:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935361:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074034.935365:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935382:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935392:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9524d30b3500) 00010000:00010000:3.0:1783074034.935394:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074034.935397:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935403:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935432:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af78 expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935446:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016dea7b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af78 expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074034.935465:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:3.0:1783074034.935467:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074034.935470:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671800, rc 0) 00000100:00100000:3.0:1783074034.935530:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:66238:x1869685708024320:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 833us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074034.935537:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1052 00000100:00100000:3.0:1783074034.940852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074034.940902:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708024576 00000100:00100000:0.0:1783074034.940913:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708024576 00000100:00100000:0.0:1783074034.940971:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1053 00000100:00100000:0.0:1783074034.940980:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:66238:x1869685708024576:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074034.940999:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074034.941018:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af7f expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074034.941114:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783074034.941208:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af7f expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.941223:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5f00) 00010000:00010000:0.0:1783074034.941226:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074034.941231:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016dea82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af7f expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074034.941242:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144600, rc 0) 00000100:00100000:0.0:1783074034.941299:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:66238:x1869685708024576:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 320us (454us total) trans 103079215106 rc 301/301 00000100:00100000:0.0:1783074034.941307:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1053 00000100:00100000:0.0:1783074034.943174:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074034.943270:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708024832 00000100:00100000:1.0:1783074034.943277:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708024832 00000100:00100000:1.0:1783074034.943348:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1054 00000100:00100000:1.0:1783074034.943357:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:66238:x1869685708024832:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:1.0:1783074034.943399:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074034.943420:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016dea7b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af78 expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074034.943461:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:1.0:1783074034.943465:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074034.943484:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074034.943497:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074034.943506:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074034.943640:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095f24c8a reply state 000000004d57e460 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074034.943654:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074034.943661:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:1.0:1783074034.943663:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1783074034.943666:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783074034.943672:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:1.0:1783074034.943743:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:66238:x1869685708024832:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 387us (572us total) trans 103079215107 rc 0/0 00000100:00100000:1.0:1783074034.943750:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1054 00000100:00100000:2.0:1783074034.945466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074034.945527:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025088 00000100:00100000:0.0:1783074034.945533:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025088 00000100:00100000:0.0:1783074034.945573:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:0.0:1783074034.945581:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:66238:x1869685708025088:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1783074034.945756:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:66238:x1869685708025088:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 174us (305us total) trans 103079215108 rc 0/0 00000100:00100000:0.0:1783074034.945764:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:2.0:1783074035.118679:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074035.118771:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074035.118793:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723484416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074035.118811:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723484288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074035.120128:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074035.120189:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484288 00000100:00100000:1.0:1783074035.120198:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484288 00000100:00100000:1.0:1783074035.120256:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1783074035.120268:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723484288:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783074035.120274:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1783074035.120296:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074035.120379:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723484288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074035.120387:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:2.0:1783074035.120501:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723484288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074035.122585:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074035.122615:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484416 00000100:00100000:1.0:1783074035.122623:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484416 00000100:00100000:1.0:1783074035.122692:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1783074035.122702:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723484416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074035.122738:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074035.122802:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723484416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074035.122810:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00080000:2.0:1783074035.122875:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074035.122902:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723484416:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783074035.311439:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783074035.400768:0:85071:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:0.0:1783074035.401064:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401077:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401085:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401091:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074035.401096:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401105:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401121:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9524d30b3500) 00010000:00010000:0.0:1783074035.401125:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074035.401143:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401162:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016dea4a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401182:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401188:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401194:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401199:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074035.401202:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401209:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401217:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:0.0:1783074035.401219:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074035.401222:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401227:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016dea51 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401238:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401242:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401250:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401254:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074035.401255:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401259:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401264:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:0.0:1783074035.401265:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074035.401267:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.401270:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016dea90 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074035.430999:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074035.431169:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025216 00000100:00100000:0.0:1783074035.431178:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025216 00000100:00100000:0.0:1783074035.431238:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1055 00000100:00100000:0.0:1783074035.431248:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:66248:x1869685708025216:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074035.431285:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:0.0:1783074035.431370:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:66248:x1869685708025216:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074035.431379:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1055 00000100:00100000:2.0:1783074035.433125:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074035.433200:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025344 00000100:00100000:3.0:1783074035.433207:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025344 00000100:00100000:3.0:1783074035.433249:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1056 00000100:00100000:3.0:1783074035.433265:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66248:x1869685708025344:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074035.433295:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:3.0:1783074035.433380:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66248:x1869685708025344:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074035.433388:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1056 00000100:00100000:2.0:1783074035.435903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074035.435944:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025472 00000100:00100000:0.0:1783074035.435952:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025472 00000100:00100000:0.0:1783074035.436006:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1633 00000100:00100000:0.0:1783074035.436016:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:66248:x1869685708025472:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074035.436041:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074035.436112:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:66248:x1869685708025472:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074035.436121:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1633 00000100:00100000:0.0:1783074035.437617:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074035.437869:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025600 00000100:00100000:3.0:1783074035.437877:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025600 00000100:00100000:3.0:1783074035.437921:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1634 00000100:00100000:3.0:1783074035.437930:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:66248:x1869685708025600:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074035.437952:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074035.438022:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:66248:x1869685708025600:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 93us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074035.438031:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1634 00000100:00100000:2.0:1783074035.470736:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074035.470817:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025856 00000100:00100000:3.0:1783074035.470828:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025856 00000100:00100000:3.0:1783074035.470887:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1057 00000100:00100000:3.0:1783074035.470898:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:66255:x1869685708025856:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00010000:3.0:1783074035.470962:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074035.470991:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016dea5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af71 expref: 7 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471009:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524e3aa5f00) 00010000:00010000:3.0:1783074035.471019:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074035.471075:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471089:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471108:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471122:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471129:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471136:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471531:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471540:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471546:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471551:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074035.471556:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471563:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471571:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:3.0:1783074035.471574:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074035.471577:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471588:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016dea97 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074035.471601:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f991df2 reply state 0000000006c57015 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471613:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.471618:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524f44eeb00) 00010000:00010000:3.0:1783074035.471621:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074035.471623:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074035.471702:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:66255:x1869685708025856:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 805us (975us total) trans 103079215109 rc 0/0 00000100:00100000:3.0:1783074035.471710:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1057 00000100:00100000:1.0:1783074035.482638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074035.483605:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025984 00000100:00100000:0.0:1783074035.483615:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025984 00000100:00100000:0.0:1783074035.484093:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1058 00000100:00100000:0.0:1783074035.484105:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:66258:x1869685708025984:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:0.0:1783074035.484128:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074035.484155:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deaa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af86 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.484220:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deaac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.484234:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.484247:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074035.484292:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074035.484296:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074035.484329:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.484356:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deaa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af86 expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.484369:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deaac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af86 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074035.484375:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:0.0:1783074035.484377:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074035.484379:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145000, rc 0) 00000100:00100000:0.0:1783074035.484433:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:66258:x1869685708025984:12345-192.168.204.26@tcp:101:rm.0 Request processed in 332us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074035.484449:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1058 00000100:00100000:1.0:1783074035.487426:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074035.487506:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026112 00000100:00100000:3.0:1783074035.487515:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026112 00000100:00100000:3.0:1783074035.487571:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1059 00000100:00100000:3.0:1783074035.487581:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:66258:x1869685708026112:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074035.487596:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074035.487612:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016deab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af8d expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487669:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487682:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487703:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487716:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487723:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487730:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487803:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487812:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487820:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074035.487855:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783074035.487859:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074035.487879:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487891:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487900:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487918:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487924:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487931:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487938:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074035.487943:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487951:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487963:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:3.0:1783074035.487966:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074035.487971:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487977:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016deaba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487988:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.487995:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488000:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488012:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074035.488016:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488022:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488032:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524f44eeb00) 00010000:00010000:3.0:1783074035.488035:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074035.488038:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488045:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670400/0x5fb609b3016deac1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488072:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016deab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af8d expref: 11 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488085:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af8d expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.488093:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:3.0:1783074035.488096:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783074035.488098:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00000100:00100000:3.0:1783074035.488197:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:66258:x1869685708026112:12345-192.168.204.26@tcp:101:rm.0 Request processed in 617us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074035.488205:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1059 00000100:00100000:0.0:1783074035.492726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074035.492770:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026368 00000100:00100000:3.0:1783074035.492786:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026368 00000100:00100000:3.0:1783074035.492846:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1060 00000100:00100000:3.0:1783074035.492874:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:66258:x1869685708026368:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:3.0:1783074035.492937:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783074035.492964:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016deac8 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af8d expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.492982:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:3.0:1783074035.492997:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deaac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af86 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493008:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0c84600) 00010000:00010000:3.0:1783074035.493017:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074035.493039:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493051:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493061:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493073:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493081:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493087:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493171:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493179:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493185:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493384:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493393:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493401:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493409:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493415:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493421:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493451:0:66202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074035.493468:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493474:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493485:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493491:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074035.493495:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493502:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493511:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9524f44eed00) 00010000:00010000:3.0:1783074035.493514:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783074035.493518:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493524:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016deadd lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493540:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493546:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493551:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493557:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493562:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074035.493570:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493576:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493584:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f44eee00) 00010000:00010000:3.0:1783074035.493586:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074035.493589:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493595:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016deacf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074035.493608:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008cc5230 reply state 00000000fbe6f828 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493618:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493624:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524f44eeb00) 00010000:00010000:3.0:1783074035.493626:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074035.493628:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074035.493692:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:66258:x1869685708026368:12345-192.168.204.26@tcp:36:rm.0 Request processed in 836us (972us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1783074035.493699:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1060 00010000:00010000:3.0:1783074035.493783:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074035.493790:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493797:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074035.493800:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493814:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493823:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9524f44eed00) 00010000:00010000:3.0:1783074035.493826:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783074035.493829:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493834:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016deae4 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074035.493847:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074035.493849:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074035.493852:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074036.335522:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074036.654546:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723484800:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.654607:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723484672:0@lo:400:kworker.0 00000100:00100000:3.0:1783074036.654617:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074036.654671:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723484544:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.654679:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074036.654694:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723485312:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.654707:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723485184:0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.654708:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074036.654737:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723485056:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.654738:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074036.654744:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074036.654759:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723485696:0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.656852:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074036.656889:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074036.656893:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723485568:0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.656932:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074036.656946:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1869685723484928:0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.656970:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723486080:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.656998:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074036.657074:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723485824:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.657330:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723485440:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.657368:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074036.657391:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723485952:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.657457:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074036.657512:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484800 00000100:00100000:0.0:1783074036.657519:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484800 00000100:00100000:0.0:1783074036.657573:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484672 00000100:00100000:0.0:1783074036.657576:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484672 00000100:00100000:0.0:1783074036.657593:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485056 00000100:00100000:0.0:1783074036.657596:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485056 00000100:00100000:0.0:1783074036.657612:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485568 00000100:00100000:0.0:1783074036.657614:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485568 00000100:00100000:0.0:1783074036.657625:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484928 00000100:00100000:0.0:1783074036.657627:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484928 00000100:00100000:0.0:1783074036.657643:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1783074036.657652:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723484800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.657720:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723484800:12345-0@lo:400:kworker.0 Request processed in 69us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.657727:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1783074036.657757:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1783074036.657764:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869685723484672:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783074036.657777:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c8cd4e00 x1869685723484672/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:362/0 lens 224/224 e 0 to 0 dl 1783074047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074036.657812:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869685723484672:12345-0@lo:400:kworker.0 Request processed in 49us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.657818:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1783074036.657830:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1783074036.657836:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723485056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.657864:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723485056:12345-0@lo:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.657880:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1783074036.657892:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1783074036.657897:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723485568:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783074036.657908:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4bcd880 x1869685723485568/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:362/0 lens 224/224 e 0 to 0 dl 1783074047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074036.657936:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723485568:12345-0@lo:400:kworker.0 Request processed in 39us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.657941:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1783074036.657955:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1783074036.657962:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1869685723484928:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783074036.657973:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c3bf2a00 x1869685723484928/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:362/0 lens 224/224 e 0 to 0 dl 1783074047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074036.658009:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1869685723484928:12345-0@lo:400:kworker.0 Request processed in 47us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.658015:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1783074036.658041:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485184 00000100:00100000:0.0:1783074036.658044:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485184 00000100:00100000:0.0:1783074036.658071:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485696 00000100:00100000:0.0:1783074036.658074:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485696 00000100:00100000:0.0:1783074036.658092:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:0.0:1783074036.658099:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723485184:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783074036.658114:0:23954:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c8cd4000 x1869685723485184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:362/0 lens 224/224 e 0 to 0 dl 1783074047 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074036.658145:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723485184:12345-0@lo:400:kworker.0 Request processed in 47us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.658166:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:0.0:1783074036.658184:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1783074036.658191:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723485696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.658238:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723485696:12345-0@lo:400:kworker.0 Request processed in 48us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.658244:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1783074036.658329:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485312 00000100:00100000:0.0:1783074036.658334:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485312 00000100:00100000:0.0:1783074036.658365:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485440 00000100:00100000:0.0:1783074036.658368:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485440 00000100:00100000:0.0:1783074036.658392:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485952 00000100:00100000:0.0:1783074036.658395:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485952 00000100:00100000:0.0:1783074036.658439:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1783074036.658451:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723485312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.658488:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723485312:12345-0@lo:400:kworker.0 Request processed in 43us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.658496:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:2.0:1783074036.658514:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1783074036.658522:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1783074036.658527:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723485440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.658533:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723485952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074036.658581:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723485440:12345-0@lo:400:kworker.0 Request processed in 59us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074036.658586:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723485952:12345-0@lo:400:kworker.0 Request processed in 54us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074036.658594:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1783074036.658600:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1783074036.658621:0:85078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723484544 00000100:00100000:2.0:1783074036.658626:0:85078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723484544 00000100:00080000:0.0:1783074036.658629:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074036.658635:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783074036.658637:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074036.658661:0:85078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783074036.658670:0:85078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723484544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074036.658716:0:85078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723484544:12345-0@lo:400:kworker.0 Request processed in 45us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074036.658726:0:85078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783074036.658768:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1869685723484928:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.658794:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723485440:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.658803:0:3661:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968707 gen 2 00000100:00100000:0.0:1783074036.658817:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723485952:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.658841:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074036.658849:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723486336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074036.658876:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074036.658920:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486336 00000100:00100000:2.0:1783074036.658925:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486336 00000100:00100000:2.0:1783074036.658959:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:2.0:1783074036.658965:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723486336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783074036.658980:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783074036.659018:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074036.659024:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723486336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074036.659031:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1783074036.659036:0:3661:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968712 gen 2 00000100:00100000:0.0:1783074036.659057:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723486336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074036.659074:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723486208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074036.659097:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074036.659126:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723484672:0@lo:400:kworker.0 00000100:00100000:2.0:1783074036.659135:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486208 00000100:00100000:0.0:1783074036.659140:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723485184:0@lo:400:kworker.0 00000100:00100000:2.0:1783074036.659148:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486208 00000100:00100000:0.0:1783074036.659157:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723485696:0@lo:400:kworker.0 00000100:00100000:2.0:1783074036.659186:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1783074036.659264:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723486208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074036.659277:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074036.659368:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723486208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074036.659378:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723486208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074036.659385:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:3.0:1783074036.659507:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074036.659582:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723484800:0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.659594:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074036.659606:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723485312:0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.659636:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723484544:0@lo:400:kworker.0 00000100:00100000:3.0:1783074036.659653:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486080 00000100:00100000:1.0:1783074036.659654:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723485056:0@lo:400:kworker.0 00000100:00100000:3.0:1783074036.659659:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486080 00000100:00100000:1.0:1783074036.659670:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723485568:0@lo:400:kworker.0 00000100:00100000:3.0:1783074036.659691:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1783074036.659701:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723486080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074036.659719:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723485824 00000100:00100000:1.0:1783074036.659724:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723485824 00010000:00000080:3.0:1783074036.659726:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c2f45500 x1869685723486080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:362/0 lens 224/224 e 0 to 0 dl 1783074047 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074036.659753:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1783074036.659820:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723486464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074036.659850:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074036.659876:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486464 00000100:00100000:2.0:1783074036.659881:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486464 00000100:00100000:2.0:1783074036.659909:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:2.0:1783074036.659916:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723486464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783074036.659940:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00010000:00000080:2.0:1783074036.659953:0:23954:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c3bf3b80 x1869685723486464/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:362/0 lens 224/368 e 0 to 0 dl 1783074047 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074036.659979:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074036.659991:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723486592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074036.659995:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723486464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074036.660004:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1783074036.660023:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074036.660047:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486592 00000100:00100000:1.0:1783074036.660049:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723485824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074036.660051:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486592 00000100:00100000:0.0:1783074036.660073:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723486464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074036.660078:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:2.0:1783074036.660088:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723486592:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074036.660093:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723485824:12345-0@lo:400:kworker.0 Request processed in 334us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074036.660101:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000004:00000024:2.0:1783074036.660105:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074036.660145:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723486592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074036.660152:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:1.0:1783074036.660153:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723485824:0@lo:400:kworker.0 00000100:00100000:0.0:1783074036.660168:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723486592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074036.660411:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723486080:12345-0@lo:400:kworker.0 Request processed in 712us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074036.660429:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1783074036.660595:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723486080:0@lo:400:kworker.0 00010000:00010000:2.0:1783074037.358987:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074038.382784:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783074038.577992:0:86290:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1783074038.604292:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074038.604898:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026496 00000100:00100000:0.0:1783074038.604909:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026496 00000100:00100000:0.0:1783074038.605008:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1061 00000100:00100000:0.0:1783074038.605019:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:66325:x1869685708026496:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074038.605041:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074038.605062:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016deaeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af94 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.605123:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016deaf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.605137:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016deaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.605148:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016deaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074038.605185:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074038.605188:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074038.605228:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016deaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.605250:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016deaeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af94 expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.605264:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016deaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af94 expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.605282:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074038.605285:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074038.605288:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144600, rc 0) 00010000:00000080:0.0:1783074038.605295:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524faad7100 x1869685708026496/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:364/0 lens 576/688 e 0 to 0 dl 1783074049 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074038.605369:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:66325:x1869685708026496:12345-192.168.204.26@tcp:101:touch.0 Request processed in 352us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074038.605376:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1061 00000100:00080000:1.0:1783074038.605593:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074038.607958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074038.608078:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026624 00000100:00100000:2.0:1783074038.608086:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026624 00000100:00100000:2.0:1783074038.608236:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1062 00000100:00100000:2.0:1783074038.608246:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:66325:x1869685708026624:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:2.0:1783074038.608264:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074038.608281:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016deaf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263af9b expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608372:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608401:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608412:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608426:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608432:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608438:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608516:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016deb0e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608524:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016deb0e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608604:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016deb0e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074038.608644:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783074038.608648:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074038.608668:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016deb0e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608680:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608686:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608692:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608697:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074038.608700:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608706:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608719:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:2.0:1783074038.608722:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074038.608726:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608731:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deb00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608756:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608761:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608766:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608771:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074038.608773:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608778:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608786:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9524c6265a00) 00010000:00010000:2.0:1783074038.608788:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074038.608791:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608797:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016deb07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608826:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016deaf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af9b expref: 13 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608841:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016deb0e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af9b expref: 12 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.608860:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524c6265c00) 00010000:00010000:2.0:1783074038.608863:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783074038.608866:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869400, rc 0) 00010000:00000080:2.0:1783074038.608875:0:66201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c3bf3480 x1869685708026624/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:364/0 lens 592/688 e 0 to 0 dl 1783074049 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074038.609172:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:66325:x1869685708026624:12345-192.168.204.26@tcp:101:touch.0 Request processed in 927us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074038.609182:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1062 00000100:00100000:2.0:1783074038.611427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074038.611470:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026880 00000100:00100000:0.0:1783074038.611478:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026880 00000100:00100000:0.0:1783074038.611533:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1063 00000100:00100000:0.0:1783074038.611541:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:66325:x1869685708026880:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074038.611556:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074038.611570:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016deb15 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afa2 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.611648:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.611662:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.611672:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.611688:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.611702:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.611710:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612045:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612111:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612121:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074038.612219:0:66200:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783074038.612222:0:66200:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1783074037 00000004:00010000:0.0:1783074038.612224:0:66200:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1783074037 00000004:00010000:0.0:1783074038.612226:0:66200:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1783074037 00000004:00010000:0.0:1783074038.612227:0:66200:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1783074038.612230:0:66200:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1783074038.612234:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612239:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612243:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612247:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612257:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074038.612260:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612265:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612273:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524c6265c00) 00010000:00010000:0.0:1783074038.612275:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074038.612375:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612392:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016deb1c lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074038.612401:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fec4b39 reply state 0000000028032c74 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612409:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612413:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9524d30b3000) 00010000:00010000:0.0:1783074038.612415:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074038.612417:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074038.612438:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016deb15 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612448:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 14 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.612468:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:0.0:1783074038.612471:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1783074038.612473:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145a00, rc 0) 00010000:00000080:0.0:1783074038.612480:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4a02680 x1869685708026880/t103079215111(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:364/0 lens 752/824 e 0 to 0 dl 1783074049 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074038.612534:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:66325:x1869685708026880:12345-192.168.204.26@tcp:101:touch.0 Request processed in 995us (1113us total) trans 103079215111 rc 0/0 00000100:00100000:0.0:1783074038.612540:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1063 00000100:00100000:1.0:1783074038.614863:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074038.614910:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027136 00000100:00100000:0.0:1783074038.614919:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027136 00000100:00100000:0.0:1783074038.614972:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1064 00000100:00100000:0.0:1783074038.614982:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:66325:x1869685708027136:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074038.615073:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.615089:0:66202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.615098:0:66202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.615130:0:66202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.615155:0:66202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 15 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074038.615182:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66202:1869685723486720:192.168.204.26@tcp:104: 00000100:00100000:0.0:1783074038.615259:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c460f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074038.618019:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66202:1869685723486720:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074038.618043:0:66202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074038.618358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074038.618485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027264 00000100:00100000:2.0:1783074038.618492:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027264 00010000:00010000:2.0:1783074038.618528:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 16 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074038.618563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2572 00000100:00100000:2.0:1783074038.618574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+16:2404:x1869685708027264:12345-192.168.204.26@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1783074038.618591:0:6516:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 16 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.618605:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 16 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.618617:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 16 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.618640:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:2.0:1783074038.618644:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783074038.618647:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.618656:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.618663:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074038.618690:0:6516:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 16 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.618702:0:66202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.618709:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074038.618746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+16:2404:x1869685708027264:12345-192.168.204.26@tcp:102:ldlm_bl.0 Request processed in 173us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074038.618753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2572 00000004:00010000:0.0:1783074038.618802:0:66202:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783074038.618805:0:66202:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1783074037 -> 1783074037 00000004:00010000:0.0:1783074038.618807:0:66202:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1783074037 -> 1783074037 00000004:00010000:0.0:1783074038.618808:0:66202:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1783074037 -> 1783074037 00000004:00010000:0.0:1783074038.618810:0:66202:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1783074038.618815:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cd5110f reply state 000000002ea1ba13 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.618827:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074038.618834:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:0.0:1783074038.618837:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074038.618839:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783074038.618886:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524faad5c00 x1869685708027136/t103079215112(0) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:364/0 lens 488/456 e 0 to 0 dl 1783074049 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074038.618946:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+17:66325:x1869685708027136:12345-192.168.204.26@tcp:36:touch.0 Request processed in 3965us (4090us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1783074038.618953:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1064 00000100:00100000:3.0:1783074038.620615:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074038.620782:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027520 00000100:00100000:2.0:1783074038.620790:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027520 00000100:00100000:2.0:1783074038.620896:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:2.0:1783074038.620906:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+17:66325:x1869685708027520:12345-192.168.204.26@tcp:35:touch.0 00010000:00000080:2.0:1783074038.621069:0:66203:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c54a9500 x1869685708027520/t103079215113(0) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:364/0 lens 392/456 e 0 to 0 dl 1783074049 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074038.621163:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+18:66325:x1869685708027520:12345-192.168.204.26@tcp:35:touch.0 Request processed in 258us (557us total) trans 103079215113 rc 0/0 00000100:00100000:2.0:1783074038.621171:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:2.0:1783074039.280782:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074039.280805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074039.280824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074039.280854:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074039.280885:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074039.280912:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027776 00000100:00100000:2.0:1783074039.280921:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027776 00000100:00100000:2.0:1783074039.280966:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027904 00000100:00100000:2.0:1783074039.280970:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027904 00000100:00100000:2.0:1783074039.281016:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 739 00000100:00100000:2.0:1783074039.281026:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+18:2403:x1869685708027776:12345-192.168.204.26@tcp:400:kworker.0 00010000:00000080:2.0:1783074039.281058:0:66201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4a01880 x1869685708027776/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:365/0 lens 224/224 e 0 to 0 dl 1783074050 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074039.281122:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+18:2403:x1869685708027776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074039.281131:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 739 00000100:00100000:2.0:1783074039.281147:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 740 00000100:00100000:2.0:1783074039.281154:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708027904:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074039.281179:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708027904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074039.281185:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 740 00000100:00100000:2.0:1783074039.281205:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028032 00000100:00100000:2.0:1783074039.281208:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028032 00000100:00100000:2.0:1783074039.281233:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028160 00000100:00100000:2.0:1783074039.281236:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028160 00000100:00100000:2.0:1783074039.281257:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2067 00000100:00100000:2.0:1783074039.281264:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708028032:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074039.281297:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708028032:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074039.281303:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2067 00000100:00100000:2.0:1783074039.281340:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2068 00000100:00100000:2.0:1783074039.281347:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708028160:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074039.281379:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708028160:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074039.281386:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2068 00000100:00100000:2.0:1783074039.281403:0:85076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027648 00000100:00100000:2.0:1783074039.281406:0:85076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027648 00000100:00100000:2.0:1783074039.281429:0:85076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1783074039.281435:0:85076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708027648:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074039.281457:0:85076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708027648:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074039.281464:0:85076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00080000:2.0:1783074039.281494:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074039.281497:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074039.281500:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783074039.406618:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783074039.436658:0:86387:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783074039.436712:0:86387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.436726:0:86387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.436733:0:86387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.436739:0:86387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.437025:0:86387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074039.437029:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1783074039.437033:0:86387:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1783074039.437038:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.437048:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074039.437053:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.437063:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074039.437070:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074039.437077:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074039.437080:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783074039.437091:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783074039.437137:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783074039.437139:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783074039.437145:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1783074039.437146:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1783074039.437152:0:86387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783074039.437169:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524f7805000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783074039.437184:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.437193:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24e00/0x5fb609b3016de6b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6bc expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074039.437203:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783074039.437206:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074039.437209:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074039.437212:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074039.437222:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723486848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074039.437226:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723486976:0@lo:39:umount.0 00000100:00100000:3.0:1783074039.437458:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074039.437460:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074039.437666:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486848 00000100:00100000:1.0:1783074039.437673:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486848 00000100:00100000:1.0:1783074039.437721:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1783074039.437730:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723486848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074039.437742:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074039.437755:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671400/0x5fb609b3016de6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de6b5 expref: 24 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.437769:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074039.437808:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723486848:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074039.437816:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1783074039.437834:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723486848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074039.437907:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723486976 00000100:00100000:0.0:1783074039.437912:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723486976 00000100:00100000:0.0:1783074039.437948:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1783074039.437956:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723486976:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783074039.437976:0:66202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de7d4 00000100:00080000:0.0:1783074039.437988:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524f08db000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1783074039.438015:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b4000 x1869685723486976/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:365/0 lens 224/224 e 0 to 0 dl 1783074050 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783074039.438018:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074039.438053:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869685723486976:12345-0@lo:39:umount.0 Request processed in 99us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074039.438060:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00080000:1.0:1783074039.438066:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f7805000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1783074039.438068:0:66202:0:(genops.c:906:class_export_put()) final put ffff9524f08de800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1783074039.438079:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723486976:0@lo:39:umount.0 00000020:00000080:3.0:1783074039.438206:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f08de800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1783074039.438253:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:3.0:1783074039.438255:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f08db000 for lustre-MDT0000 00000100:00100000:2.0:1783074039.438257:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783074039.438261:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783074039.439157:0:86387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439168:0:86387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439186:0:86387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439191:0:86387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439207:0:86387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074039.439213:0:86387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439220:0:86387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439226:0:86387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439232:0:86387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439246:0:86387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074039.439247:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074039.439250:0:86387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439253:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439257:0:86387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439260:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24000 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:2.0:1783074039.439263:0:86387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074039.439264:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.439272:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074039.439274:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.439282:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439284:0:86387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.439304:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb360800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074039.439305:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074039.439329:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439329:0:86387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783074039.439347:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074039.439349:0:86387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.439350:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074039.439351:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783074039.439357:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074039.439362:0:86387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.439378:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074039.439383:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439387:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439390:0:86387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.439402:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb361800 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074039.439405:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1783074039.439409:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074039.439410:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074039.439410:0:86387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074039.439417:0:6517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783074039.439421:0:6517:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783074039.439426:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.439436:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439437:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24000/0x5fb609b3016de5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de5e3 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074039.439440:0:86387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074039.439443:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074039.439446:0:86387:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1783074039.439451:0:86387:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:1.0:1783074039.439459:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.439460:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074039.439462:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074039.439470:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074039.439472:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783074039.439474:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074039.439478:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:01000004:2.0:1783074039.439484:0:86387:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 10000000:01000000:1.0:1783074039.439484:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783074039.439488:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25c00 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:3.0:1783074039.439493:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb360800/0x5fb609b3016de6d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074039.439494:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.439507:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439514:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.439516:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1783074039.439526:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074039.439532:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074039.439537:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074039.439544:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1783074039.439548:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb361800/0x5fb609b3016de6a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de6ae expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074039.439549:0:8460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:01000000:2.0:1783074039.439554:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1783074039.439562:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1783074039.439564:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:2.0:1783074039.439567:0:86387:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1783074039.439568:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074039.439568:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439574:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074039.439580:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074039.439583:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439591:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25c00/0x5fb609b3016de5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016de5d5 expref: -99 pid: 85070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074039.439598:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723487104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074039.439609:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074039.439612:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074039.439615:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074039.439628:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723487232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074039.439646:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074039.439668:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074039.439676:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074039.439679:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074039.439689:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074039.439694:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723487360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074039.439725:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487104 00000100:00100000:1.0:1783074039.439731:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487104 00000100:00100000:3.0:1783074039.439732:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074039.439769:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487232 00000100:00100000:1.0:1783074039.439774:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487232 00000100:00100000:3.0:1783074039.439790:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074039.439794:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487360 00000100:00100000:3.0:1783074039.439799:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723487488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074039.439800:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487360 00000100:00100000:1.0:1783074039.439831:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1783074039.439836:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074039.439845:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3660:x1869685723487104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074039.439849:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487488 00000100:00100000:0.0:1783074039.439855:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487488 00010000:00010000:1.0:1783074039.439866:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074039.439881:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb360a00/0x5fb609b3016de5e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de5dc expref: 26 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074039.439882:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1783074039.439893:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1783074039.439897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3661:x1869685723487232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074039.439899:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074039.439907:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c5329850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3658:x1869685723487360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074039.439911:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074039.439918:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074039.439926:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b25200/0x5fb609b3016de6df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de6d8 expref: 25 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.439933:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298000/0x5fb609b3016de6ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de6a7 expref: 25 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.439939:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074039.439942:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723487104:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (293us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074039.439952:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074039.439968:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1783074039.439989:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3661:x1869685723487232:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074039.439990:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1783074039.440002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1783074039.440006:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c5329850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3658:x1869685723487360:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074039.440007:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3658:x1869685723487488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074039.440021:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00010000:00010000:1.0:1783074039.440023:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074039.440036:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb361600/0x5fb609b3016de5d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de5ce expref: 20 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074039.440045:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723487232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074039.440047:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074039.440082:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723487488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074039.440086:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3658:x1869685723487488:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074039.440095:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1783074039.440096:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723487360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074039.440168:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074039.440177:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723487104:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1783074039.441488:0:86387:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1783074039.441878:0:85071:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:3.0:1783074039.441910:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.441921:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.441939:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.441945:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074039.441949:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.441957:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.441973:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524f44eeb00) 00010000:00010000:3.0:1783074039.441975:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074039.441980:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.441987:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671e00/0x5fb609b3016dea9e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442003:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442009:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442015:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442020:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074039.442023:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442039:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442050:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524f44eeb00) 00000020:00000080:2.0:1783074039.442075:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783074039.442083:0:86387:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524d08ce000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074039.442088:0:86387:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c809e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074039.442092:0:86387:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524f7803000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074039.442101:0:86387:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524fb54c000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074039.442107:0:86387:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524fb548000 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 192.168.204.26@tcp 11 (0 0 3) 0 0 0 2: ffff9524c8fea000 103079215113 stale:0 00000020:00080000:2.0:1783074039.442111:0:86387:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9523c338cd40) has exports, disconnecting them 00000020:00080000:2.0:1783074039.442116:0:86387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524d08ce000), last request at 1783074026 00010000:00010000:3.0:1783074039.442123:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074039.442127:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442133:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016dead6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074039.442134:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de7cd 00000100:00080000:2.0:1783074039.442151:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524d08c8800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783074039.442158:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442167:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442173:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074039.442179:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524d08ce000): rc 0 00010000:00010000:3.0:1783074039.442181:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145000 already unused, calling callback (ffffffffc186d4f0) 00000020:00000080:2.0:1783074039.442184:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524d08ce000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1783074039.442186:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442195:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442203:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9524d30b3000) 00000020:00080000:2.0:1783074039.442206:0:86387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c809e800), last request at 1783074036 00010000:00010000:3.0:1783074039.442208:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00000080:2.0:1783074039.442213:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de7c6 00010000:00010000:3.0:1783074039.442214:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783074039.442219:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524c8099000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783074039.442230:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145000/0x5fb609b3016deb23 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074039.442232:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c809e800): rc 0 00000020:00000080:2.0:1783074039.442237:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524c809e800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1783074039.442244:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783074039.442247:0:86387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524f7803000), last request at 1783074036 00000020:00000080:2.0:1783074039.442253:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de7bf 00010000:00010000:3.0:1783074039.442258:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783074039.442260:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524c8098000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783074039.442270:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442277:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074039.442282:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524f7803000): rc 0 00010000:00010000:3.0:1783074039.442286:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145c00 already unused, calling callback (ffffffffc186d4f0) 00000020:00000080:2.0:1783074039.442287:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524f7803000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1783074039.442292:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074039.442295:0:86387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524fb54c000), last request at 1783074020 00010000:00010000:3.0:1783074039.442306:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074039.442341:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de629 00000100:00080000:2.0:1783074039.442361:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783074039.442376:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783074039.442449:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d08ce000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074039.442520:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c809e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074039.442554:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7803000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074039.442575:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d08c8800 for lustre-MDT0000 00000020:00000080:0.0:1783074039.442580:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c8099000 for lustre-MDT0000 00000020:00000080:0.0:1783074039.442583:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c8098000 for lustre-MDT0000 00010000:00010000:0.0:1783074039.442591:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783074039.442592:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524fb54c000): rc 0 00000020:00000080:2.0:1783074039.442596:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fb54c000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1783074039.442611:0:86387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.26@tcp (ffff9524fb548000), last request at 1783074039 00000020:00000080:2.0:1783074039.442615:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de622 00000020:00010000:2.0:1783074039.442623:0:86387:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524fb548000: total 1 00000020:00000080:0.0:1783074039.442625:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:2.0:1783074039.442627:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524c6020000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074039.442647:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524fb548000): rc 0 00000020:00000080:0.0:1783074039.442652:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d08cc000 for lustre-MDT0000 00000004:00000080:2.0:1783074039.442654:0:86387:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd3bc1527ae0 00000020:00010000:1.0:1783074039.442666:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524fb548000: total 0 00000100:00080000:2.0:1783074039.442673:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783074039.442677:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1783074039.442702:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524fb548000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1783074039.442753:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016deb0e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af9b expref: 5 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.442780:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144600/0x5fb609b3016deaf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af94 expref: 4 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.442800:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016deb2a lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 3 pid: 66200 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.442814:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524fb548000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1783074039.442860:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:3.0:1783074039.442864:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074039.442867:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442874:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016deb38 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074039.442896:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074039.444645:0:86387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783074039.444674:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9523c16e5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783074039.444735:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723487616:0@lo:39:umount.0 00000100:00100000:0.0:1783074039.444810:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074039.444860:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487616 00000100:00100000:3.0:1783074039.444870:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487616 00000100:00100000:3.0:1783074039.444925:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597 00000100:00100000:3.0:1783074039.444950:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723487616:12345-0@lo:39:umount.0 00000100:00080000:2.0:1783074039.444958:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783074039.444963:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968712 gen 3 00000004:00080000:2.0:1783074039.444977:0:86387:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1783074039.444979:0:23954:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de668 00000100:00080000:3.0:1783074039.444989:0:23954:0:(import.c:65:import_set_state_nolock()) ffff9523c316a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783074039.445024:0:23954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411438 00000100:00080000:2.0:1783074039.445044:0:86387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1783074039.445050:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074039.445058:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524c7838000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783074039.445075:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783074039.445077:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968707 gen 3 00000004:00080000:2.0:1783074039.445085:0:86387:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074039.445144:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723487744:0@lo:9:umount.0 00000100:00100000:0.0:1783074039.445184:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074039.445233:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3657:x1869685723487616:12345-0@lo:39:umount.0 Request processed in 285us (423us total) trans 77309411439 rc 0/0 00000100:00100000:3.0:1783074039.445243:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597 00000100:00080000:0.0:1783074039.445248:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c16e5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783074039.445255:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723487616:0@lo:39:umount.0 00000100:00080000:2.0:1783074039.445405:0:86387:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783074039.445417:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783074039.445459:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487744 00000100:00100000:0.0:1783074039.445464:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487744 00000020:00080000:2.0:1783074039.445472:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9523c338cd40) has no exports 00000100:00100000:0.0:1783074039.445507:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1783074039.445515:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723487744:12345-0@lo:9:umount.0 00000100:00080000:3.0:1783074039.445530:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1783074039.445531:0:26173:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de684 00000100:00080000:0.0:1783074039.445539:0:26173:0:(import.c:65:import_set_state_nolock()) ffff9524c783d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783074039.445591:0:26173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968712 00010000:00010000:2.0:1783074039.445620:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074039.445700:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723487744:12345-0@lo:9:umount.0 Request processed in 185us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074039.445709:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1783074039.445733:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723487872:0@lo:9:umount.0 00000100:00100000:0.0:1783074039.445769:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074039.445808:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c7838000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783074039.445816:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783074039.445818:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074039.445821:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723487744:0@lo:9:umount.0 00000100:00100000:3.0:1783074039.445894:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723487872 00000100:00100000:3.0:1783074039.445899:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723487872 00000100:00100000:3.0:1783074039.445944:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880 00000100:00100000:3.0:1783074039.445952:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723487872:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783074039.445967:0:8443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de699 00000100:00080000:3.0:1783074039.445973:0:8443:0:(import.c:65:import_set_state_nolock()) ffff9524c783b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074039.445987:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9523c338cd40) has no exports 00000001:00000004:3.0:1783074039.446004:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968707 00000100:00080000:0.0:1783074039.446008:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074039.446501:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723487872:12345-0@lo:9:umount.0 Request processed in 549us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074039.446507:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880 00010000:00010000:3.0:1783074039.446528:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074039.446549:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783074039.446556:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783074039.446558:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074039.446561:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723487872:0@lo:9:umount.0 00000020:00000080:1.0:1783074039.513907:0:6518:0:(genops.c:906:class_export_put()) final put ffff9524fb548000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00010000:00010000:1.0:1783074039.513990:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074039.513993:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074039.513996:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783074039.514028:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb548000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-MDT0000 00000020:00000080:0.0:1783074039.514086:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c6020000 for lustre-MDT0000 00000020:00000080:2.0:1783074039.526442:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de63e 00000020:00000080:2.0:1783074039.526458:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c2c29000/lustre-QMT0000_UUID 00000020:01000000:2.0:1783074039.526522:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783074039.526533:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074039.526544:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783074039.526548:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9524fb4dcd40) has no exports 00000020:00000080:3.0:1783074039.526676:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c29000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783074039.529589:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de637 00000020:00000080:2.0:1783074039.529600:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524de7c6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074039.529666:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074039.529677:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783074039.529680:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c4b62800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783074039.529697:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4b62800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783074039.529708:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783074039.529872:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524de7c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783074039.529985:0:86387:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524f4691a20 - data ffff9524fbdc6bd0/ffff9524fc2efc00 00000020:01000000:2.0:1783074039.530107:0:86387:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c45a1f60 - data ffff9524fbd19360/ffff9524f0763000 00000100:00080000:3.0:1783074039.567295:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783074039.567303:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783074039.567344:0:86387:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9524f4a01180 x1869685723487616/t77309411439(77309411439) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074049 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074039.567391:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783074039.568941:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783074039.568946:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968712 gen 4 00000004:00080000:3.0:1783074039.569001:0:86387:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074039.569004:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783074039.569225:0:85087:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783074039.569231:0:85087:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1783074039.569243:0:85087:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:3.0:1783074039.570167:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783074039.570171:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968707 gen 4 00000004:00080000:3.0:1783074039.570244:0:86387:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074039.570247:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783074039.570582:0:85089:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783074039.570586:0:85089:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1783074039.570595:0:85089:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:3.0:1783074039.571629:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de5f8 00000020:00000080:3.0:1783074039.571640:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c4e7d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783074039.572466:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de60d 00000020:00000080:3.0:1783074039.572473:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fb54b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074039.572517:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783074039.572583:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783074039.572589:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074039.572598:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783074039.572603:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9523c33899c0) has no exports 00000004:01000000:3.0:1783074039.572823:0:86387:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783074039.572833:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de68b 00000020:00000080:3.0:1783074039.572837:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c6945000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074039.572907:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783074039.572964:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783074039.572969:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074039.572977:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783074039.572980:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9524fb4d8000) has no exports 00000020:00000080:3.0:1783074039.572986:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de67d 00000020:00000080:3.0:1783074039.572991:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524df200000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074039.573012:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6945000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783074039.573415:0:86387:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783074039.573419:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783074039.573424:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968707 gen 5 00000004:00080000:3.0:1783074039.573466:0:86387:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074039.573469:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074039.573523:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524df200000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074039.573602:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074039.573612:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074039.573618:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de66f 00000020:00000080:3.0:1783074039.573623:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524f7806800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074039.573645:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c0000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783074039.573652:0:44310:0:(genops.c:906:class_export_put()) final put ffff9524f7805800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074039.573655:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7805800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783074039.573660:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783074039.573855:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783074039.573860:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074039.573866:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783074039.573869:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9524fa860000) has no exports 00000020:00000080:3.0:1783074039.573874:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de661 00000020:00000080:3.0:1783074039.573879:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524c783d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074039.573900:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7806800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1783074039.574389:0:86387:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783074039.574392:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783074039.574394:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968712 gen 5 00000004:00080000:3.0:1783074039.574398:0:86387:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074039.574399:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074039.574440:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c783d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074039.574522:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074039.574530:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783074039.574543:0:86387:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783074039.574548:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de653 00000020:00000080:3.0:1783074039.574553:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fc3c1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074039.574577:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c7838000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783074039.574583:0:44310:0:(genops.c:906:class_export_put()) final put ffff9524fc3c4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074039.574586:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783074039.574594:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783074039.574710:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783074039.574715:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074039.574722:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783074039.574725:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9524fa863380) has no exports 00000020:00000080:3.0:1783074039.574729:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de64c 00000020:00000080:3.0:1783074039.574733:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c4e7a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074039.574755:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783074039.576371:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783074039.577376:0:86387:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783074039.577381:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074039.577385:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074039.577392:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074039.577429:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c16e5800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783074039.577939:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074039.577953:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074039.577958:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fb54a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074039.577961:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783074039.577972:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074039.578113:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074039.578120:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074039.578123:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c4e78000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074039.578134:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783074039.578139:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074039.578211:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de614 00000020:00000080:1.0:1783074039.578217:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fb548800/lustre-MDD0000_UUID 00000020:01000000:1.0:1783074039.578232:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783074039.578236:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074039.578241:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783074039.578245:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9524fab719c0) has no exports 00000020:00000080:1.0:1783074039.578273:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074039.578277:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783074039.578281:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de61b 00000020:00000080:1.0:1783074039.578289:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fb549000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783074039.578296:0:86387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6cad800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783074039.578300:0:86387:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cad800 3 00000020:00000080:0.0:1783074039.578303:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb548800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:1.0:1783074039.578304:0:86387:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524c6cad800 from lustre-MDT0000 00000020:00000080:0.0:1783074039.578323:0:44310:0:(genops.c:906:class_export_put()) final put ffff9524fb54e000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783074039.578326:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783074039.578330:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783074039.578346:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074039.578351:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783074039.578355:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c4e7a000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783074039.578357:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783074039.578379:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1783074039.578396:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb549000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783074039.578425:0:86387:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783074039.578432:0:86387:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783074039.578436:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783074039.578438:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074039.578441:0:86387:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783074039.578452:0:86387:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524f7801000 da924155-7591-4a6a-a2d2-c0d2908d0bfb 192.168.204.26@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074039.578459:0:86387:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524ee2c7800 522b6a34-04f4-4017-ab45-61a21d19bfef 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074039.578464:0:86387:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9524fa8619c0) has exports, disconnecting them 00000020:00080000:1.0:1783074039.578468:0:86387:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.26@tcp (ffff9524f7801000), last request at 1783074023 00000020:00000080:1.0:1783074039.578487:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de79c 00000020:00010000:1.0:1783074039.578492:0:86387:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524f7801000: total 0 00000100:00080000:1.0:1783074039.578501:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524f0837000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074039.578515:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524f7801000): rc 0 00000020:00080000:1.0:1783074039.578519:0:86387:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9524ee2c7800), last request at 1783074020 00000020:00010000:0.0:1783074039.578526:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524f7801000: total 0 00010000:00010000:0.0:1783074039.578559:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524f7801000, canceled 0 locks, left on hash table 4. 00000020:00000080:1.0:1783074039.578587:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de5b9 00010000:00010000:0.0:1783074039.578590:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb360000/0x5fb609b3016de7b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af5c expref: 5 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1783074039.578597:0:86387:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524ee2c7800: total 0 00000100:00080000:1.0:1783074039.578602:0:86387:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783074039.578611:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb361a00/0x5fb609b3016de7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af47 expref: 4 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074039.578618:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524ee2c7800): rc 0 00000020:00080000:1.0:1783074039.578623:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9524fa8619c0) has no exports 00010000:00010000:0.0:1783074039.578627:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671600/0x5fb609b3016de7b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af55 expref: 3 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.578640:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb361c00/0x5fb609b3016de7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263af4e expref: 2 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.578648:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524f7801000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1783074039.578674:0:6517:0:(genops.c:906:class_export_put()) final put ffff9524f7801000/da924155-7591-4a6a-a2d2-c0d2908d0bfb 00000100:00100000:1.0:1783074039.578684:0:85077:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9524deb03000:85077] 1 exiting: rc = 0 00000020:00010000:0.0:1783074039.578684:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524ee2c7800: total 1 00010000:00010000:0.0:1783074039.578688:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074039.578703:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074039.578717:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524ee2c7800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783074039.578736:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb360e00/0x5fb609b3016de733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de72c expref: 14 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074039.578743:0:85076:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9524fb6e1a00:85076] 0 exiting: rc = 1 00010000:00010000:0.0:1783074039.578758:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299000/0x5fb609b3016de741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de73a expref: 13 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.578771:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298600/0x5fb609b3016de74f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de748 expref: 12 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.578789:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298200/0x5fb609b3016de75d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de756 expref: 11 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783074039.578805:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7801000/da924155-7591-4a6a-a2d2-c0d2908d0bfb for MGS 00010000:00010000:0.0:1783074039.578807:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b25400/0x5fb609b3016de6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de6e6 expref: 10 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.578824:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b24800/0x5fb609b3016de6fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de6f4 expref: 9 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783074039.578840:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f0837000 for MGS 00010000:00010000:0.0:1783074039.578851:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298c00/0x5fb609b3016de779 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de772 expref: 8 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074039.578865:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb360c00/0x5fb609b3016de709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de702 expref: 7 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.578905:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb361400/0x5fb609b3016de76b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de764 expref: 6 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074039.578927:0:85078:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9524deb03e00:85078] 2 exiting: rc = 0 00010000:00010000:1.0:1783074039.578927:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670200/0x5fb609b3016de725 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de71e expref: 5 pid: 85077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074039.578961:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b25000/0x5fb609b3016de787 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de780 expref: 4 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074039.578978:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783074039.578990:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299a00/0x5fb609b3016de717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de710 expref: 3 pid: 85078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074039.578998:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579010:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783074039.579014:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299e00/0x5fb609b3016de795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016de78e expref: 2 pid: 85076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074039.579025:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783074039.579034:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524ee2c7800, canceled 13 locks, left on hash table 0. 00000100:00100000:0.0:1783074039.579035:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579045:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579056:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783074039.579059:0:6517:0:(genops.c:906:class_export_put()) final put ffff9524ee2c7800/522b6a34-04f4-4017-ab45-61a21d19bfef 00010000:00010000:1.0:1783074039.579071:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074039.579074:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074039.579075:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579081:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783074039.579086:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074039.579092:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783074039.579094:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c7800/522b6a34-04f4-4017-ab45-61a21d19bfef for MGS 00000100:00100000:0.0:1783074039.579103:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579111:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783074039.579121:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c0800 for MGS 00000100:00100000:0.0:1783074039.579122:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579134:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579143:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579149:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579156:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579161:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579166:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579172:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579176:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579181:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579186:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579190:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579194:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579199:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579204:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579209:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579213:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579218:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579224:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579233:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579238:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579243:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579248:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579253:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579259:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579263:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579268:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579273:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579277:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579282:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579293:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579298:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579302:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579308:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579328:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579335:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579342:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579347:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579354:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579372:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579380:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579389:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579396:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579403:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579409:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579415:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579423:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579432:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579441:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579451:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579459:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783074039.579467:0:86387:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783074039.580180:0:86387:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523cec81660 - data ffff9524fbd9caf8/ffff9523c4cb6400 00000020:01000000:1.0:1783074039.580282:0:86387:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c680f900 - data ffff9524fbd610d8/ffff9523c2077400 00000020:00000080:1.0:1783074039.580776:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de5b2 00000020:00000080:1.0:1783074039.580783:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fc3c6800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783074039.580839:0:86387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6cad800 from MGS, refs=2 00000020:01000004:1.0:1783074039.580843:0:86387:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cad800 2 00000020:01000004:1.0:1783074039.580845:0:86387:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524c6cad800 from MGS 00000020:00000080:1.0:1783074039.580862:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074039.580868:0:86387:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783074039.580870:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fc3c7000/MGS 00000020:00000080:1.0:1783074039.580873:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c7000/MGS for MGS 00000020:01000000:1.0:1783074039.580878:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1783074039.580903:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783074039.580974:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783074039.580978:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074039.580987:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783074039.580994:0:86387:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9524d2eac800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074039.581000:0:86387:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9523c2c33380) has exports, disconnecting them 00000020:00080000:1.0:1783074039.581037:0:86387:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9524d2eac800), last request at 1783074020 00000020:00000080:1.0:1783074039.581043:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de6ca 00000020:00080000:1.0:1783074039.581054:0:86387:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524d2eac800): rc 0 00000020:00000080:1.0:1783074039.581058:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524d2eac800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783074039.583403:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2eac800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783074039.584381:0:86387:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783074039.584389:0:86387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074039.584393:0:86387:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074039.584399:0:86387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074039.584501:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f7805000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783074039.584638:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074039.584650:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783074039.584655:0:86387:0:(genops.c:906:class_export_put()) final put ffff9523c4e78800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783074039.584658:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e78800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783074039.584672:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783074039.584743:0:86387:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cad800 1 00000020:00000080:0.0:1783074039.584749:0:86387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de5a4 00000020:00000080:0.0:1783074039.584755:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524fc3c0000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783074039.584763:0:86387:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783074039.584770:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074039.584778:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074039.584782:0:86387:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783074039.584786:0:86387:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9523c338b380) has no exports 00000020:00000080:1.0:1783074039.617212:0:86387:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074039.617222:0:86387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783074039.617227:0:86387:0:(genops.c:906:class_export_put()) final put ffff9524f808b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074039.617230:0:86387:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f808b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783074039.617239:0:86387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783074039.618987:0:86387:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524c6cac800 00000020:02000400:1.0:1783074039.619112:0:86387:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1783074040.239513:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723488128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074040.239645:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074040.239698:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074040.239707:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723488000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074040.239744:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074040.239782:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488128 00000100:00100000:0.0:1783074040.239789:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488128 00000100:00100000:0.0:1783074040.239839:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488000 00000100:00100000:0.0:1783074040.239842:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488000 00000100:00100000:0.0:1783074040.239870:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1783074040.239880:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723488128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074040.239908:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074040.239949:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723488128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074040.239956:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1783074040.239974:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:0.0:1783074040.239996:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723488000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074040.240013:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074040.240045:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723488000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074040.240062:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00080000:0.0:1783074040.240084:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074040.240087:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074040.240140:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723488000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074040.240160:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723488128:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783074040.431730:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074041.454454:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074041.774502:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723488256:0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.774526:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723488384:0@lo:400:kworker.0 00000100:00100000:2.0:1783074041.774562:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723488512:0@lo:400:kworker.0 00000400:00000100:0.0:1783074041.774563:0:3658:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723488256 offset 0 length 224: 4 00000100:00100000:3.0:1783074041.774578:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1869685723488640:0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.774579:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074041.774611:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074041.774623:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723488896:0@lo:400:kworker.0 00000100:00100000:0.0:1783074041.774623:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723488768:0@lo:400:kworker.0 00000100:00100000:3.0:1783074041.774634:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488384 00000100:00100000:3.0:1783074041.774640:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488384 00000100:00100000:2.0:1783074041.774644:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723489024:0@lo:400:kworker.0 00000100:00100000:0.0:1783074041.774669:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074041.774671:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074041.774698:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723489280:0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.774701:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723489408:0@lo:400:kworker.0 00000100:00100000:2.0:1783074041.774748:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074041.774751:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074041.774762:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488512 00000100:00100000:3.0:1783074041.774763:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488768 00000100:00100000:0.0:1783074041.774768:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488512 00000100:00100000:3.0:1783074041.774770:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488768 00000100:00100000:2.0:1783074041.774808:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489408 00000100:00100000:2.0:1783074041.774814:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489408 00000100:00100000:1.0:1783074041.774818:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488896 00000100:00100000:1.0:1783074041.774823:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488896 00000100:00100000:0.0:1783074041.774830:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1783074041.774838:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1783074041.774843:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723488512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.774851:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598 00000100:00100000:1.0:1783074041.774858:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1869685723488896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074041.774860:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723488768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783074041.774866:0:26189:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783074041.774870:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1783074041.774877:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1869685723488384:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783074041.774884:0:67186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074041.774926:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723488512:12345-0@lo:400:kworker.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074041.774934:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1783074041.774939:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723488768:12345-0@lo:400:kworker.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074041.774940:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1869685723488896:12345-0@lo:400:kworker.0 Request processed in 82us (272us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783074041.774948:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598 00000100:00100000:2.0:1783074041.774957:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1869685723488384:12345-0@lo:400:kworker.0 Request processed in 77us (377us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074041.774962:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1783074041.774972:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1783074041.774982:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1783074041.774992:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489024 00000100:00100000:0.0:1783074041.774994:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1869685723489408:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783074041.775001:0:66200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074041.775006:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489024 00000100:00080000:1.0:1783074041.775018:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783074041.775023:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783074041.775027:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783074041.775033:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723488512:0@lo:400:kworker.0 00000100:00080000:1.0:1783074041.775034:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783074041.775042:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00080000:1.0:1783074041.775042:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2865 00000100:00100000:0.0:1783074041.775043:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1869685723489408:12345-0@lo:400:kworker.0 Request processed in 59us (291us total) trans 0 rc -107/-107 00000100:00080000:1.0:1783074041.775050:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074041.775051:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723489024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074041.775055:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1783074041.775082:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074041.775083:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b7800 x1869685723489536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074041.775089:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074041.775102:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723489024:12345-0@lo:400:kworker.0 Request processed in 52us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074041.775106:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723488896:0@lo:400:kworker.0 00000100:00100000:3.0:1783074041.775110:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1783074041.775122:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723489536:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783074041.775124:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489280 00000100:00100000:3.0:1783074041.775130:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489280 00000100:00100000:2.0:1783074041.775131:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723488768:0@lo:400:kworker.0 00000100:00080000:1.0:1783074041.775143:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783074041.775148:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783074041.775151:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783074041.775156:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074041.775161:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2865 00000100:00100000:3.0:1783074041.775163:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1783074041.775165:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074041.775169:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074041.775172:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723489280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.775185:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b4a80 x1869685723489664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074041.775196:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074041.775200:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723489408:0@lo:400:kworker.0 00000100:00080000:1.0:1783074041.775215:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783074041.775216:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489536 00000100:00080000:1.0:1783074041.775219:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1783074041.775221:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489536 00000100:00100000:3.0:1783074041.775227:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723489280:12345-0@lo:400:kworker.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:02000400:1.0:1783074041.775229:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783074041.775233:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783074041.775234:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00080000:1.0:1783074041.775247:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2865 00000100:00080000:2.0:1783074041.775250:0:3661:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9524f4a03480 x1869685723489152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074041.775252:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00080000:1.0:1783074041.775257:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074041.775265:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723489536:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783074041.775275:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b4700 x1869685723489792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074041.775279:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723489280:0@lo:400:kworker.0 00010000:00020000:0.0:1783074041.775286:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074041.775289:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869685723488384:0@lo:400:kworker.0 00000100:00100000:2.0:1783074041.775290:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723488640 00000100:00100000:2.0:1783074041.775301:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723488640 00000100:00100000:1.0:1783074041.775359:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723489664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783074041.775361:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723489024:0@lo:400:kworker.0 00000100:00100000:0.0:1783074041.775362:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723489536:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 97us (200us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074041.775372:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1783074041.775376:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1783074041.775382:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1869685723488640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.775390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783074041.775395:0:68632:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783074041.775410:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723489792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783074041.775418:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489664 00000100:00100000:3.0:1783074041.775421:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489664 00000100:00100000:1.0:1783074041.775436:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074041.775442:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1783074041.775446:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1869685723488640:12345-0@lo:400:kworker.0 Request processed in 63us (250us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074041.775450:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723489664:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783074041.775463:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783074041.775465:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783074041.775469:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:1.0:1783074041.775472:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074041.775478:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723489536:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783074041.775487:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489792 00000100:00100000:2.0:1783074041.775492:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489792 00000100:00080000:1.0:1783074041.775496:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783074041.775501:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723489664:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 52us (114us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783074041.775501:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074041.775504:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723489664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783074041.775508:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1783074041.775517:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1783074041.775524:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723489792:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783074041.775536:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074041.775573:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723489792:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 48us (137us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074041.775580:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:0.0:1783074041.775600:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074041.775604:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783074041.775608:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074041.775611:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074041.775614:0:3661:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2865 00000100:00080000:0.0:1783074041.775618:0:3661:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074041.775633:0:3661:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c3bf1500 x1869685723489920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074041.775645:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1869685723488640:0@lo:400:kworker.0 00000100:00100000:1.0:1783074041.775678:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723489920:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783074041.775701:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074041.775731:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074041.775735:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074041.775737:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723489792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783074041.775793:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489920 00000100:00100000:3.0:1783074041.775856:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489920 00000100:00100000:3.0:1783074041.775898:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1783074041.775902:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723489920:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1783074041.775909:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074041.775942:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723489920:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 39us (240us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074041.775946:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:0.0:1783074041.776039:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074041.776044:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074041.776048:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723489920:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1783074042.478449:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074043.503168:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074044.400028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074044.400090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000400:00000100:3.0:1783074044.400125:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708028288 offset 0 length 224: 4 00000100:00100000:3.0:1783074044.400144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074044.400166:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028416 00000100:00100000:3.0:1783074044.400173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074044.400189:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028416 00000100:00100000:3.0:1783074044.400220:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028672 00000100:00100000:3.0:1783074044.400225:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028672 00000100:00100000:0.0:1783074044.400233:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028544 00000100:00100000:0.0:1783074044.400238:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028544 00000100:00100000:3.0:1783074044.400284:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028800 00000100:00100000:3.0:1783074044.400288:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028800 00000100:00100000:0.0:1783074044.400301:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 743 00000100:00100000:0.0:1783074044.400363:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708028544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074044.400364:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2071 00000100:00100000:3.0:1783074044.400377:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708028672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074044.400481:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2072 00000100:00100000:1.0:1783074044.400492:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708028800:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074044.400833:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708028672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 458us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074044.400841:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2071 00000100:00100000:3.0:1783074044.400908:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1072 00000100:00100000:3.0:1783074044.400921:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1869685708028416:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:3.0:1783074044.400928:0:66200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:0.0:1783074044.400979:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708028544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 668us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074044.400987:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 743 00000100:00100000:1.0:1783074044.401124:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708028800:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 633us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074044.401132:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2072 00000100:00080000:0.0:1783074044.401172:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074044.401179:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074044.401182:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074044.402205:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1869685708028416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1279us (2184us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074044.402214:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1072 00000100:00100000:3.0:1783074044.404519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074044.404938:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708028928 00000100:00100000:1.0:1783074044.404949:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708028928 00000100:00100000:1.0:1783074044.405161:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1073 00000100:00100000:1.0:1783074044.405169:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708028928:12345-192.168.204.26@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1783074044.405194:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074044.405259:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708028928:12345-192.168.204.26@tcp:38:ptlrpcd_01_00.0 Request processed in 89us (746us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074044.405292:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1073 00010000:00010000:0.0:1783074044.526589:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783074044.849631:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074044.849638:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524c783a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783074044.849641:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074044.849647:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524c7839000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783074044.849688:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783074044.849698:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411439 is committed 00000020:00000080:3.0:1783074044.849702:0:75594:0:(genops.c:906:class_export_put()) final put ffff9523c3168000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074044.849712:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c783a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783074044.849749:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c7839000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783074044.849762:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c3168000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783074044.849790:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c783d800 for lustre-OST0000 00000020:00000080:0.0:1783074044.849796:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c783b800 for lustre-OST0001 00000020:00000080:0.0:1783074044.849808:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c316a000 for lustre-MDT0001 00000100:00100000:1.0:1783074045.358655:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723490048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074045.358726:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074045.358792:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490048 00000100:00100000:3.0:1783074045.358800:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490048 00000100:00100000:3.0:1783074045.358865:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:3.0:1783074045.358874:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723490048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783074045.358902:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074045.358957:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723490048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074045.358970:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00080000:1.0:1783074045.359046:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074045.359077:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723490048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074045.359303:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723490176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074045.359353:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074045.359641:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490176 00000100:00100000:3.0:1783074045.359646:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490176 00000100:00100000:3.0:1783074045.359695:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:3.0:1783074045.359702:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723490176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074045.359720:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074045.359774:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723490176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074045.359781:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00080000:1.0:1783074045.359838:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074045.359934:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723490176:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074045.550543:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074046.574563:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074046.894835:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723490304:0@lo:400:kworker.0 00000400:00000100:3.0:1783074046.894903:0:3658:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723490304 offset 0 length 224: 4 00000100:00080000:1.0:1783074046.894988:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074046.894993:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074046.894996:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074046.895001:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2880 00000100:00080000:1.0:1783074046.895005:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074046.895011:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074046.895033:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b6300 x1869685723490432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074046.895097:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723490432:0@lo:38:kworker.0 00000100:00100000:2.0:1783074046.895118:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723490560:0@lo:400:kworker.0 00000100:00100000:0.0:1783074046.895139:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074046.895160:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074046.895176:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074046.895181:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074046.895184:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074046.895189:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2880 00000100:00080000:1.0:1783074046.895193:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1783074046.895194:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490432 00000100:00100000:0.0:1783074046.895194:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490560 00000100:00080000:1.0:1783074046.895198:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074046.895202:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490432 00000100:00100000:0.0:1783074046.895202:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490560 00000100:00100000:1.0:1783074046.895214:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b6a00 x1869685723490688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074046.895253:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074046.895259:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1783074046.895271:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723490560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074046.895275:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00080000:1.0:1783074046.895276:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074046.895282:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074046.895285:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783074046.895286:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723490432:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783074046.895293:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2880 00000100:00080000:1.0:1783074046.895297:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074046.895301:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074046.895307:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00020000:0.0:1783074046.895307:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074046.895333:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b4380 x1869685723490944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074046.895347:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723490560:12345-0@lo:400:kworker.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074046.895353:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723490816:0@lo:400:kworker.0 00000100:00100000:3.0:1783074046.895358:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00080000:1.0:1783074046.895369:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074046.895375:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783074046.895375:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723490432:12345-0@lo:38:kworker.0 Request processed in 87us (234us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783074046.895380:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783074046.895386:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00080000:1.0:1783074046.895387:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2880 00000100:00100000:2.0:1783074046.895394:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074046.895395:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074046.895402:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074046.895416:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b7480 x1869685723491328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074046.895422:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723491072:0@lo:400:kworker.0 00000100:00100000:1.0:1783074046.895458:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723490688:0@lo:38:kworker.0 00000100:00100000:2.0:1783074046.895461:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074046.895493:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491072 00000100:00100000:2.0:1783074046.895499:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491072 00000100:00100000:1.0:1783074046.895506:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074046.895527:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1783074046.895534:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723491072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074046.895576:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723491072:12345-0@lo:400:kworker.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074046.895583:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1783074046.895617:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723491072:0@lo:400:kworker.0 00000100:00100000:0.0:1783074046.895866:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490816 00000100:00100000:0.0:1783074046.895871:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490816 00000100:00100000:2.0:1783074046.895906:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490688 00000100:00100000:0.0:1783074046.895910:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1783074046.895912:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490688 00000100:00100000:1.0:1783074046.895921:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723490944:0@lo:38:kworker.0 00000100:00100000:3.0:1783074046.895940:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723490560:0@lo:400:kworker.0 00000100:00100000:2.0:1783074046.895943:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1783074046.895951:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723490688:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074046.895956:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074046.895965:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723491200:0@lo:400:kworker.0 00010000:00020000:2.0:1783074046.895965:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074046.896780:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723490816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074046.897044:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074046.897085:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491200 00000100:00100000:3.0:1783074046.897089:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491200 00000100:00100000:3.0:1783074046.897117:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1783074046.897136:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723491200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074046.897175:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723491200:12345-0@lo:400:kworker.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074046.897181:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1783074046.897210:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723491200:0@lo:400:kworker.0 00000100:00080000:3.0:1783074046.897274:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074046.897362:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723490688:12345-0@lo:38:kworker.0 Request processed in 1408us (1855us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074046.897371:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1783074046.897540:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074046.897564:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723491328:0@lo:38:kworker.0 00000100:00100000:1.0:1783074046.897589:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074046.897616:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074046.897630:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074046.897633:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723490432:0@lo:38:kworker.0 00000100:00080000:1.0:1783074046.897653:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783074046.897703:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723490944 00000100:00100000:2.0:1783074046.897708:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723490944 00000100:00080000:1.0:1783074046.897720:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074046.897725:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723490688:0@lo:38:kworker.0 00000100:00100000:2.0:1783074046.897731:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:2.0:1783074046.897738:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723490944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074046.897752:0:26189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074046.897790:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723490944:12345-0@lo:38:kworker.0 Request processed in 51us (249us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074046.897796:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00080000:1.0:1783074046.897867:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074046.897872:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074046.897875:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723490944:0@lo:38:kworker.0 00000100:00100000:3.0:1783074046.897947:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491328 00000100:00100000:3.0:1783074046.897951:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491328 00000100:00100000:3.0:1783074046.897980:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1783074046.897985:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723491328:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783074046.897997:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074046.898046:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723491328:12345-0@lo:38:kworker.0 Request processed in 60us (455us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074046.898053:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00080000:1.0:1783074046.898117:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074046.898122:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074046.898125:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723491328:0@lo:38:kworker.0 00000100:00100000:0.0:1783074046.900664:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723490816:12345-0@lo:400:kworker.0 Request processed in 4739us (5267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074046.900677:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1783074046.901273:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723490816:0@lo:400:kworker.0 00010000:00010000:1.0:1783074047.599387:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074048.623732:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783074049.519202:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708029056 offset 0 length 224: 4 00000100:00100000:2.0:1783074049.519247:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074049.519639:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708029184 00000100:00100000:3.0:1783074049.519650:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708029184 00000100:00100000:2.0:1783074049.519772:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074049.519847:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1077 00000100:00100000:3.0:1783074049.519856:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869685708029184:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:3.0:1783074049.519881:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074049.519951:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869685708029184:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 94us (702us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074049.519959:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1077 00000100:00100000:0.0:1783074049.520158:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708029440 00000100:00100000:0.0:1783074049.520163:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708029440 00000100:00100000:0.0:1783074049.520223:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2075 00000100:00100000:0.0:1783074049.520231:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708029440:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074049.520274:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708029440:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074049.520293:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2075 00000100:00080000:2.0:1783074049.520384:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074049.520990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074049.521022:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074049.521114:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708029568 00000100:00100000:0.0:1783074049.521119:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708029568 00000100:00100000:3.0:1783074049.521140:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708029312 00000100:00100000:3.0:1783074049.521146:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708029312 00000100:00100000:0.0:1783074049.521215:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2076 00000100:00100000:0.0:1783074049.521223:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708029568:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074049.521266:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708029568:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074049.521273:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2076 00000100:00080000:2.0:1783074049.521537:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074049.521541:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074049.521813:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 746 00000100:00100000:3.0:1783074049.521822:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708029312:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074049.521908:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708029312:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 86us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074049.521915:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 746 00010000:00010000:1.0:1783074049.649293:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074050.478496:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723491456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074050.478568:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074050.478569:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074050.478587:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723491584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074050.478627:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074050.478644:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491456 00000100:00100000:2.0:1783074050.478654:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491584 00000100:00100000:2.0:1783074050.478662:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491584 00000100:00100000:0.0:1783074050.478663:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491456 00000100:00100000:0.0:1783074050.478725:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1783074050.478737:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723491456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074050.478767:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074050.478812:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723491456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074050.478819:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00080000:3.0:1783074050.479031:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074050.479035:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074050.479068:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1783074050.479073:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723491456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074050.479079:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c54ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723491584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074050.479098:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074050.479142:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c54ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723491584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074050.479149:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1783074050.479249:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723491584:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783074050.671190:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074051.694547:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074052.016624:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074052.016631:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074052.016635:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074052.016643:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2886 00000100:00080000:3.0:1783074052.016648:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074052.016655:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074052.016675:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c54ab480 x1869685723491840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074052.016715:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074052.016719:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074052.016720:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074052.016724:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2886 00000100:00080000:3.0:1783074052.016727:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074052.016730:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074052.016740:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c54a9c00 x1869685723492096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074052.016754:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074052.016758:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074052.016759:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074052.016763:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2886 00000100:00080000:3.0:1783074052.016765:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074052.016768:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074052.016780:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c54aad80 x1869685723492352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074052.016828:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074052.016832:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074052.016834:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074052.016837:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2886 00000100:00080000:3.0:1783074052.016840:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074052.016844:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074052.016854:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4eff800 x1869685723492736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074052.016883:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723491968:0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.016946:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074052.017003:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074052.017009:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723492224:0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.017030:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074052.017066:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491968 00000100:00100000:3.0:1783074052.017072:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491968 00000100:00100000:3.0:1783074052.017114:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492224 00000100:00100000:3.0:1783074052.017116:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492224 00000100:00100000:3.0:1783074052.017156:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1783074052.017165:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723491968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.017216:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723491968:12345-0@lo:400:kworker.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074052.017223:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1783074052.017238:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1783074052.017244:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723492224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.017274:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723492224:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074052.017285:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00080000:3.0:1783074052.017300:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074052.017359:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723492224:0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.017369:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723491968:0@lo:400:kworker.0 00000100:00100000:1.0:1783074052.017439:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723492480:0@lo:400:kworker.0 00000100:00100000:1.0:1783074052.017468:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074052.017494:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783074052.017500:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723491712:0@lo:400:kworker.0 00000400:00000100:1.0:1783074052.017517:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723491712 offset 0 length 224: 4 00000100:00100000:1.0:1783074052.017535:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723492608:0@lo:400:kworker.0 00000100:00100000:1.0:1783074052.017551:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074052.017616:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723491840:0@lo:38:kworker.0 00000100:00100000:0.0:1783074052.017642:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074052.017666:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723492096:0@lo:38:kworker.0 00000100:00100000:0.0:1783074052.017684:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074052.017697:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c54aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723492352:0@lo:38:kworker.0 00000100:00100000:0.0:1783074052.017716:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074052.017730:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723492736:0@lo:38:kworker.0 00000100:00100000:0.0:1783074052.017749:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074052.017780:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723491840 00000100:00100000:0.0:1783074052.017784:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723491840 00000100:00100000:0.0:1783074052.017802:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492096 00000100:00100000:0.0:1783074052.017804:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492096 00000100:00100000:0.0:1783074052.017812:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492736 00000100:00100000:0.0:1783074052.017814:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492736 00000100:00100000:0.0:1783074052.017823:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1783074052.017828:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723491840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074052.017844:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074052.017874:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723491840:12345-0@lo:38:kworker.0 Request processed in 45us (231us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074052.017881:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1783074052.017900:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1783074052.017904:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723492096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074052.017913:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074052.017935:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723492096:12345-0@lo:38:kworker.0 Request processed in 30us (250us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074052.017941:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1783074052.017951:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1783074052.017955:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723492736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074052.017963:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074052.017984:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723492736:12345-0@lo:38:kworker.0 Request processed in 27us (233us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074052.017989:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1783074052.018007:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492352 00000100:00100000:0.0:1783074052.018010:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492352 00000100:00100000:0.0:1783074052.018030:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:0.0:1783074052.018034:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723492352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074052.018043:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074052.018067:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723492352:12345-0@lo:38:kworker.0 Request processed in 32us (350us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074052.018073:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00080000:0.0:1783074052.018101:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074052.018106:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074052.018108:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723491840:0@lo:38:kworker.0 00000100:00080000:0.0:1783074052.018116:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074052.018119:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074052.018139:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723492096:0@lo:38:kworker.0 00000100:00080000:0.0:1783074052.018150:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074052.018154:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074052.018156:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723492352:0@lo:38:kworker.0 00000100:00080000:0.0:1783074052.018163:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074052.018166:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074052.018168:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723492736:0@lo:38:kworker.0 00000100:00100000:3.0:1783074052.018271:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492480 00000100:00100000:3.0:1783074052.018275:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492480 00000100:00100000:3.0:1783074052.018336:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492608 00000100:00100000:3.0:1783074052.018340:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492608 00000100:00100000:3.0:1783074052.018358:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1783074052.018363:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723492480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.018405:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723492480:12345-0@lo:400:kworker.0 Request processed in 42us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074052.018412:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1783074052.018422:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1783074052.018427:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723492608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.018453:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723492608:12345-0@lo:400:kworker.0 Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074052.018458:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1783074052.018483:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723492608:0@lo:400:kworker.0 00000100:00100000:3.0:1783074052.018492:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723492480:0@lo:400:kworker.0 00000100:00080000:0.0:1783074052.018691:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074052.018694:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783074052.720346:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074053.743480:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074054.638890:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000400:00000100:1.0:1783074054.638931:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708029696 offset 0 length 224: 4 00000100:00100000:1.0:1783074054.638968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074054.638994:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074054.639028:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074054.639057:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030080 00000100:00100000:1.0:1783074054.639066:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030080 00000100:00100000:1.0:1783074054.639130:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030208 00000100:00100000:1.0:1783074054.639134:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030208 00000100:00100000:1.0:1783074054.639159:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2079 00000100:00100000:1.0:1783074054.639167:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708030080:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074054.639241:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708030080:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074054.639249:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2079 00000100:00100000:1.0:1783074054.639268:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2080 00000100:00100000:1.0:1783074054.639276:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708030208:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074054.639303:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708030208:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074054.639335:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2080 00000100:00100000:0.0:1783074054.639363:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708029824 00000100:00100000:0.0:1783074054.639368:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708029824 00000100:00100000:0.0:1783074054.639394:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708029952 00000100:00100000:0.0:1783074054.639396:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708029952 00000100:00100000:0.0:1783074054.639435:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 749 00000100:00100000:0.0:1783074054.639444:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708029952:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074054.639479:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708029952:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074054.639485:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 749 00000100:00100000:0.0:1783074054.639502:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1081 00000100:00100000:0.0:1783074054.639507:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708029824:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:0.0:1783074054.639526:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074054.639552:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708029824:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 44us (671us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074054.639560:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1081 00000100:00080000:2.0:1783074054.639664:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074054.639670:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074054.639671:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783074054.766586:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783074055.253948:0:87003:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783074055.253952:0:87003:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783074055.253953:0:87003:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783074055.254139:0:87003:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9524e6a75000 00000020:01000004:3.0:1783074055.254155:0:87003:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783074055.254170:0:87003:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783074055.254185:0:87003:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9524fa864d40) 00000020:00000080:3.0:1783074055.254202:0:87003:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783074055.311640:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783074055.314588:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.315187:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.316080:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783074055.316568:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.316863:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.317045:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.317558:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783074055.317823:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783074055.318127:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783074055.318585:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783074055.318986:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.319555:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.319809:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783074055.320858:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783074055.325555:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.325744:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.325965:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.326141:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.326415:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.326583:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.326746:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.326994:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.327215:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.327630:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.327858:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.328059:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.328341:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.328573:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.328856:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.329037:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.329266:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.329499:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.329665:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783074055.329893:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.330096:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783074055.330266:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783074055.330659:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783074055.330975:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783074055.331171:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783074055.331453:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783074055.331641:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783074055.332196:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783074055.332379:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783074055.332636:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783074055.333008:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783074055.333335:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783074055.333815:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1783074055.334248:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1783074055.334455:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1783074055.334906:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1783074055.335131:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1783074055.335331:0:87003:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1783074055.336222:0:87003:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783074055.336631:0:87003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783074055.336639:0:87003:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783074055.336650:0:87003:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016deb46 00000020:01000004:0.0:1783074055.336657:0:87003:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783074055.336670:0:87003:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783074055.336675:0:87003:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524e6a75000 from MGS 00000020:01000004:0.0:1783074055.336679:0:87003:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783074055.336689:0:87003:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9523c2284d40) 00000020:00000080:0.0:1783074055.336702:0:87003:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:0.0:1783074055.336753:0:87003:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524e6a75000 from MGS, refs=2 00080000:01000000:0.0:1783074055.336757:0:87003:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783074055.336769:0:87003:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016deb54 00010000:00010000:0.0:1783074055.336875:0:87003:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783074055.339361:0:87003:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783074055.340296:0:87007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783074055.340350:0:87003:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783074055.340381:0:87003:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783074055.340857:0:87003:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783074055.341292:0:87003:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783074055.341562:0:87003:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783074055.341568:0:87003:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783074055.342576:0:87003:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783074055.342583:0:87003:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783074055.343255:0:87003:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783074055.343263:0:87003:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783074055.344767:0:87003:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783074055.344791:0:87003:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783074055.344793:0:87003:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783074055.344803:0:87003:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1783074055.344809:0:87003:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783074055.344815:0:87003:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783074055.344819:0:87003:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783074055.344821:0:87003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783074055.344930:0:87003:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c54a8380 x1869685723488256/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074057 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074055.345004:0:87003:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c47b7800 x1869685723490304/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074062 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074055.345015:0:87003:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c54ab100 x1869685723491712/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783074055.345035:0:87003:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783074055.345037:0:87003:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783074055.345039:0:87003:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783074055.345041:0:87003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1783074055.345118:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723491712:0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.345125:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c54a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723488256:0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.345263:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723490304:0@lo:400:kworker.0 10000000:01000000:1.0:1783074055.345280:0:87003:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1783074055.345296:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345306:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345377:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1783074055.345388:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345397:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb360600/0x5fb609b3016de780 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de787 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345419:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345426:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345432:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345442:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345447:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb361200/0x5fb609b3016de6e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de6ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345465:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345472:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345477:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345486:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345492:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016de702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de709 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345505:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345512:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345518:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345525:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345529:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016de72c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de733 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345542:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345548:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345553:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345600:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345607:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016de73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de741 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345622:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345627:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345633:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345643:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345647:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb360400/0x5fb609b3016de756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de75d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345655:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345662:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345668:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345675:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345680:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299600/0x5fb609b3016de764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de76b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345689:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345696:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345712:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345722:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345728:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb361000/0x5fb609b3016de78e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de795 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345743:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345750:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345754:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345762:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345766:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016de6f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de6fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345777:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345784:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345789:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074055.345792:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345795:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25600/0x5fb609b3016de710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de717 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345805:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345822:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345828:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074055.345834:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345838:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016de71e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de725 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345846:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345852:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345857:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074055.345860:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345863:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670e00/0x5fb609b3016de748 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de74f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.345870:0:87003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074055.345877:0:87003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.345882:0:87003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074055.345885:0:87003:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074055.345889:0:87003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb360200/0x5fb609b3016de772 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016de779 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074055.345913:0:87003:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 51, was 0): DISCONN 00000100:00080000:1.0:1783074055.345918:0:87003:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074055.345924:0:87003:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 2860 00000100:00080000:1.0:1783074055.345931:0:87003:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074055.345959:0:87003:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c47b7800 x1869685723492864/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074055.345991:0:87003:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1783074055.346004:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723492864:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783074055.346079:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.346332:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492864 00000100:00100000:3.0:1783074055.346339:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492864 00000100:00100000:3.0:1783074055.346410:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783074055.346418:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1869685723492864:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783074055.346443:0:87008:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo t0 exp 0000000000000000 cur 2894 last 0 00000020:00000080:3.0:1783074055.346472:0:87008:0:(genops.c:1406:class_connect()) connect: client 522b6a34-04f4-4017-ab45-61a21d19bfef, cookie 0x5fb609b3016deb5b 00000100:00080000:3.0:1783074055.346608:0:87008:0:(import.c:65:import_set_state_nolock()) ffff9523c316c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074055.346684:0:3657:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 25 00000100:00100000:3.0:1783074055.346685:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3657:x1869685723492864:12345-0@lo:250:mount.lustre.0 Request processed in 265us (618us total) trans 0 rc 0/0 00000100:00080000:1.0:1783074055.346692:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00100000:3.0:1783074055.346697:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783074055.346698:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783074055.346703:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783074055.346706:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783074055.346707:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783074055.346732:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783074055.346738:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723492864:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1783074055.346766:0:53092:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.126@tcp 10000000:01000000:1.0:1783074055.346778:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783074055.346781:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783074055.346782:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783074055.346784:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.346785:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.346785:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074055.346786:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074055.346788:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074055.346789:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.346789:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783074055.346822:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783074055.346826:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783074055.346827:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783074055.346832:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783074055.346833:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.346834:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.346834:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074055.346835:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074055.346836:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074055.346837:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.346837:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783074055.346935:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783074055.346936:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723492992:0@lo:253:kworker.0 10000000:01000000:1.0:1783074055.346940:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783074055.346943:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783074055.346944:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783074055.346944:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.346945:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.346946:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1783074055.346973:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.347000:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783074055.347006:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723493120:0@lo:253:kworker.0 00000100:00100000:2.0:1783074055.347035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.347075:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723492992 00000100:00100000:2.0:1783074055.347079:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723492992 00000100:00100000:2.0:1783074055.347102:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493120 00000100:00100000:2.0:1783074055.347105:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493120 00000100:00100000:3.0:1783074055.347239:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783074055.347248:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:3658:x1869685723492992:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783074055.347267:0:87008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:3.0:1783074055.347468:0:87012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783074055.347554:0:87008:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 107 00000020:01000004:1.0:1783074055.347769:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074055.347771:0:53092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074055.347773:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.347774:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783074055.347820:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00080000:1.0:1783074055.347881:0:87003:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1783074055.347891:0:87003:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783074055.347918:0:87003:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783074055.347922:0:87003:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:2.0:1783074055.347932:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723493248:0@lo:253:kworker.0 00000100:00100000:2.0:1783074055.347972:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1783074055.347983:0:87003:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783074055.348010:0:87003:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783074055.348023:0:87003:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783074055.348026:0:87003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074055.348027:0:87003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.348028:0:87003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.348030:0:87003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074055.348031:0:87003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074055.348033:0:87003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074055.348035:0:87003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074055.348036:0:87003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.348038:0:87003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074055.348040:0:87003:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783074055.348042:0:87003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783074055.348044:0:87003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074055.348051:0:87003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.348052:0:87003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.348054:0:87003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074055.348055:0:87003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074055.348057:0:87003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074055.348058:0:87003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074055.348060:0:87003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.348061:0:87003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074055.348084:0:87003:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783074055.348094:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783074055.348129:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074055.348142:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be1240 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.348482:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493248 00000100:00100000:2.0:1783074055.348487:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493248 00000100:00100000:2.0:1783074055.348505:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493376 00000100:00100000:2.0:1783074055.348509:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493376 00000100:00100000:2.0:1783074055.348521:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783074055.348537:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3658:x1869685723493120:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783074055.348557:0:87010:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783074055.350109:0:87013:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783074055.350115:0:87013:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783074055.350117:0:87013:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783074055.350120:0:87013:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783074055.350627:0:87013:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783074055.350850:0:87008:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074055.350872:0:87008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783074055.352775:0:87008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783074055.352792:0:87008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783074055.352871:0:87010:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783074055.352991:0:87012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074055.352996:0:87012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074055.353018:0:87012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.353035:0:87012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.353038:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3658:x1869685723492992:12345-0@lo:253:kworker.0 Request processed in 5788us (6061us total) trans 0 rc 0/0 20000000:01000000:0.0:1783074055.353052:0:87012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056867s 00010000:00010000:0.0:1783074055.353059:0:87012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.353074:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1783074055.353081:0:87012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.353093:0:87012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.353101:0:87012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.353108:0:87012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074055.353113:0:87012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.353115:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783074055.353124:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3660:x1869685723493248:12345-0@lo:253:kworker.0 00010000:00010000:0.0:1783074055.353134:0:87012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.353150:0:87012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783074055.353157:0:87008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00010000:0.0:1783074055.353159:0:87012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.353168:0:87012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144c00/0x5fb609b3016deb62 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783074055.353385:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783074055.353388:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783074055.353389:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074055.353390:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074055.353391:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074055.353393:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074055.353394:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783074055.353396:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074055.353397:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074055.353401:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723492992:0@lo:253:kworker.0 20000000:01000000:2.0:1783074055.355525:0:87010:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783074055.355541:0:87010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783074055.355562:0:87008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783074055.355686:0:87012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074055.355691:0:87012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074055.355708:0:87012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355722:0:87012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074055.355731:0:87012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056867s 00010000:00010000:0.0:1783074055.355735:0:87012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355741:0:87012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355748:0:87012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355760:0:87012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355775:0:87012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074055.355780:0:87012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355787:0:87012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355798:0:87012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355805:0:87012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.355811:0:87012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145400/0x5fb609b3016deb69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074055.356082:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3658:x1869685723493120:12345-0@lo:253:kworker.0 Request processed in 7545us (9045us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.356092:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1783074055.356118:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783074055.356122:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783074055.356123:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.356126:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.356127:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074055.356130:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:2.0:1783074055.356131:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1783074055.356132:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074055.356136:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.356138:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783074055.356143:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723493120:0@lo:253:kworker.0 00000100:00100000:2.0:1783074055.356147:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:87003:x1869685723493376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783074055.356181:0:87010:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783074055.356184:0:87010:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783074055.356187:0:87010:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1783074055.356192:0:87010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783074055.358386:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:87003:x1869685723493376:12345-0@lo:253:mount.lustre.0 Request processed in 2238us (10251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.358401:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493376:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783074055.358406:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:1.0:1783074055.358419:0:87003:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783074055.358423:0:87003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783074055.358425:0:87003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074055.358427:0:87003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074055.358428:0:87003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074055.358430:0:87003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074055.358431:0:87003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074055.358433:0:87003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074055.358444:0:87003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074055.358446:0:87003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074055.358447:0:87003:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783074055.358467:0:87003:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524e6a75000 from lustre-MDT0000 10000000:01000000:1.0:1783074055.358494:0:87003:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783074055.358497:0:87003:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074055.358505:0:87003:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9524e6a75000 10000000:01000000:1.0:1783074055.358510:0:87003:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783074055.358514:0:87003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9524e6a75000 10000000:01000000:1.0:1783074055.358517:0:87003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783074055.358520:0:87003:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524e6a75000 from 1 10000000:01000000:1.0:1783074055.358523:0:87003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074055.358553:0:87003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.358562:0:87003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.358571:0:87003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074055.358588:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074055.358621:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074055.358661:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be19c0 going to sleep for 11 seconds 20000000:01000000:3.0:1783074055.358727:0:87008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:2.0:1783074055.358795:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493504 00000100:00100000:2.0:1783074055.358801:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493504 00000100:00100000:2.0:1783074055.358840:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783074055.358847:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:87003:x1869685723493504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074055.358865:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074055.358878:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0868e00/0x5fb609b3016deb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016deb70 expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.358897:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0868e00/0x5fb609b3016deb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016deb70 expref: 7 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.358907:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0868e00/0x5fb609b3016deb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016deb70 expref: 7 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.358915:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868e00, rc 0) 00000100:00100000:2.0:1783074055.358942:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:87003:x1869685723493504:12345-0@lo:101:mount.lustre.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.358948:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783074055.359057:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074055.359081:0:87003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359090:0:87003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.359112:0:87003:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783074055.359126:0:87003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359133:0:87003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074055.359139:0:87003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074055.359143:0:87003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783074055.359147:0:87003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9524e6a75000 10000000:01000000:1.0:1783074055.359151:0:87003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783074055.359154:0:87003:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783074055.359156:0:87003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074055.359169:0:87003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359176:0:87003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359183:0:87003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074055.359193:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074055.359216:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074055.359226:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074055.359242:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493632 00000100:00100000:1.0:1783074055.359246:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493632 00000100:00100000:1.0:1783074055.359261:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783074055.359273:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+7:87003:x1869685723493632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074055.359280:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074055.359288:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016deb85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016deb7e expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359300:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016deb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016deb7e expref: 8 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359308:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016deb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016deb7e expref: 8 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359328:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bdc00, rc 0) 00000100:00100000:1.0:1783074055.359353:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87003:x1869685723493632:12345-0@lo:101:mount.lustre.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.359359:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783074055.359386:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074055.359396:0:87003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.359404:0:87003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074055.359444:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074055.359465:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074055.359476:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074055.359486:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493760 00000100:00100000:1.0:1783074055.359490:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493760 00000100:00100000:1.0:1783074055.359504:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783074055.359515:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87003:x1869685723493760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074055.359622:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723493760:12345-0@lo:501:mount.lustre.0 Request processed in 107us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.359630:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783074055.359656:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074055.359680:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074055.359715:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074055.359727:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074055.359738:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723493888 00000100:00100000:1.0:1783074055.359741:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723493888 20000000:01000000:3.0:1783074055.359831:0:87008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783074055.360135:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:3660:x1869685723493248:12345-0@lo:253:kworker.0 Request processed in 7012us (12163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.360160:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783074055.360168:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723493888:12345-0@lo:503:mount.lustre.0 00000020:01000004:2.0:1783074055.360377:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783074055.360380:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783074055.360381:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074055.360383:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074055.360384:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074055.360385:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074055.360386:0:3660:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074055.360388:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074055.360389:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074055.360392:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723493248:0@lo:253:kworker.0 20000000:01000000:0.0:1783074055.360682:0:87012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074055.360686:0:87012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074055.360761:0:87012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360772:0:87012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074055.360779:0:87012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000093574s 00010000:00010000:0.0:1783074055.360783:0:87012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360789:0:87012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360805:0:87012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360811:0:87012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360817:0:87012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074055.360821:0:87012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360828:0:87012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360839:0:87012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360845:0:87012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.360851:0:87012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144400/0x5fb609b3016deb8c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074055.360858:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723493888:12345-0@lo:503:mount.lustre.0 Request processed in 690us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.360908:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723493888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074055.361034:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783074055.361190:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783074055.361292:0:87014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87014:1869685723494016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074055.361366:0:87014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.361398:0:87014:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4947480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.361405:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494016 00000100:00100000:2.0:1783074055.361410:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494016 00000100:00100000:2.0:1783074055.361442:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783074055.361449:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87014:x1869685723494016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074055.361951:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87014:x1869685723494016:12345-0@lo:502:llog_process_th.0 Request processed in 501us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.361966:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783074055.361981:0:87014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87014:1869685723494016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074055.362056:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074055.362078:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.362086:0:87014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783074055.362092:0:87014:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783074055.362096:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074055.362110:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9524fab719c0) 00000020:00000080:0.0:1783074055.362129:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783074055.362135:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783074055.362212:0:87014:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783074055.362284:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016deb9a 00000020:00000080:0.0:1783074055.362511:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783074055.362515:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074055.362519:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.362521:0:87014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783074055.362523:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074055.362527:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.362528:0:87014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783074055.362531:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074055.362540:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9524f3da3380) 00000020:00000080:0.0:1783074055.362554:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783074055.362559:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783074055.362560:0:87014:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783074055.362563:0:87014:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783074055.362569:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783074055.362611:0:87014:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524e6a75000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783074055.362623:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9524f3da0000) 00000020:00000080:0.0:1783074055.362633:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783074055.362681:0:87014:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783074055.362687:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016debaf 00000020:00000080:0.0:1783074055.362786:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783074055.362792:0:87014:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783074055.362796:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb609b3016debb6 00080000:01000000:0.0:1783074055.362800:0:87014:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783074055.362804:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016debbd 00010000:00010000:0.0:1783074055.417466:0:87014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1783074055.417670:0:87014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0510a7c0-d9c1-4de9-a6c3-ede973deaaff idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:0.0:1783074055.417738:0:87014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:0.0:1783074055.417762:0:87014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:0.0:1783074055.417895:0:87014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1783074055.417960:0:87014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9523c456b900: xid 1869685708025088, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:0.0:1783074055.417983:0:87014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9523c456bb40: xid 1869685708024832, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:0.0:1783074055.418810:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9524f3da4d40) 00000020:00000080:0.0:1783074055.418828:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1783074055.418897:0:87014:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783074055.418904:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016debd9 00000020:00000080:0.0:1783074055.419374:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783074055.424460:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb609b3016debe0 00000020:00000080:1.0:1783074055.424785:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783074055.424797:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074055.424804:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074055.424807:0:87014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783074055.424811:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783074055.424814:0:87014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783074055.424816:0:87014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074055.424817:0:87014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074055.424818:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783074055.424821:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074055.424823:0:87014:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783074055.424826:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074055.424848:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074055.424849:0:87014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783074055.424855:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783074055.424897:0:87014:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783074055.424933:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074055.424937:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074055.424938:0:87014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783074055.424941:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074055.424944:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074055.424945:0:87014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783074055.424949:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783074055.424954:0:87014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:1.0:1783074055.424977:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074055.424990:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9524fb4db380) 00000020:00000080:1.0:1783074055.425009:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783074055.425015:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783074055.425153:0:87014:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783074055.425159:0:87014:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783074055.425166:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016debee 00010000:00080000:1.0:1783074055.425202:0:87014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c4b63800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1783074055.426921:0:87014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783074055.428792:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074055.428805:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783074055.428896:0:87014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074055.428921:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016debf5 00000100:00080000:2.0:1783074055.428930:0:87014:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074055.428935:0:87014:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9523c4b63800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074055.429002:0:87014:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df768380 x1869685723494144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074055.429026:0:87014:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783074055.429077:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723494144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074055.429165:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074055.429299:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074055.429305:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074055.429308:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074055.429328:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2891 00000100:00080000:3.0:1783074055.429332:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783074055.429338:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074055.429355:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efe680 x1869685723494272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074055.429759:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494144 00000100:00100000:1.0:1783074055.429759:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723494272:0@lo:38:kworker.0 00000100:00100000:2.0:1783074055.429767:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494144 00000100:00100000:1.0:1783074055.429795:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.429806:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:2.0:1783074055.429814:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723494144:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074055.429836:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494272 00010000:00080000:2.0:1783074055.429838:0:8454:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2894 last 0 00000100:00100000:1.0:1783074055.429841:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494272 00000100:00100000:1.0:1783074055.429869:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1783074055.429875:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723494272:12345-0@lo:38:kworker.0 00000020:00000080:2.0:1783074055.429885:0:8454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016debfc 00000004:00100000:2.0:1783074055.429901:0:8454:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783074055.429923:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723494272:12345-0@lo:38:kworker.0 Request processed in 47us (128us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783074055.429942:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00080000:1.0:1783074055.429981:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074055.429987:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074055.429992:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723494272:0@lo:38:kworker.0 00000100:00080000:2.0:1783074055.430012:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9523c2c2b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074055.430082:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723494144:12345-0@lo:38:llog_process_th.0 Request processed in 267us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.430090:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00100000:1.0:1783074055.430094:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783074055.430100:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1783074055.430106:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783074055.430110:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783074055.430112:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4b63800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783074055.430125:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723494144:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783074055.430154:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074055.430161:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074055.430163:0:87014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783074055.430168:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074055.430172:0:87014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1783074055.430175:0:87014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074055.430183:0:87014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074055.430185:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783074055.430190:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074055.430191:0:87014:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074055.430194:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783074055.430201:0:87014:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783074055.430205:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074055.430207:0:87014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783074055.430210:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074055.430214:0:87014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1783074055.430233:0:87014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783074055.430236:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074055.430247:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9523c2c33380) 00000100:00100000:0.0:1783074055.430260:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723494528:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1783074055.430266:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783074055.430273:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783074055.430335:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.430360:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494528 00000100:00100000:0.0:1783074055.430365:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494528 00000004:00080000:2.0:1783074055.430369:0:87014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783074055.430376:0:87014:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783074055.430385:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dec0a 00000100:00100000:1.0:1783074055.430410:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603 00000100:00100000:1.0:1783074055.430418:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723494528:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1783074055.430421:0:87014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c783d800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000004:00000024:1.0:1783074055.430441:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074055.430484:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723494528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.430491:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603 00000100:00100000:0.0:1783074055.430521:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723494528:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783074055.430930:0:87014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:3.0:1783074055.431548:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074055.431553:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074055.431555:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074055.431560:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2891 00000100:00080000:3.0:1783074055.431564:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783074055.431569:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074055.431590:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efd180 x1869685723494656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074055.431625:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074055.431629:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074055.431636:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074055.431640:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2891 00000100:00080000:3.0:1783074055.431642:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783074055.431646:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074055.431661:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efe300 x1869685723494912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074055.431663:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723494784:0@lo:400:kworker.0 00000100:00080000:3.0:1783074055.431696:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074055.431700:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783074055.431703:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074055.431704:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074055.431710:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2891 00000100:00080000:3.0:1783074055.431713:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783074055.431717:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074055.431729:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efdc00 x1869685723495296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074055.431742:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723494656:0@lo:38:kworker.0 00000100:00100000:1.0:1783074055.431767:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074055.431784:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723494912:0@lo:38:kworker.0 00000100:00100000:1.0:1783074055.431806:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.431821:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723495040:0@lo:400:kworker.0 00000100:00100000:1.0:1783074055.431837:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723495296:0@lo:38:kworker.0 00000100:00100000:1.0:1783074055.431870:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.431930:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494912 00000100:00100000:3.0:1783074055.431937:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494912 00000100:00100000:0.0:1783074055.432096:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.432120:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783074055.432133:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723494400:0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.432951:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494784 00000100:00100000:1.0:1783074055.432952:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494656 00000100:00100000:2.0:1783074055.432958:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494784 00000100:00100000:1.0:1783074055.432958:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494656 00000100:00100000:0.0:1783074055.432964:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495296 00000100:00100000:0.0:1783074055.432969:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495296 00000100:00100000:1.0:1783074055.432995:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1783074055.433003:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1783074055.433007:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723494784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.433017:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723494656:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074055.433017:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1783074055.433022:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723495296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074055.433135:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723495296:12345-0@lo:38:kworker.0 Request processed in 111us (1263us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783074055.433142:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1783074055.433168:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604 00000100:00100000:0.0:1783074055.433172:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495040 00000100:00100000:3.0:1783074055.433173:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723494912:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074055.433176:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495040 00000100:00100000:0.0:1783074055.433202:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:0.0:1783074055.433209:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723495040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074055.433241:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723495040:12345-0@lo:400:kworker.0 Request processed in 33us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.433247:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:1.0:1783074055.433348:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723494784:12345-0@lo:400:kworker.0 Request processed in 344us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.433356:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1783074055.433392:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723494784:0@lo:400:kworker.0 00000100:00100000:0.0:1783074055.433450:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.433471:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723495168:0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.433548:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723494656:12345-0@lo:38:kworker.0 Request processed in 531us (1779us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074055.433555:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1783074055.433565:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.433567:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723494400 00000100:00100000:2.0:1783074055.433570:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723494400 00000100:00100000:0.0:1783074055.433593:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723495040:0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.433598:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1783074055.433604:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723494400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074055.433614:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495168 00000100:00100000:0.0:1783074055.433617:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495168 00000100:00100000:0.0:1783074055.433643:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1783074055.433644:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723494400:12345-0@lo:400:kworker.0 Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.433648:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723495168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074055.433650:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:2.0:1783074055.433667:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074055.433671:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074055.433673:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074055.433677:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723495168:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.433683:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1783074055.433725:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723494400:0@lo:400:kworker.0 00000100:00100000:0.0:1783074055.433736:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723495168:0@lo:400:kworker.0 00000100:00080000:1.0:1783074055.433920:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074055.433940:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074055.433945:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723495296:0@lo:38:kworker.0 00000100:00080000:1.0:1783074055.433960:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074055.433963:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783074055.433968:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723494912:12345-0@lo:38:kworker.0 Request processed in 792us (2160us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074055.433976:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604 00000100:00100000:1.0:1783074055.434301:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723494656:0@lo:38:kworker.0 00000040:01000000:2.0:1783074055.434339:0:87014:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783074055.434363:0:87014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1783074055.434365:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074055.434371:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074055.434374:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723494912:0@lo:38:kworker.0 00000040:00080000:2.0:1783074055.434439:0:87014:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1783074055.435402:0:87014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074055.435427:0:87014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:2.0:1783074055.438566:0:87014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:1.0:1783074055.439020:0:87020:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1783074055.439026:0:87020:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783074055.439205:0:87020:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1783074055.439225:0:87020:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783074055.439374:0:87020:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1783074055.439378:0:87020:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783074055.440519:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074055.440530:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074055.440569:0:87014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783074055.440588:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dec11 00000100:00080000:2.0:1783074055.440596:0:87014:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074055.440600:0:87014:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9524c783d800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074055.440627:0:87014:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df76bb80 x1869685723495424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074055.440670:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723495424:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783074055.440735:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074055.440795:0:87014:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1783074055.440807:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495424 00000100:00100000:3.0:1783074055.440814:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495424 00000100:00100000:3.0:1783074055.440847:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881 00000100:00100000:3.0:1783074055.440854:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3657:x1869685723495424:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783074055.440877:0:26170:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2894 last 0 00000020:01000000:2.0:1783074055.440891:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074055.440894:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074055.440896:0:87014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783074055.440899:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074055.440901:0:87014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783074055.440902:0:87014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074055.440904:0:87014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074055.440905:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783074055.440906:0:26170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dec18 00000020:00000080:2.0:1783074055.440907:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074055.440913:0:87014:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074055.440916:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00002000:00100000:3.0:1783074055.440918:0:26170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9523c2e03800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:01000004:2.0:1783074055.440920:0:87014:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00002000:00080000:3.0:1783074055.440922:0:26170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000020:00000080:2.0:1783074055.440923:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00002000:00100000:3.0:1783074055.440924:0:26170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:2.0:1783074055.440924:0:87014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783074055.440927:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074055.440931:0:87014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1783074055.440948:0:87014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783074055.440951:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074055.440961:0:87014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9523c2c319c0) 00000020:00000080:2.0:1783074055.440974:0:87014:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1783074055.440979:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00002000:00080000:3.0:1783074055.440981:0:26170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783074055.441003:0:26170:0:(import.c:65:import_set_state_nolock()) ffff9524d2eac800 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1783074055.441032:0:87014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783074055.441036:0:87014:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783074055.441041:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dec26 00010000:00080000:2.0:1783074055.441158:0:87014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524f0831000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1783074055.441364:0:87014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1783074055.441420:0:87014:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783074055.441432:0:87014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783074055.441508:0:87014:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:3.0:1783074055.441636:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723495424:12345-0@lo:8:llog_process_th.0 Request processed in 780us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074055.441644:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881 00000100:00100000:1.0:1783074055.441989:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783074055.441998:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783074055.442005:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783074055.442009:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783074055.442011:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c783d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783074055.442022:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783074055.442027:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723495424:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1783074055.442062:0:87020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783074055.442109:0:87020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2894659797636ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783074055.442115:0:87020:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783074055.443104:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074055.443117:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723495552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074055.443218:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.443289:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495552 00000100:00100000:3.0:1783074055.443295:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495552 00000100:00100000:3.0:1783074055.443520:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1783074055.443529:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723495552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074055.443554:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074055.443599:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723495552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074055.443606:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1783074055.443644:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723495552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783074055.443669:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1783074055.443894:0:87014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074055.443934:0:87014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:0.0:1783074055.444100:0:87014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000004:00080000:0.0:1783074055.444291:0:87004:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1783074055.444536:0:87022:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1783074055.444540:0:87022:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074055.444656:0:87022:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1783074055.444671:0:87022:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074055.444772:0:87022:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1783074055.444781:0:87022:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783074055.445763:0:87014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074055.445775:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783074055.445816:0:87014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783074055.445912:0:87014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dec2d 00000100:00080000:3.0:1783074055.445922:0:87014:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783074055.445927:0:87014:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9524f0831000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074055.445956:0:87014:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efc380 x1869685723495680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074055.446005:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723495680:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783074055.446061:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074055.446154:0:87014:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783074055.446213:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074055.446217:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074055.446219:0:87014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783074055.446222:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074055.446226:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074055.446227:0:87014:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783074055.446231:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783074055.446232:0:87014:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783074055.446234:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074055.446236:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074055.446238:0:87014:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783074055.446240:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074055.446242:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074055.446243:0:87014:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783074055.446247:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783074055.446273:0:87014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87014:1869685723495808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074055.446336:0:87014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.446374:0:87014:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.446517:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495680 00000100:00100000:0.0:1783074055.446524:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495680 00000100:00100000:0.0:1783074055.446589:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4882 00000100:00100000:0.0:1783074055.446602:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3657:x1869685723495680:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783074055.446627:0:26177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2894 last 0 00000020:00000080:0.0:1783074055.446648:0:26177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dec34 00002000:00100000:0.0:1783074055.446661:0:26177:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9523c6940000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783074055.446665:0:26177:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783074055.446667:0:26177:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783074055.446725:0:26177:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074055.446744:0:26177:0:(import.c:65:import_set_state_nolock()) ffff9523c6943800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074055.446933:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723495680:12345-0@lo:8:llog_process_th.0 Request processed in 329us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.446940:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4882 00000100:00100000:1.0:1783074055.446995:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783074055.447003:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783074055.447010:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783074055.447014:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783074055.447017:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0831000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783074055.447071:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783074055.447077:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723495680:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783074055.447104:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495808 00000100:00100000:1.0:1783074055.447107:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495808 00000100:00100000:1.0:1783074055.447141:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783074055.447148:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87014:x1869685723495808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074055.447242:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87014:x1869685723495808:12345-0@lo:502:llog_process_th.0 Request processed in 94us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.447259:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783074055.447301:0:87014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87014:1869685723495808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074055.447344:0:87014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074055.447350:0:87014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074055.447351:0:87014:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783074055.447356:0:87014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:3.0:1783074055.447500:0:87022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783074055.447545:0:87022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2894665232904ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783074055.447551:0:87022:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1783074055.447929:0:87003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783074055.447955:0:87003:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783074055.447978:0:87003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.447989:0:87003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074055.447996:0:87003:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524e6a75000 from 1 10000000:01000000:2.0:1783074055.447999:0:87003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783074055.448026:0:87003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.448040:0:87003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.448050:0:87003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074055.448075:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723495936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074055.448110:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.448136:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cabe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.448262:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074055.448272:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723496064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074055.448306:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.448348:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496064 00000100:00100000:1.0:1783074055.448350:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723495936 00000100:00100000:0.0:1783074055.448352:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496064 00000100:00100000:1.0:1783074055.448353:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723495936 00000100:00100000:1.0:1783074055.448376:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783074055.448382:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:87003:x1869685723495936:12345-0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783074055.448383:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:0.0:1783074055.448389:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723496064:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783074055.448392:0:87008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074055.448404:0:87008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dec3b expref: -99 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1783074055.448408:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1783074055.448423:0:87008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 9 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.448434:0:87008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 9 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074055.448440:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723496064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074055.448442:0:87008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc400, rc 0) 00000100:00100000:0.0:1783074055.448446:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1783074055.448466:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723495936:12345-0@lo:101:mount.lustre.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.448473:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783074055.448477:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723496064:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783074055.448531:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074055.448565:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723495936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074055.448576:0:87003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.448584:0:87003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.449195:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496192:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783074055.449232:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.449285:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.449443:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496192 00000100:00100000:0.0:1783074055.449448:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496192 00000100:00100000:0.0:1783074055.449478:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783074055.449490:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723496192:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783074055.449504:0:87011:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783074055.449516:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783074055.449520:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783074055.449523:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783074055.449525:0:87011:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 110 00000100:00100000:0.0:1783074055.449591:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723496192:12345-0@lo:256:mount.lustre.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.449597:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783074055.449718:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496192:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783074055.450450:0:87003:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783074055.450468:0:87003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.450477:0:87003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074055.450484:0:87003:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524e6a75000 from 1 10000000:01000000:3.0:1783074055.450487:0:87003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074055.450509:0:87003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.450517:0:87003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.450525:0:87003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.450549:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074055.450579:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.450610:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074055.450674:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496320 00000100:00100000:1.0:1783074055.450680:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496320 00000100:00100000:1.0:1783074055.450716:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783074055.450723:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:87003:x1869685723496320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074055.450738:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074055.450749:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dec50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dec49 expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.450768:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dec50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dec49 expref: 10 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.450777:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dec50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec49 expref: 10 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074055.450786:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd600, rc 0) 00000100:00100000:1.0:1783074055.450822:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87003:x1869685723496320:12345-0@lo:101:mount.lustre.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.450829:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:2.0:1783074055.450950:0:87004:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783074055.450983:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074055.450995:0:87003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.451003:0:87003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.451046:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783074055.451116:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.451174:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074055.451197:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496448 00000100:00100000:1.0:1783074055.451200:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496448 00000100:00100000:1.0:1783074055.451222:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783074055.451228:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87003:x1869685723496448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074055.451454:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87003:x1869685723496448:12345-0@lo:501:mount.lustre.0 Request processed in 225us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.451461:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783074055.451502:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783074055.451528:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074055.451565:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.451628:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.451658:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496576 00000100:00100000:0.0:1783074055.451662:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496576 00000100:00100000:0.0:1783074055.451694:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783074055.451701:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87003:x1869685723496576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074055.451815:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87003:x1869685723496576:12345-0@lo:503:mount.lustre.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.451823:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783074055.451938:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074055.452228:0:87024:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87024:1869685723496704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074055.452262:0:87024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.452307:0:87024:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c57d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074055.452437:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496704 00000100:00100000:1.0:1783074055.452442:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496704 00000100:00100000:1.0:1783074055.452474:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783074055.452480:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87024:x1869685723496704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074055.452797:0:87024:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87024:1869685723496704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074055.452799:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87024:x1869685723496704:12345-0@lo:502:llog_process_th.0 Request processed in 319us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074055.452815:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:0.0:1783074055.452818:0:87024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074055.452825:0:87024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.452827:0:87024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783074055.452834:0:87024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524e6a75000 00000020:00000080:0.0:1783074055.452837:0:87024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783074055.452914:0:87024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074055.452918:0:87024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.452925:0:87024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783074055.452929:0:87024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074055.452932:0:87024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.452933:0:87024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783074055.452936:0:87024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524e6a75000 00000020:00000080:0.0:1783074055.452938:0:87024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783074055.453010:0:87024:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87024:1869685723496832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074055.453043:0:87024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.453083:0:87024:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c57d6240 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.453381:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496832 00000100:00100000:2.0:1783074055.453384:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496832 00000100:00100000:2.0:1783074055.453410:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783074055.453417:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87024:x1869685723496832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074055.453498:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87024:x1869685723496832:12345-0@lo:502:llog_process_th.0 Request processed in 81us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.453505:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783074055.453564:0:87024:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87024:1869685723496832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074055.453578:0:87024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074055.453581:0:87024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074055.453582:0:87024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783074055.453585:0:87024:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783074055.453654:0:87003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783074055.453675:0:87003:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783074055.453692:0:87003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.453702:0:87003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074055.453775:0:87003:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783074055.453778:0:87003:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9524e6a75000 10000000:01000000:3.0:1783074055.453781:0:87003:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9524e6a75000 10000000:01000000:3.0:1783074055.453784:0:87003:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783074055.453789:0:87003:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524e6a75000 from 1 10000000:01000000:3.0:1783074055.453791:0:87003:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074055.453812:0:87003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.453819:0:87003:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074055.453827:0:87003:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074055.453839:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074055.453867:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.453905:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.453919:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723496960 00000100:00100000:0.0:1783074055.453923:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723496960 00000100:00100000:0.0:1783074055.453949:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783074055.453956:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:87003:x1869685723496960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074055.453963:0:87008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074055.453974:0:87008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4145400/0x5fb609b3016dec5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dec57 expref: -99 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.453994:0:87008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145400/0x5fb609b3016dec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dec57 expref: 11 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.454003:0:87008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4145400/0x5fb609b3016dec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec57 expref: 11 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.454012:0:87008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145400, rc 0) 00000100:00100000:0.0:1783074055.454041:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723496960:12345-0@lo:101:mount.lustre.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.454052:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783074055.454095:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723496960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074055.454108:0:87003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.454117:0:87003:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074055.454161:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723497088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074055.454184:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.454197:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c57d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.454212:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497088 00000100:00100000:2.0:1783074055.454216:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497088 00000100:00100000:2.0:1783074055.454243:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783074055.454248:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723497088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074055.454362:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723497088:12345-0@lo:501:mount.lustre.0 Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.454368:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783074055.454933:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723497088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074055.454960:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723497216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074055.455002:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.455033:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c57d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.455085:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497216 00000100:00100000:2.0:1783074055.455089:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497216 00000100:00100000:2.0:1783074055.455153:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783074055.455160:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723497216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074055.455241:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723497216:12345-0@lo:503:mount.lustre.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.455247:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783074055.455337:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723497216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074055.456246:0:87025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87025:1869685723497344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074055.456285:0:87025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.456343:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497344 00000100:00100000:2.0:1783074055.456347:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497344 00000100:00100000:3.0:1783074055.456348:0:87025:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.456372:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783074055.456380:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87025:x1869685723497344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074055.456464:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87025:x1869685723497344:12345-0@lo:502:llog_process_th.0 Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.456470:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783074055.456697:0:87025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87025:1869685723497344:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783074055.456746:0:87025:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783074055.456823:0:87025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9524fa8619c0) 00000020:00000080:3.0:1783074055.456846:0:87025:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1783074055.457103:0:87025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524e6a75000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783074055.457107:0:87025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524e6a75000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783074055.457110:0:87025:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524e6a75000 4 00010000:00080000:3.0:1783074055.457136:0:87025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524de7c7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1783074055.458772:0:87025:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1783074055.458867:0:87025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783074055.458914:0:87025:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783074055.458926:0:87025:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb609b3016dec6c 00000100:00080000:3.0:1783074055.458936:0:87025:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783074055.458940:0:87025:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524de7c7000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074055.458972:0:87025:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efed80 x1869685723497472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074055.459001:0:87025:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783074055.459158:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723497472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074055.459217:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.459476:0:87025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87025:1869685723497600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074055.459519:0:87025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.459545:0:87025:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68dfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.459591:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497600 00000100:00100000:2.0:1783074055.459598:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497600 00000100:00100000:2.0:1783074055.459671:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783074055.459681:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87025:x1869685723497600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074055.459785:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87025:x1869685723497600:12345-0@lo:502:llog_process_th.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.459792:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783074055.459980:0:87025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87025:1869685723497600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074055.460022:0:87025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87025:1869685723497728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074055.460056:0:87025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.460114:0:87025:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.460148:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497728 00000100:00100000:0.0:1783074055.460152:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497728 00000100:00100000:0.0:1783074055.460215:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783074055.460223:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87025:x1869685723497728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074055.460303:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87025:x1869685723497728:12345-0@lo:502:llog_process_th.0 Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.460331:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783074055.460362:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497472 00000100:00100000:1.0:1783074055.460368:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497472 00000100:00100000:2.0:1783074055.460407:0:87025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:87025:1869685723497728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074055.460409:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1783074055.460420:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723497472:12345-0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783074055.460434:0:87025:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1783074055.460472:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723497472:12345-0@lo:38:llog_process_th.0 Request processed in 51us (1253us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783074055.460479:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000020:01000000:0.0:1783074055.460562:0:87003:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783074055.460587:0:87003:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074055.460639:0:87003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.460649:0:87003:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783074055.460696:0:87003:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783074055.460698:0:87003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783074055.460700:0:87003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074055.460701:0:87003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074055.460702:0:87003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074055.460703:0:87003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074055.460704:0:87003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074055.460705:0:87003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783074055.460707:0:87003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074055.460708:0:87003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783074055.460711:0:87003:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783074055.460714:0:87003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783074055.460715:0:87003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783074055.460716:0:87003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074055.460718:0:87003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074055.460719:0:87003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074055.460720:0:87003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074055.460721:0:87003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074055.460722:0:87003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783074055.460723:0:87003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074055.460724:0:87003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783074055.460738:0:87003:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783074055.460748:0:87003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723497856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783074055.460786:0:87003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.460806:0:87003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68df540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.460830:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783074055.460836:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524de7c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074055.460910:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783074055.460914:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723497472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074055.460956:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497856 00000100:00100000:2.0:1783074055.460962:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497856 00000100:00100000:2.0:1783074055.461023:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783074055.461030:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723497856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783074055.461049:0:87008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783074055.461072:0:87008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783074055.462208:0:87008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783074055.462222:0:87008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783074055.462245:0:87012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074055.462250:0:87012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074055.462268:0:87012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.462281:0:87012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 11 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.462287:0:87012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.462325:0:87012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 11 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.462375:0:87012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 11 pid: 87008 timeout: 2994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074055.462388:0:87012:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87012:1869685723497984:0@lo:104: 00000100:00100000:0.0:1783074055.462432:0:87012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.462484:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:87003:x1869685723497856:12345-0@lo:253:mount.lustre.0 Request processed in 1453us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.462493:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783074055.462534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723497984 00000100:00100000:2.0:1783074055.462539:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723497984 00000100:00100000:0.0:1783074055.462573:0:87012:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68dfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074055.462579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783074055.462588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:87012:x1869685723497984:12345-0@lo:104: 00010000:00010000:2.0:1783074055.462600:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.462656:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783074055.462663:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:87012:x1869685723497984:12345-0@lo:104: Request processed in 77us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.462669:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:2.0:1783074055.462690:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074055.462695:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.462703:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074055.462707:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.462725:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074055.462733:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074055.462739:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074055.462763:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.462770:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074055.462785:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.462793:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868c00/0x5fb609b3016dec3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dec42 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.462809:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074055.462811:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074055.462813:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074055.462824:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723498112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074055.462928:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074055.462974:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498112 00000100:00100000:2.0:1783074055.462978:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498112 00010000:00010000:2.0:1783074055.462992:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 11 pid: 87008 timeout: 2994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074055.463014:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1783074055.463019:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3660:x1869685723498112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074055.463037:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074055.463044:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 11 pid: 87008 timeout: 2994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463054:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 11 pid: 87008 timeout: 2994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463082:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463091:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074055.463104:0:19654:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000854728s 00010000:00010000:2.0:1783074055.463108:0:19654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463116:0:19654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463122:0:19654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463128:0:19654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463133:0:19654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074055.463137:0:19654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463143:0:19654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463159:0:19654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074055.463168:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074055.463199:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3660:x1869685723498112:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074055.463206:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1783074055.463243:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723498112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074055.463285:0:87003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:87003:1869685723497856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783074055.463295:0:87003:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783074055.463298:0:87003:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783074055.463300:0:87003:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074055.463301:0:87003:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074055.463303:0:87003:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074055.463304:0:87003:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074055.463305:0:87003:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074055.463307:0:87003:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074055.463308:0:87003:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074055.463334:0:87003:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074055.463335:0:87003:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783074055.463349:0:87003:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783074055.464012:0:87012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc400/0x5fb609b3016dec42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dec3b expref: 10 pid: 87008 timeout: 2994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074055.464023:0:87012:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87012:1869685723497984:0@lo:104: 00010000:00010000:0.0:1783074055.464042:0:87012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.464050:0:87012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.464057:0:87012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074055.464074:0:87012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144c00/0x5fb609b3016dec73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783074055.469287:0:87003:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:0.0:1783074055.469890:0:87003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783074055.470139:0:87032:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:3.0:1783074055.470144:0:87032:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:2.0:1783074055.470413:0:87033:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783074055.470670:0:87003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783074055.471061:0:87033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783074055.472383:0:87034:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87034:1869685723498240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074055.472512:0:87034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.472560:0:87034:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498600 going to sleep for 11 seconds 00000040:01000000:1.0:1783074055.472723:0:87003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783074055.472758:0:87003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783074055.472903:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498240 00000100:00100000:0.0:1783074055.472910:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498240 00000100:00100000:0.0:1783074055.472953:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:0.0:1783074055.472962:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87034:x1869685723498240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074055.473042:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87034:x1869685723498240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.473049:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:3.0:1783074055.473919:0:87034:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87034:1869685723498240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783074055.473956:0:87034:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783074055.473987:0:87034:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87034:1869685723498368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074055.474024:0:87034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.474076:0:87034:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074055.474109:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498368 00000100:00100000:3.0:1783074055.474113:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498368 00000100:00100000:3.0:1783074055.474150:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606 00000100:00100000:3.0:1783074055.474159:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87034:x1869685723498368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074055.474282:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87034:x1869685723498368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 124us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074055.474289:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606 00000100:00100000:3.0:1783074055.474450:0:87034:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87034:1869685723498368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074055.474505:0:87034:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87034:1869685723498496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074055.474529:0:87034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.474550:0:87034:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074055.474719:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498496 00000100:00100000:0.0:1783074055.474723:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498496 00000100:00100000:0.0:1783074055.474746:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:0.0:1783074055.474752:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87034:x1869685723498496:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074055.474804:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87034:x1869685723498496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.474811:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:3.0:1783074055.474852:0:87034:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87034:1869685723498496:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783074055.474881:0:87034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783074055.477815:0:87003:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783074055.477832:0:87003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783074055.477918:0:87003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074055.482355:0:87033:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783074055.482447:0:87033:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1783074055.485354:0:87034:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783074055.485431:0:87034:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783074055.485436:0:87034:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1783074055.485489:0:87003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783074055.486283:0:87003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783074055.486336:0:87003:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783074055.486450:0:87003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783074055.486871:0:87003:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:1.0:1783074055.489267:0:87003:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:2.0:1783074055.490405:0:87035:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87035 00010000:02000000:2.0:1783074055.490424:0:87035:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1783074055.490427:0:87035:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783074055.490431:0:87035:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1783074055.490580:0:87003:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783074055.490596:0:87003:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783074055.490612:0:87003:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783074055.490623:0:87003:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783074055.491581:0:87003:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783074055.491818:0:87003:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783074055.598481:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074055.598549:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723498624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074055.598617:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074055.598636:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074055.598646:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723498752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074055.598675:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074055.598690:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498624 00000100:00100000:3.0:1783074055.598696:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498624 00000100:00100000:0.0:1783074055.598705:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498752 00000100:00100000:0.0:1783074055.598708:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498752 00000100:00100000:3.0:1783074055.598753:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:3.0:1783074055.598762:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723498752:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074055.598762:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1783074055.598768:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723498624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074055.598788:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074055.598831:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723498624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074055.598844:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:2.0:1783074055.599047:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723498624:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074055.599056:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074055.599137:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723498752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074055.599144:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723498752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 381us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074055.599152:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00010000:00010000:0.0:1783074055.790558:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783074056.690113:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783074056.690119:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524e6a75000 from 111 10000000:01000000:3.0:1783074056.690124:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783074056.690173:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.690183:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.690194:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.690217:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723498880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.690281:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.690376:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723498880 00000100:00100000:0.0:1783074056.690384:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723498880 00000100:00100000:0.0:1783074056.690441:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783074056.690450:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.690453:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:6527:x1869685723498880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.690470:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074056.690485:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4145c00/0x5fb609b3016dec81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dec7a expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.690509:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145c00/0x5fb609b3016dec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dec7a expref: 11 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.690520:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4145c00/0x5fb609b3016dec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec7a expref: 11 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.690528:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145c00, rc 0) 00000100:00100000:0.0:1783074056.690579:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723498880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.690587:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783074056.690665:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723498880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.690681:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.690690:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.690733:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.690775:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.690815:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.691074:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499008 00000100:00100000:0.0:1783074056.691079:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499008 00000100:00100000:0.0:1783074056.691112:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783074056.691120:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723499008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783074056.691134:0:87008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783074056.691148:0:87008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783074056.691152:0:87008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 111 00000100:00100000:0.0:1783074056.691233:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723499008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.691240:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783074056.691489:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783074056.691536:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783074056.691544:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.691552:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.691566:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783074056.691567:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 52 10000000:01000000:3.0:1783074056.691570:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074056.691584:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.691591:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.691598:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.691610:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.691634:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.691673:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.692071:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499136 00000100:00100000:1.0:1783074056.692076:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499136 00000100:00100000:1.0:1783074056.692109:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783074056.692116:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fa9cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723499136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.692123:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074056.692137:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc600/0x5fb609b3016dec8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dec88 expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.692153:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc600/0x5fb609b3016dec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dec88 expref: 12 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.692162:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc600/0x5fb609b3016dec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec88 expref: 12 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.692170:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc600, rc 0) 00000100:00100000:1.0:1783074056.692195:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fa9cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723499136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.692201:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783074056.692572:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.692588:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.692598:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.692654:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.692686:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.692727:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.693070:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499264 00000100:00100000:1.0:1783074056.693075:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499264 00000100:00100000:1.0:1783074056.693104:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783074056.693110:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723499264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.693215:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723499264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.693221:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783074056.694210:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.694248:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.694302:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.694362:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499392 00000100:00100000:3.0:1783074056.694364:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.694368:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499392 00000100:00100000:0.0:1783074056.694400:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783074056.694407:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723499392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.694497:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723499392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.694504:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783074056.694547:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074056.695619:0:87165:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783074056.695868:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783074056.695897:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074056.695906:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.695916:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.695935:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783074056.695938:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 108 10000000:01000000:3.0:1783074056.695941:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783074056.695966:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.695974:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.695987:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.696004:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.696064:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.696114:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.696151:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499520 00000100:00100000:0.0:1783074056.696157:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499520 00000100:00100000:0.0:1783074056.696193:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783074056.696200:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723499520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.696209:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074056.696220:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4145000/0x5fb609b3016dec9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dec96 expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.696252:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145000/0x5fb609b3016dec9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dec96 expref: 13 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.696262:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4145000/0x5fb609b3016dec9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dec96 expref: 13 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.696271:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145000, rc 0) 00000100:00100000:0.0:1783074056.696327:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723499520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.696334:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783074056.697475:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.697490:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.697500:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074056.697551:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.697591:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074056.697611:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3206780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.697659:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499648 00000100:00100000:0.0:1783074056.697664:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499648 00000100:00100000:0.0:1783074056.697696:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783074056.697704:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723499648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783074056.697717:0:87010:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783074056.697731:0:87010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783074056.697735:0:87010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783074056.697738:0:87010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783074056.697741:0:87010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783074056.697743:0:87010:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:0.0:1783074056.697812:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723499648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.697819:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783074056.698146:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783074056.698229:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783074056.698240:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.698249:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.698257:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783074056.698260:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783074056.698262:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783074056.698279:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.698286:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.698294:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.698306:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.698353:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.698389:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.698466:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499776 00000100:00100000:0.0:1783074056.698470:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499776 00000100:00100000:0.0:1783074056.698503:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783074056.698510:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723499776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.698525:0:87008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074056.698535:0:87008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4145600/0x5fb609b3016decab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016deca4 expref: -99 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.698553:0:87008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145600/0x5fb609b3016decab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016deca4 expref: 14 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.698562:0:87008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4145600/0x5fb609b3016decab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016deca4 expref: 14 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.698570:0:87008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145600, rc 0) 00000100:00100000:0.0:1783074056.698601:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723499776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.698607:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783074056.698637:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.698647:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.698655:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074056.698703:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.698727:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.698742:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c4c793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074056.698829:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723499904 00000100:00100000:3.0:1783074056.698834:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723499904 00000100:00100000:3.0:1783074056.698869:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783074056.698877:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723499904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.699002:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723499904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074056.699010:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783074056.699104:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723499904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.699182:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.699221:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.699240:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c4c793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.699293:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500032 00000100:00100000:2.0:1783074056.699298:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500032 00000100:00100000:2.0:1783074056.699345:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783074056.699354:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723500032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.699846:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723500032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 492us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.699854:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783074056.699870:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074056.701732:0:87166:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1783074056.701827:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1783074056.701868:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783074056.701878:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.701888:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074056.701918:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783074056.701922:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9523c6b72800 from 1 10000000:01000000:2.0:1783074056.701926:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783074056.701953:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.701963:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.701973:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074056.701992:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.702097:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.702151:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500160 00000100:00100000:3.0:1783074056.702158:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500160 00000100:00100000:3.0:1783074056.702208:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783074056.702225:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723500160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.702236:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074056.702252:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c4b25600/0x5fb609b3016decb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016decb2 expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.702273:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c4b25600/0x5fb609b3016decb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016decb2 expref: 15 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.702284:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c4b25600/0x5fb609b3016decb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016decb2 expref: 15 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.702292:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25600, rc 0) 00000100:00100000:3.0:1783074056.702356:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723500160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074056.702364:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783074056.702903:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.702927:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074056.702940:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.702950:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074056.702972:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783074056.702977:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.702984:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074056.702991:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783074056.702994:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c6b72800 from 7 10000000:01000000:2.0:1783074056.702996:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074056.703010:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.703017:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.703024:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074056.703048:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.703077:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.703101:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.703115:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500288 00000100:00100000:2.0:1783074056.703119:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500288 00000100:00100000:2.0:1783074056.703147:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783074056.703155:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723500288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074056.703163:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074056.703171:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0869200/0x5fb609b3016decc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016decc0 expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.703194:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0869200/0x5fb609b3016decc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016decc0 expref: 16 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.703201:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0869200/0x5fb609b3016decc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016decc0 expref: 16 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.703208:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869200, rc 0) 00000100:00100000:2.0:1783074056.703240:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723500288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.703245:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783074056.703277:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074056.703287:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.703294:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074056.703362:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.703386:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.703400:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.703412:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500416 00000100:00100000:2.0:1783074056.703415:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500416 00000100:00100000:2.0:1783074056.703438:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783074056.703446:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723500416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.703547:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723500416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.703563:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783074056.703597:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.703625:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.703665:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.703680:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.703692:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500544 00000100:00100000:2.0:1783074056.703696:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500544 00000100:00100000:2.0:1783074056.703726:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783074056.703732:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723500544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.703798:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723500544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.703804:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783074056.703838:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074056.704484:0:87167:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783074056.704530:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783074056.704545:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783074056.704551:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704559:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074056.704566:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783074056.704568:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 52 10000000:01000000:2.0:1783074056.704570:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783074056.704587:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704603:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704611:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074056.704624:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.704653:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.704667:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.704679:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500672 00000100:00100000:2.0:1783074056.704683:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500672 00000100:00100000:2.0:1783074056.704701:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783074056.704707:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723500672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074056.704714:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074056.704723:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0869a00/0x5fb609b3016decd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016decce expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704738:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0869a00/0x5fb609b3016decd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016decce expref: 17 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704747:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0869a00/0x5fb609b3016decd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016decce expref: 17 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704754:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869a00, rc 0) 00000100:00100000:2.0:1783074056.704781:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723500672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.704787:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783074056.704823:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074056.704835:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.704843:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074056.704878:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.704902:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.704914:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.704925:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500800 00000100:00100000:2.0:1783074056.704928:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500800 00000100:00100000:2.0:1783074056.704944:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783074056.704950:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723500800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.705026:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723500800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.705032:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783074056.705072:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.705093:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.705135:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.705158:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.705170:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723500928 00000100:00100000:2.0:1783074056.705173:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723500928 00000100:00100000:2.0:1783074056.705189:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783074056.705193:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723500928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.705261:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723500928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074056.705275:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783074056.705340:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723500928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074056.705958:0:87168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783074056.705998:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783074056.706016:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074056.706023:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.706031:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074056.706207:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783074056.706210:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783074056.706213:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074056.706230:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.706239:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.706247:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074056.706261:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.706291:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.706632:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3575c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.706711:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501056 00000100:00100000:0.0:1783074056.706717:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501056 00000100:00100000:0.0:1783074056.707869:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783074056.707882:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723501056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.707895:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074056.707910:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4144600/0x5fb609b3016dece3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016decdc expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.707931:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144600/0x5fb609b3016dece3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016decdc expref: 18 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.707942:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4144600/0x5fb609b3016dece3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016decdc expref: 18 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.707952:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144600, rc 0) 00000100:00100000:0.0:1783074056.708009:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723501056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.708017:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783074056.708153:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.708168:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.708181:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.708240:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.708271:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.708380:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c62bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.713422:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501184 00000100:00100000:0.0:1783074056.713435:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501184 00000100:00100000:0.0:1783074056.713520:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783074056.713532:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723501184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.713714:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723501184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (5441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.713722:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783074056.715194:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.715249:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.715299:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.715373:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c62bf540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074056.716030:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501312 00000100:00100000:2.0:1783074056.716036:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501312 00000100:00100000:2.0:1783074056.716098:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783074056.716109:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723501312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.717020:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723501312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 912us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.717037:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783074056.717136:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074056.718213:0:87174:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783074056.718357:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783074056.718385:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783074056.718402:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.718413:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.718422:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783074056.718425:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49f9000 from 7 10000000:01000000:3.0:1783074056.718428:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074056.718459:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.718467:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.718486:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.718506:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.718546:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.718641:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3a00840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.719156:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501440 00000100:00100000:0.0:1783074056.719163:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501440 00000100:00100000:0.0:1783074056.719209:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783074056.719217:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723501440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.719228:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074056.719240:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4145a00/0x5fb609b3016decf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016decea expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.719263:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145a00/0x5fb609b3016decf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016decea expref: 19 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.719274:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4145a00/0x5fb609b3016decf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016decea expref: 19 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.719282:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145a00, rc 0) 00000100:00100000:0.0:1783074056.719344:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723501440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.719351:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783074056.719496:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.719510:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.719519:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074056.719569:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.719600:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074056.719631:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3206900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.719646:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501568 00000100:00100000:0.0:1783074056.719651:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501568 00000100:00100000:0.0:1783074056.719682:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783074056.719689:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723501568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.719911:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723501568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.719919:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783074056.720004:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.720036:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.720761:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074056.720801:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501696 00000100:00100000:1.0:1783074056.720807:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501696 00000100:00100000:3.0:1783074056.720809:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3a00840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.720840:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783074056.720848:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723501696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.720988:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723501696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.720996:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783074056.721094:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074056.723239:0:87175:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074056.723341:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074056.723376:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074056.723385:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.723396:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074056.723405:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074056.723408:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 52 10000000:01000000:0.0:1783074056.723410:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074056.723441:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.723449:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.723459:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074056.723478:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.723529:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.723562:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.723680:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501824 00000100:00100000:1.0:1783074056.723687:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501824 00000100:00100000:1.0:1783074056.723739:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783074056.723748:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723501824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.723765:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074056.723779:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc200/0x5fb609b3016decff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016decf8 expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.723800:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc200/0x5fb609b3016decff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016decf8 expref: 20 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.723810:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc200/0x5fb609b3016decff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016decf8 expref: 20 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.723818:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc200, rc 0) 00000100:00100000:1.0:1783074056.723852:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723501824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.723858:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783074056.723929:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074056.723942:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.723950:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074056.724010:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.724061:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.724110:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.724140:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723501952 00000100:00100000:1.0:1783074056.724144:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723501952 00000100:00100000:1.0:1783074056.724205:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783074056.724214:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723501952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.724345:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723501952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.724352:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783074056.725575:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.725619:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.725669:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.725698:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074056.725709:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502080 00000100:00100000:3.0:1783074056.725716:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502080 00000100:00100000:3.0:1783074056.725761:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783074056.725771:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723502080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.725968:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723502080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074056.725978:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783074056.726473:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074056.727764:0:87176:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783074056.727878:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783074056.727907:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074056.727917:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.727938:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.727947:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783074056.727950:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783074056.727953:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783074056.727997:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.728006:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.728016:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.728035:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.728090:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.728138:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.728220:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502208 00000100:00100000:1.0:1783074056.728226:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502208 00000100:00100000:1.0:1783074056.728269:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783074056.728278:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723502208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.728287:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074056.728301:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd800/0x5fb609b3016ded0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016ded06 expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.728358:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd800/0x5fb609b3016ded0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016ded06 expref: 21 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.728368:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd800/0x5fb609b3016ded0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016ded06 expref: 21 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.728378:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd800, rc 0) 00000100:00100000:1.0:1783074056.728429:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723502208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.728436:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783074056.728522:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.728534:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.728543:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.728587:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.728613:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.728654:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.728695:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502336 00000100:00100000:1.0:1783074056.728699:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502336 00000100:00100000:1.0:1783074056.728723:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783074056.728730:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723502336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.728863:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723502336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.728870:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783074056.728923:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.728948:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.728981:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.729013:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.729166:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502464 00000100:00100000:0.0:1783074056.729171:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502464 00000100:00100000:0.0:1783074056.729204:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783074056.729213:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723502464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.730400:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723502464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1186us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.730409:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783074056.730478:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074056.731582:0:87177:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783074056.731752:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783074056.731791:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783074056.731801:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.731810:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.731818:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783074056.731820:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f4a91000 from 7 10000000:01000000:3.0:1783074056.731822:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074056.731850:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.731858:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.731867:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.731884:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.731928:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074056.732018:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3cc9780 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.732069:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502592 00000100:00100000:1.0:1783074056.732075:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502592 00000100:00100000:1.0:1783074056.732221:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783074056.732232:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723502592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.732242:0:87008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074056.732254:0:87008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bce00/0x5fb609b3016ded1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016ded14 expref: -99 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.732274:0:87008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bce00/0x5fb609b3016ded1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016ded14 expref: 22 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.732291:0:87008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bce00/0x5fb609b3016ded1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016ded14 expref: 22 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.732299:0:87008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bce00, rc 0) 00000100:00100000:1.0:1783074056.732357:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723502592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.732364:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783074056.732487:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.732561:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.732571:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074056.732618:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.732647:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074056.732707:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3206780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074056.732740:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502720 00000100:00100000:0.0:1783074056.732745:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502720 00000100:00100000:0.0:1783074056.732807:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783074056.732816:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723502720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.732917:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723502720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074056.732925:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783074056.733005:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.733035:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.733156:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.733220:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c41623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.733257:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502848 00000100:00100000:1.0:1783074056.733262:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502848 00000100:00100000:1.0:1783074056.733354:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783074056.733362:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723502848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.733441:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723502848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.733449:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783074056.734379:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074056.735460:0:87178:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074056.736614:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074056.736651:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074056.736665:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.736676:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074056.736690:0:6527:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783074056.736696:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074056.736699:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783074056.736741:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.736755:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074056.736769:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074056.736794:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074056.736853:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074056.736903:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4162840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.736962:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723502976 00000100:00100000:1.0:1783074056.736970:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723502976 00000100:00100000:1.0:1783074056.737025:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783074056.737034:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723502976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.737058:0:87011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074056.737071:0:87011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bde00/0x5fb609b3016ded29 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016ded22 expref: -99 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.737094:0:87011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bde00/0x5fb609b3016ded29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016ded22 expref: 23 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.737104:0:87011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bde00/0x5fb609b3016ded29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016ded22 expref: 23 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.737113:0:87011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bde00, rc 0) 00000100:00100000:1.0:1783074056.737169:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723502976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.737176:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783074056.738165:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723502976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.738182:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.738192:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.738212:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783074056.738218:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.738225:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074056.738232:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783074056.738234:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:3.0:1783074056.738237:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783074056.738255:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.738264:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.738272:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.738287:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723503104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074056.738344:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074056.738396:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503104 00000100:00100000:3.0:1783074056.738399:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3cc9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.738403:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503104 00000100:00100000:1.0:1783074056.738450:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783074056.738459:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723503104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074056.738467:0:87008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074056.738476:0:87008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bcc00/0x5fb609b3016ded37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016ded30 expref: -99 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.738492:0:87008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bcc00/0x5fb609b3016ded37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016ded30 expref: 24 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.738508:0:87008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bcc00/0x5fb609b3016ded37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016ded30 expref: 24 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.738516:0:87008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bcc00, rc 0) 00000100:00100000:1.0:1783074056.738556:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723503104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074056.738563:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783074056.739431:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723503104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074056.739445:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074056.739454:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074056.739512:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074056.740085:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074056.740137:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3cc9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074056.740212:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503232 00000100:00100000:1.0:1783074056.740218:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503232 00000100:00100000:1.0:1783074056.740261:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783074056.740269:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723503232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074056.740374:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723503232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (289us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074056.740381:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783074056.740383:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723503232:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783074056.740418:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783074056.740425:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074056.740433:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074056.814475:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783074057.561982:0:87285:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783074057.839336:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783074058.003233:0:87338:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783074058.003576:0:87338:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1783074058.443952:0:87388:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783074058.444172:0:87388:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783074058.863148:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074059.760851:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074059.760881:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074059.760950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074059.760961:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074059.761001:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074059.761017:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030720 00000100:00100000:1.0:1783074059.761025:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030464 00000100:00100000:0.0:1783074059.761030:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030720 00000100:00100000:1.0:1783074059.761031:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030464 00000100:00100000:2.0:1783074059.761047:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030976 00000100:00100000:2.0:1783074059.761050:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030976 00000100:00100000:1.0:1783074059.761068:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030592 00000100:00100000:1.0:1783074059.761071:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030592 00000100:00100000:0.0:1783074059.761085:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708030848 00000100:00100000:0.0:1783074059.761089:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708030848 00000100:00100000:2.0:1783074059.761093:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:2.0:1783074059.761103:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1869685708030976:12345-192.168.204.26@tcp:250:kworker.0 00000100:00100000:1.0:1783074059.761103:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 752 00000100:00100000:1.0:1783074059.761124:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708030592:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074059.761125:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4883 00010000:00080000:2.0:1783074059.761138:0:87011:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from da924155-7591-4a6a-a2d2-c0d2908d0bfb@192.168.204.26@tcp t0 exp 0000000000000000 cur 2898 last 0 00000100:00100000:0.0:1783074059.761139:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708030720:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:2.0:1783074059.761165:0:87011:0:(genops.c:1406:class_connect()) connect: client da924155-7591-4a6a-a2d2-c0d2908d0bfb, cookie 0x5fb609b3016ded3e 00000020:00000080:0.0:1783074059.761175:0:26172:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de836 00000100:00080000:0.0:1783074059.761184:0:26172:0:(import.c:65:import_set_state_nolock()) ffff9524c86a8800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783074059.761192:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708030592:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074059.761200:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 752 00000100:00100000:3.0:1783074059.761232:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1086 00000001:00000004:0.0:1783074059.761236:0:26172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968712 00000100:00100000:3.0:1783074059.761242:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869685708030464:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:1.0:1783074059.761255:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4884 00010000:00080000:3.0:1783074059.761263:0:66200:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0510a7c0-d9c1-4de9-a6c3-ede973deaaff' at ffff9524f0889800, cookie 0x5fb609b3016debc4 00000100:00100000:1.0:1783074059.761265:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708030848:12345-192.168.204.26@tcp:9:kworker.0 00010000:00080000:3.0:1783074059.761272:0:66200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp recovering/t103079215109 exp ffff9524f0889800 cur 2898 last 1783074055 00000020:00000080:1.0:1783074059.761281:0:26173:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016de83d 00010000:02000400:3.0:1783074059.761282:0:66200:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00080000:1.0:1783074059.761290:0:26173:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b5000 : changing import state from FULL to CLOSED 00010000:00080000:3.0:1783074059.761291:0:66200:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783074059.761344:0:66200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783074059.761354:0:87011:0:(import.c:65:import_set_state_nolock()) ffff9523c6945000 : changing import state from RECOVER to FULL 00000001:00000004:1.0:1783074059.761356:0:26173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968707 00000100:00100000:2.0:1783074059.761390:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:2401:x1869685708030976:12345-192.168.204.26@tcp:250:kworker.0 Request processed in 287us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074059.761406:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1783074059.761465:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+2:2401:x1869685708030848:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 202us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074059.761473:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4884 00000100:00100000:0.0:1783074059.761496:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+2:2401:x1869685708030720:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 360us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074059.761506:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4883 00000100:00080000:2.0:1783074059.761525:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074059.761532:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783074059.761533:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074059.761536:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074059.761551:0:66200:0:(import.c:65:import_set_state_nolock()) ffff9524de7c3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074059.761586:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708030464:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 344us (742us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074059.761635:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074059.762888:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1086 00000100:00100000:2.0:1783074059.765436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074059.765531:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708025856 00000100:00100000:1.0:1783074059.765540:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708025856 00000100:00100000:1.0:1783074059.765595:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1087 00000100:00100000:1.0:1783074059.765604:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708025856:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00080000:1.0:1783074059.765623:0:66202:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:1.0:1783074059.765687:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708025856:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 84us (257us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074059.765694:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1087 00010000:00080000:2.0:1783074059.765733:0:87035:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1783074059.886564:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074060.718522:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723503360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074060.718593:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074060.718644:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503360 00000100:00100000:0.0:1783074060.718653:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503360 00000100:00100000:0.0:1783074060.718716:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:0.0:1783074060.718727:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723503360:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783074060.718899:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074060.718928:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723503488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074060.718957:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074060.719011:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503488 00000100:00100000:3.0:1783074060.719015:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503488 00000100:00100000:3.0:1783074060.719040:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1783074060.719046:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723503488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074060.719070:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074060.719110:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723503488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074060.719117:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00080000:3.0:1783074060.719135:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074060.719159:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723503488:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074060.719820:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074060.719870:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723503360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1145us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074060.719876:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1783074060.719952:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723503616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074060.720000:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074060.720072:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074060.720077:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074060.720080:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074060.720088:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074060.720111:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df768380 x1869685723503872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074060.720143:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074060.720147:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074060.720148:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074060.720153:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074060.720179:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc496d80 x1869685723504128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074060.720189:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723503872:0@lo:38:kworker.0 00000100:00080000:2.0:1783074060.720210:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074060.720215:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074060.720217:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074060.720222:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074060.720229:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074060.720240:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc497100 x1869685723504384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074060.720258:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723504128:0@lo:38:kworker.0 00000100:00080000:2.0:1783074060.720264:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074060.720269:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074060.720271:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074060.720276:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074060.720286:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074060.720291:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc496680 x1869685723504512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074060.720329:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723504384:0@lo:38:kworker.0 00000100:00080000:2.0:1783074060.720340:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783074060.720344:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074060.720346:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524de7c7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074060.720352:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524de7c7000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074060.720358:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074060.720364:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc494a80 x1869685723504896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074060.720377:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723504512:0@lo:38:kworker.0 00000100:00100000:2.0:1783074060.720398:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503872 00000100:00100000:2.0:1783074060.720403:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503872 00000100:00100000:0.0:1783074060.720416:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074060.720446:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723504896:0@lo:38:kworker.0 00000100:00100000:0.0:1783074060.720472:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074060.720478:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503616 00000100:00100000:3.0:1783074060.720483:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503616 00000100:00100000:2.0:1783074060.720507:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504128 00000100:00100000:3.0:1783074060.720512:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504384 00000100:00100000:2.0:1783074060.720513:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504128 00000100:00100000:3.0:1783074060.720518:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504384 00000100:00100000:3.0:1783074060.720538:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:3.0:1783074060.720546:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723503616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783074060.720567:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:3.0:1783074060.720604:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723503616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074060.720610:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:3.0:1783074060.720622:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609 00000100:00100000:2.0:1783074060.720625:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504512 00000100:00100000:3.0:1783074060.720627:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723504384:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074060.720630:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504512 00000100:00100000:2.0:1783074060.720649:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504896 00000100:00100000:2.0:1783074060.720653:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504896 00000100:00100000:0.0:1783074060.720672:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1783074060.720683:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1783074060.720683:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723503872:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074060.720701:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723504128:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783074060.720746:0:8454:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9523c2c2f000, cookie 0x5fb609b3016debcb 00010000:00080000:0.0:1783074060.720751:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2899 last 0 00010000:00080000:3.0:1783074060.720754:0:8454:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9523c2c2f000 cur 2899 last 1783074055 00000004:00100000:3.0:1783074060.720778:0:8454:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:0.0:1783074060.720791:0:68632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016ded45 00000004:00100000:0.0:1783074060.720802:0:68632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783074060.720830:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524c2b7a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074060.720870:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723503872:12345-0@lo:38:kworker.0 Request processed in 189us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074060.720877:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1783074060.720898:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1783074060.720909:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1783074060.720910:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723504512:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1783074060.720914:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9524de7c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074060.720919:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723504896:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783074060.720930:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2899 last 0 00010000:00080000:0.0:1783074060.720937:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2899 last 0 00000100:00100000:3.0:1783074060.720979:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723504384:12345-0@lo:38:kworker.0 Request processed in 350us (620us total) trans 0 rc 0/0 00000020:00000080:1.0:1783074060.720982:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb609b3016ded4c 00000100:00100000:3.0:1783074060.720989:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609 00000004:00100000:1.0:1783074060.720992:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783074060.721011:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524d2ead000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074060.721021:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723503744:0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.721047:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869685723504512:12345-0@lo:38:kworker.0 Request processed in 140us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074060.721061:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074060.721066:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000020:00000080:0.0:1783074060.721066:0:68632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb609b3016ded53 00000004:00100000:0.0:1783074060.721078:0:68632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:2.0:1783074060.721095:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2899 last 0 00000100:00100000:3.0:1783074060.721102:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723504768:0@lo:400:kworker.0 00000100:00080000:0.0:1783074060.721103:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524c2b7b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074060.721145:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074060.721147:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723504896:12345-0@lo:38:kworker.0 Request processed in 229us (674us total) trans 0 rc 0/0 00000020:00000080:2.0:1783074060.721154:0:67186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb609b3016ded5a 00000100:00100000:0.0:1783074060.721155:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000004:00100000:2.0:1783074060.721165:0:67186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1783074060.721191:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524fc494a80 x1869685723504896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783074060.721192:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9523c6942000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783074060.721206:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:0.0:1783074060.721214:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783074060.721218:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783074060.721227:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524de7c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783074060.721234:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869685723504128:12345-0@lo:38:kworker.0 Request processed in 531us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074060.721235:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723504896:0@lo:38:kworker.0 00000100:00100000:2.0:1783074060.721247:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00080000:0.0:1783074060.721254:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:0.0:1783074060.721261:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783074060.721265:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783074060.721268:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00010000:00080000:2.0:1783074060.721270:0:87035:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00080000:0.0:1783074060.721272:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9524f0d24800 from lustre-MDT0000_UUID committed 81604378635 last 0 00010000:00080000:2.0:1783074060.721276:0:87035:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 103079215109 00000100:00080000:0.0:1783074060.721277:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00080000:2.0:1783074060.721283:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.721287:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:2.0:1783074060.721291:0:87035:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:2.0:1783074060.721294:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.721303:0:87035:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708025856 t103079215109 from 192.168.204.26@tcp req@ffff9524df76bb80 x1869685708025856/t0(103079215109) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:385/0 lens 528/0 e 0 to 0 dl 1783074070 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074060.721514:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723504640:0@lo:400:kworker.0 00000100:00100000:3.0:1783074060.721534:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074060.721544:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723504000:0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.721551:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074060.721581:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074060.721592:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723503616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074060.721610:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783074060.721618:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723504256:0@lo:400:kworker.0 00000100:00100000:3.0:1783074060.721619:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723503744 00000100:00100000:3.0:1783074060.721626:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723503744 00000100:00100000:1.0:1783074060.721649:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074060.721681:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504768 00000100:00100000:1.0:1783074060.721685:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504768 00000100:00100000:1.0:1783074060.721718:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504640 00000100:00100000:1.0:1783074060.721720:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504640 00000100:00100000:1.0:1783074060.721738:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:1.0:1783074060.721745:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723504768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.721782:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723504768:12345-0@lo:400:kworker.0 Request processed in 37us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074060.721893:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723504384:0@lo:38:kworker.0 00010000:00080000:0.0:1783074060.721909:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524fc496680 x1869685723504512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074060.721919:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000004:00080000:2.0:1783074060.721924:0:87035:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 560us 00000100:00080000:0.0:1783074060.722813:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9524fc496680 x1869685723504512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074085 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074060.722821:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074060.722825:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074060.722828:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074060.722832:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723504512:0@lo:38:kworker.0 00010000:00080000:0.0:1783074060.722849:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524fc496d80 x1869685723504128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074060.722858:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00100000:1.0:1783074060.722917:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:1.0:1783074060.722945:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:1.0:1783074060.722955:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.723014:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723504640:12345-0@lo:400:kworker.0 Request processed in 62us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.723021:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:1.0:1783074060.723049:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504000 00000100:00100000:1.0:1783074060.723054:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504000 00000100:00100000:1.0:1783074060.723082:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723504256 00000100:00100000:1.0:1783074060.723084:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723504256 00000100:00100000:1.0:1783074060.723167:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1783074060.723180:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723504000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.723212:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723504000:12345-0@lo:400:kworker.0 Request processed in 34us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.723218:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1783074060.723230:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1783074060.723236:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723504256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.723413:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723504256:12345-0@lo:400:kworker.0 Request processed in 176us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.723420:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1783074060.723464:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723504000:0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.723477:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723504768:0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.723509:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723504256:0@lo:400:kworker.0 00000100:00100000:1.0:1783074060.723518:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723504640:0@lo:400:kworker.0 00010000:00080000:1.0:1783074060.723554:0:87401:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783074060.723558:0:87401:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783074060.723563:0:87401:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:3.0:1783074060.723845:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783074060.723853:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723503744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074060.723909:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723503744:12345-0@lo:400:kworker.0 Request processed in 57us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074060.723916:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1783074060.723956:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783074060.723961:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074060.723998:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074060.724027:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c8cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723503360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074060.724136:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723503744:0@lo:400:kworker.0 00000100:00080000:0.0:1783074060.724233:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9524fc496d80 x1869685723504128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074085 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074060.724251:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074060.724263:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074060.724267:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074060.724271:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723504128:0@lo:38:kworker.0 00010000:00080000:0.0:1783074060.724288:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524df768380 x1869685723503872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074060.724298:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00080000:1.0:1783074060.724662:0:87401:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1783074060.725616:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9524df768380 x1869685723503872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074085 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074060.725624:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074060.725629:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074060.725633:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074060.725638:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723503872:0@lo:38:kworker.0 00000100:00100000:0.0:1783074060.725688:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723505024:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783074060.725734:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1783074060.725853:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:0.0:1783074060.725858:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524c86af800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:0.0:1783074060.725878:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074060.725895:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c86af800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0000 00000020:00000080:0.0:1783074060.725949:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c86a8800 for lustre-OST0000 00000100:00100000:1.0:1783074060.726144:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505024 00000100:00100000:1.0:1783074060.726150:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505024 00000100:00100000:1.0:1783074060.726189:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:1.0:1783074060.726197:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723505024:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783074060.726213:0:26189:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524fdfe2c50 x1869685723505024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:386/0 lens 224/0 e 0 to 0 dl 1783074071 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074060.726236:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723505024:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 40us (503us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074060.726243:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000001:00100000:3.0:1783074060.727218:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:3.0:1783074060.727229:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524fb6b3000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:3.0:1783074060.727252:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783074060.727291:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074060.727779:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb6b3000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0001 00000020:00000080:1.0:1783074060.727813:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb6b5000 for lustre-OST0001 00010000:00010000:0.0:1783074060.737514:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737535:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737562:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737576:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737584:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737590:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737935:0:87035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737943:0:87035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737949:0:87035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737955:0:87035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074060.737959:0:87035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737979:0:87035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.737992:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3100) 00010000:00010000:0.0:1783074060.737995:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074060.738000:0:87035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.738012:0:87035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074060.738030:0:87035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b93277e reply state 000000006912c8b1 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.738041:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.738047:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d30b3800) 00010000:00010000:0.0:1783074060.738049:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074060.738052:0:87035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074060.738147:0:87035:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1783074060.738170:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074060.738174:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:0.0:1783074060.738179:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074060.738181:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000001:00080000:0.0:1783074060.740053:0:87004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215109 is committed 00010000:00010000:2.0:1783074060.740121:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.740131:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.740138:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.740143:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074060.740147:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.740154:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.740180:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d30b3800) 00010000:00010000:2.0:1783074060.740183:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074060.740186:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.740193:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016ded68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074060.744470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074060.744833:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026368 00000100:00100000:1.0:1783074060.744843:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026368 00000100:00100000:1.0:1783074060.744902:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1092 00000100:00100000:1.0:1783074060.744911:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708026368:12345-192.168.204.26@tcp:36:rm.0 00010000:00080000:1.0:1783074060.744932:0:66201:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:1.0:1783074060.744950:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708026368:12345-192.168.204.26@tcp:36:rm.0 Request processed in 41us (489us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074060.744957:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1092 00000020:00080000:0.0:1783074060.745021:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074060.745026:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:0.0:1783074060.745031:0:87035:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:0.0:1783074060.745034:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074060.745044:0:87035:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708026368 t103079215110 from 192.168.204.26@tcp req@ffff9524fc494700 x1869685708026368/t0(103079215110) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:386/0 lens 512/0 e 0 to 0 dl 1783074071 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074060.745148:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745164:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745185:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745199:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745206:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745213:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745291:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745299:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745305:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745551:0:87035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745560:0:87035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745566:0:87035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745572:0:87035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074060.745576:0:87035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745597:0:87035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745609:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074060.745621:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783074060.745627:0:87035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745631:0:87035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016ded7d lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745653:0:87035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745657:0:87035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745661:0:87035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745664:0:87035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074060.745665:0:87035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745668:0:87035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745673:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3100) 00010000:00010000:0.0:1783074060.745674:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074060.745676:0:87035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745687:0:87035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016ded6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074060.745694:0:87035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f8a6bfd reply state 000000002504c38c transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745701:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.745705:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d30b3f00) 00010000:00010000:0.0:1783074060.745707:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074060.745708:0:87035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074060.745782:0:87035:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783074060.745797:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074060.745800:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:0.0:1783074060.745803:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074060.745805:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000100:00100000:0.0:1783074060.747540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074060.747578:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708026880 00000100:00100000:1.0:1783074060.747585:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708026880 00000100:00100000:1.0:1783074060.747631:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1093 00000100:00100000:1.0:1783074060.747640:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708026880:12345-192.168.204.26@tcp:101:touch.0 00010000:00080000:1.0:1783074060.747654:0:66202:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:1.0:1783074060.747777:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708026880:12345-192.168.204.26@tcp:101:touch.0 Request processed in 137us (240us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074060.747784:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1093 00000020:00080000:2.0:1783074060.747825:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.747829:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:2.0:1783074060.747833:0:87035:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:2.0:1783074060.747836:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.747843:0:87035:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708026880 t103079215111 from 192.168.204.26@tcp req@ffff9523c8cd6300 x1869685708026880/t0(103079215111) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:386/0 lens 752/0 e 0 to 0 dl 1783074071 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1783074060.747862:0:87035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074060.747885:0:87035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016ded84 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afa2 expref: -99 pid: 87035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748079:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748092:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748102:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748115:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748133:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748141:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783074060.748514:0:87035:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x5fb609b3016deb31 00000004:00080000:2.0:1783074060.748518:0:87035:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x5fb609b3016deb31 in new mfd 00010000:00010000:2.0:1783074060.748527:0:87035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748534:0:87035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748541:0:87035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748545:0:87035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074060.748549:0:87035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748554:0:87035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748564:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524fc299300) 00010000:00010000:2.0:1783074060.748566:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074060.748569:0:87035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748574:0:87035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016ded8b lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074060.748594:0:87035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f271d89d reply state 00000000322b3a28 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748603:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748608:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9524fc299700) 00010000:00010000:2.0:1783074060.748610:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074060.748612:0:87035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783074060.748631:0:87035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016ded84 lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 10 pid: 87035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748639:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524fc299300) 00010000:00010000:2.0:1783074060.748641:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074060.748644:0:87035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016ded84 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa2 expref: 10 pid: 87035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.748656:0:87035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868c00, rc 0) 00010000:00080000:2.0:1783074060.748701:0:87035:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783074060.748713:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.748716:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:2.0:1783074060.748720:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.748722:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:2.0:1783074060.763652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074060.763818:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027136 00000100:00100000:3.0:1783074060.763827:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027136 00000100:00100000:3.0:1783074060.763884:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1094 00000100:00100000:3.0:1783074060.763893:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708027136:12345-192.168.204.26@tcp:36:touch.0 00010000:00080000:3.0:1783074060.763911:0:66200:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:3.0:1783074060.763930:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708027136:12345-192.168.204.26@tcp:36:touch.0 Request processed in 39us (287us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074060.763937:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1094 00000020:00080000:2.0:1783074060.764001:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.764006:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:2.0:1783074060.764011:0:87035:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:2.0:1783074060.764028:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.764038:0:87035:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708027136 t103079215112 from 192.168.204.26@tcp req@ffff9524fc495180 x1869685708027136/t0(103079215112) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:386/0 lens 488/0 e 0 to 0 dl 1783074071 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783074060.764144:0:87035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.764158:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.764169:0:87035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074060.764294:0:87035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b7f5af2 reply state 00000000b4cd060d transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.764306:0:87035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.764347:0:87035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9524fc299300) 00010000:00010000:2.0:1783074060.764350:0:87035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074060.764353:0:87035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1783074060.764432:0:87035:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783074060.764449:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.764452:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:2.0:1783074060.764455:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.764457:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:1.0:1783074060.766978:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074060.767162:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708027520 00000100:00100000:0.0:1783074060.767170:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708027520 00000100:00100000:0.0:1783074060.767213:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:0.0:1783074060.767222:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2401:x1869685708027520:12345-192.168.204.26@tcp:35:touch.0 00010000:00080000:0.0:1783074060.767238:0:66204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:0.0:1783074060.767252:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2401:x1869685708027520:12345-192.168.204.26@tcp:35:touch.0 Request processed in 31us (293us total) trans 0 rc 0/-999 00000020:00080000:2.0:1783074060.767258:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:0.0:1783074060.767259:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 218 00010000:00080000:2.0:1783074060.767264:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:2.0:1783074060.767270:0:87035:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:2.0:1783074060.767273:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.767294:0:87035:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708027520 t103079215113 from 192.168.204.26@tcp req@ffff9523caed2a00 x1869685708027520/t0(103079215113) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:386/0 lens 392/0 e 0 to 0 dl 1783074071 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074060.767843:0:87035:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783074060.767856:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.767859:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:2.0:1783074060.767862:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783074060.767865:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:0.0:1783074060.772545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074060.772697:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031232 00000100:00100000:2.0:1783074060.772706:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031232 00000100:00100000:2.0:1783074060.772850:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 755 00000100:00100000:2.0:1783074060.772860:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708031232:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783074060.772881:0:67186:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524e4108380 x1869685708031232/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:386/0 lens 224/0 e 0 to 0 dl 1783074071 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074060.772908:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708031232:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 Request processed in 50us (371us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074060.772915:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 755 00000020:00080000:3.0:1783074060.772958:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074060.772976:0:87035:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:3.0:1783074060.772979:0:87035:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1783074060.772982:0:87035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074060.772989:0:87035:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783074060.772992:0:87035:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783074060.773090:0:87035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:1.0:1783074060.775118:0:87004:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:1.0:1783074060.775127:0:87004:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1783074060.775146:0:87004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:3.0:1783074060.775229:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775241:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775248:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775254:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074060.775258:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775275:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775293:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775299:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016ded76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775353:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775360:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775365:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775370:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074060.775372:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775378:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775386:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775392:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016ded92 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775416:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775423:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775428:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775433:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074060.775436:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775441:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775449:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.775454:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016deda0 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074060.775485:0:87035:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783074060.775515:0:87035:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783074060.775526:0:87035:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9524fdfe2c50 x1869685723505024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:386/0 lens 224/0 e 0 to 0 dl 1783074071 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783074060.776097:0:87035:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.26@tcp: req@ffff9524e4108380 x1869685708031232/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:386/0 lens 224/0 e 0 to 0 dl 1783074071 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783074060.776157:0:87035:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1783074060.777937:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783074060.777947:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9523caed0e00 x1869685723505024/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074076 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074060.777956:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9523caed0e00 x1869685723505024/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074076 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074060.777973:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074060.777989:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783074060.777995:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000295cd25f): req@ffff9524f4a03480 x1869685723489152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074060.778015:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723505024:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783074060.778089:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074060.778116:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723505152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074060.778150:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074060.778177:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723489152 00000100:00100000:1.0:1783074060.778184:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723489152 00000100:00100000:1.0:1783074060.778229:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505152 00000100:00100000:1.0:1783074060.778232:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505152 00000100:00100000:1.0:1783074060.778258:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611 00000100:00100000:1.0:1783074060.778267:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:0:x1869685723489152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074060.778292:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:1.0:1783074060.778350:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:0:x1869685723489152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.778358:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611 00000100:00100000:1.0:1783074060.778381:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612 00000100:00100000:1.0:1783074060.778387:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e410b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723505152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074060.778398:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:1.0:1783074060.778425:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e410b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723505152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.778443:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612 00000100:00100000:1.0:1783074060.778469:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1869685723489152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074060.778759:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723505152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074060.780031:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074060.780134:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031104 00000100:00100000:1.0:1783074060.780140:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031104 00000100:00100000:1.0:1783074060.780400:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1095 00000100:00100000:1.0:1783074060.780409:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031104:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074060.780428:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:1.0:1783074060.780485:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031104:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 77us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.780491:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1095 00000100:00100000:2.0:1783074060.783837:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074060.783919:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031360 00000100:00100000:1.0:1783074060.783927:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031360 00000100:00100000:1.0:1783074060.784124:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1096 00000100:00100000:1.0:1783074060.784134:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031360:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074060.784165:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074060.784264:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031360:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 130us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.784271:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1096 00000100:00100000:0.0:1783074060.788346:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074060.788583:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031488 00000100:00100000:1.0:1783074060.788593:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031488 00000100:00100000:1.0:1783074060.788673:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4885 00000100:00100000:1.0:1783074060.788682:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2401:x1869685708031488:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:1.0:1783074060.788733:0:26175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2900 last 0 00000020:00000080:1.0:1783074060.788777:0:26175:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016deda7 00002000:00100000:1.0:1783074060.788801:0:26175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9524d2ca4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783074060.788812:0:26175:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783074060.788897:0:26175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783074060.788956:0:26175:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074060.789032:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708031488:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 350us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.789040:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4885 00000100:00100000:2.0:1783074060.790481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074060.790565:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031616 00000100:00100000:0.0:1783074060.790572:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031616 00000100:00100000:0.0:1783074060.790702:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1649 00000100:00100000:0.0:1783074060.790710:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031616:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074060.790727:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074060.790780:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031616:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074060.790787:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1649 00000100:00080000:1.0:1783074060.790831:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074060.794914:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074060.795068:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031744 00000100:00100000:1.0:1783074060.795076:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031744 00000100:00100000:1.0:1783074060.795153:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4886 00000100:00100000:1.0:1783074060.795161:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1869685708031744:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:1.0:1783074060.795194:0:8487:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2900 last 0 00000020:00000080:1.0:1783074060.795224:0:8487:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016dedae 00002000:00100000:1.0:1783074060.795240:0:8487:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9524ee2c5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783074060.795251:0:8487:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783074060.795342:0:8487:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783074060.795370:0:8487:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074060.795431:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708031744:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 268us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.795438:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4886 00000004:00000080:3.0:1783074060.795778:0:87035:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc7e23e10 00100000:10000000:3.0:1783074060.795787:0:87035:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1783074060.796821:0:87021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:2.0:1783074060.796857:0:87021:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc495500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87021:1869685723505280:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783074060.796911:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783074060.796953:0:87023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x4b0:0x0] 00000100:00100000:1.0:1783074060.796982:0:87023:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87023:1869685723505408:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783074060.797132:0:87023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074060.797282:0:87021:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3575a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074060.797306:0:87023:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c1084840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074060.797424:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505280 00000100:00100000:3.0:1783074060.797430:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505280 00000100:00100000:3.0:1783074060.797467:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505408 00000100:00100000:3.0:1783074060.797471:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505408 00000100:00100000:3.0:1783074060.797499:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887 00000100:00100000:2.0:1783074060.797507:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4888 00000100:00100000:3.0:1783074060.797508:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:87021:x1869685723505280:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783074060.797522:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:87023:x1869685723505408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783074060.797529:0:26167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -95 00002000:02000040:3.0:1783074060.797533:0:26167:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1793) 00002000:00080000:2.0:1783074060.797536:0:26174:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -593 00002000:02000040:2.0:1783074060.797547:0:26174:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1201 to 0x2c0000401:1793) 00000100:00100000:1.0:1783074060.803677:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074060.803757:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708031872 00000100:00100000:0.0:1783074060.803765:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708031872 00002000:00010000:3.0:1783074060.803839:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.803852:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074060.803864:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1650 00010000:00010000:3.0:1783074060.803869:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.803876:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783074060.803876:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031872:12345-192.168.204.26@tcp:13:lfs.0 00010000:00010000:3.0:1783074060.803885:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1783074060.803903:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1783074060.803905:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.803918:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.803926:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.803970:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783074060.803977:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:66643:x1869685708031872:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 103us (305us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074060.803985:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783074060.803987:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1650 00010000:00010000:3.0:1783074060.803993:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804003:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.804008:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804018:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804035:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804043:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da8dd59/0x5fb609b3016dedb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804066:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.804068:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.804070:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783074060.804130:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1783074060.804167:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.804173:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804181:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.804190:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.804195:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804205:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804212:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804218:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804261:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.804263:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.804270:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.804291:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.804295:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.804304:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.804305:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.804347:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804359:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.804360:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e65a9fe/0x5fb609b3016dedbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804381:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.804385:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.804389:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.804390:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.804393:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.804397:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.804405:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804414:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.804427:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805174:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.805181:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805189:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.805193:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805201:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805219:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074060.805221:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805232:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd2289d8/0x5fb609b3016dedc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.805279:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.805285:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805295:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.805299:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.805304:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805337:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805345:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805353:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805373:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.805383:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.805390:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805391:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.805398:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.805402:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.805411:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074060.805411:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805422:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.805430:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805442:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:1.0:1783074060.805444:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026f329ba/0x5fb609b3016dedca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805447:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.805455:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.805465:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.805467:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.805468:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.805472:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.805479:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805487:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805509:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.805545:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1783074060.805551:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.805551:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805559:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805568:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:0.0:1783074060.805574:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.805579:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805586:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.805596:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805597:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805616:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805621:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805637:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016dedd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805641:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805656:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805660:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.805674:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.805677:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074060.805679:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805687:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.805691:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805701:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805713:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.805717:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074060.805726:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.805738:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805745:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016dedd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805747:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.805755:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.805763:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805771:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.805774:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805775:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.805779:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.805795:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805803:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805833:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.805871:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.805873:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.805877:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805879:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805889:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.805897:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.805899:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.805902:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805904:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805925:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805939:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805946:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805950:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805971:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.805980:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016deddf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.805984:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.805996:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806000:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806007:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.806009:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806015:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806023:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806029:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016dede6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806049:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806050:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806052:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074060.806087:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.806094:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806107:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.806116:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.806120:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806129:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806138:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806145:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806166:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.806189:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806195:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806202:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671600 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:3.0:1783074060.806204:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.806206:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806213:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806217:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806229:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.806234:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.806237:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806239:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806254:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7aa803d/0x5fb609b3016deded lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806259:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806271:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806271:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806274:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806275:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.806286:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806307:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.806330:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806336:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.806337:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.806345:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.806355:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.806364:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.806368:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.806377:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.806377:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806401:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:1.0:1783074060.806403:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da95a83/0x5fb609b3016dedf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806406:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.806415:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806425:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.806425:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.806429:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.806433:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.806438:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806446:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806466:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.806482:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806488:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806501:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.806505:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.806509:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.806517:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806518:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806543:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.806546:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.806547:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806551:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806564:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806575:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016dedfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806578:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806597:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806602:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806607:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806610:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806618:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.806619:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074060.806622:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806632:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806656:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.806659:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.806670:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806671:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d0d74e2/0x5fb609b3016dee02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806690:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.806695:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.806700:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806701:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806705:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806708:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.806713:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.806723:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.806735:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806743:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806763:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.806800:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.806805:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806813:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.806817:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.806821:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806822:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806831:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806835:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806847:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.806850:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806853:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806866:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806871:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806887:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806897:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016dee09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806905:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.806926:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.806931:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.806937:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.806938:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.806942:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.806944:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.806953:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.806956:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806980:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.806985:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.806986:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.806990:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807006:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce2a48ca/0x5fb609b3016dee10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807010:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807028:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807031:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.807035:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807037:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807039:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807066:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.807101:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.807106:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807113:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.807122:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.807125:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807134:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807141:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807149:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807168:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783074060.807204:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.807209:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807217:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:0.0:1783074060.807219:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074060.807220:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.807228:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807229:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807253:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.807254:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807266:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807267:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807274:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.807277:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807280:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807296:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.807297:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807301:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807301:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807334:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004691fbc7/0x5fb609b3016dee17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807335:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807341:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.807351:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.807351:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.807355:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807359:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807363:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.807367:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e9af1ce/0x5fb609b3016dee1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807367:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807375:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807386:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.807393:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.807393:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a2dc10/0x5fb609b3016dee25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807395:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.807399:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807402:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807402:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807413:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:0.0:1783074060.807414:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807418:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.807423:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807432:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807439:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807446:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807463:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.807485:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.807490:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.807496:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074060.807498:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.807501:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807512:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807514:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807529:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.807534:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074060.807537:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807538:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807543:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.807562:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008468488d/0x5fb609b3016dee2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807564:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807579:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807597:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807601:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.807603:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.807607:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807619:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.807638:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.807644:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.807655:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.807661:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807662:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.807669:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807673:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.807680:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074060.807685:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807686:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807710:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807714:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807730:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807737:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807758:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.807780:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.807786:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807794:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:3.0:1783074060.807795:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074060.807799:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807802:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807819:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807820:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.807827:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.807840:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807841:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807862:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016dee3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.807864:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807865:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016dee33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.807882:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.807884:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.807888:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807890:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807894:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.807898:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807901:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807901:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.807927:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.807935:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.807940:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807971:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.807975:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807983:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.807994:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.808002:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016dee41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.808016:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.808018:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.808020:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074060.808518:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.808525:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808534:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.808537:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.808540:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808549:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808557:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808564:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808617:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.808656:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.808661:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808668:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.808675:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.808679:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808688:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808697:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808704:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808731:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074060.808736:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808751:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.808755:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808763:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808773:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808780:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016dee48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808805:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.808809:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808815:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.808819:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808827:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808837:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808849:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.808851:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.808852:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.808880:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783074060.808885:0:26167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016dee4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.808907:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074060.808935:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.808941:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808948:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.808951:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.808955:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808978:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808992:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.808999:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809074:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.809112:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.809118:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809125:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.809128:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.809132:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809140:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809148:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809154:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.809156:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809162:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809181:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.809187:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809195:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.809196:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809215:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.809217:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809220:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809225:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016dee56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809228:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:3.0:1783074060.809232:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074060.809233:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809239:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.809242:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.809243:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809245:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.809246:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809264:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.809269:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074060.809270:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809274:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809289:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016dee5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809293:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809329:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809332:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.809335:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.809339:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.809341:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809359:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.809390:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.809394:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809401:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.809409:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.809413:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809421:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809428:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809435:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809450:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783074060.809453:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074060.809472:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.809478:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809486:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:3.0:1783074060.809487:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.809492:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809494:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809502:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809515:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809516:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:1.0:1783074060.809523:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.809525:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074060.809528:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809532:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809534:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809541:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809553:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016dee6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809559:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809561:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809578:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809580:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016dee64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809589:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.809592:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.809595:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.809597:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.809601:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.809602:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.809603:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.809625:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.809658:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.809664:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809669:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.809675:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:0.0:1783074060.809676:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809681:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.809689:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809691:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.809698:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809703:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809714:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809717:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809728:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809747:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.809749:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809758:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016dee72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809772:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074060.809775:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809781:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.809790:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809799:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809811:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074060.809816:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.809818:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016dee79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809823:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809835:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.809838:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:0.0:1783074060.809839:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.809842:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.809843:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.809850:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809859:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809867:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809874:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809894:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.809928:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.809933:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.809941:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.809944:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.809948:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809953:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.809957:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809960:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.809984:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.809987:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.810007:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810009:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810020:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810034:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016dee80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810047:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.810048:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.810050:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.810085:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.810118:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.810166:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074060.810202:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.810207:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.810214:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.810217:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.810221:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.810229:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.810236:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.810242:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810307:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074060.810326:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810335:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.810338:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810357:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810368:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810375:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016dee87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810389:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.810393:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810399:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.810402:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810410:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810420:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810427:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.810429:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.810436:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.810483:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783074060.810488:0:26167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029a45529/0x5fb609b3016dee8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810522:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074060.810587:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.810596:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810607:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.810612:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.810617:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810632:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810643:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810651:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810683:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074060.810756:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1783074060.810762:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.810762:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810773:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810776:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.810787:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.810791:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.810796:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810814:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810824:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810833:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810855:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074060.810906:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.810914:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810923:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.810926:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.810932:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810939:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810943:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.810960:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.810972:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.810992:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.810999:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811002:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811023:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.811023:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.811030:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811038:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811040:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811061:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b9bf66c/0x5fb609b3016dee95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811067:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.811069:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074060.811077:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074060.811082:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811083:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d1d991/0x5fb609b3016dee9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811090:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811109:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:0.0:1783074060.811112:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.811114:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074060.811117:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.811118:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811120:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811120:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.811124:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.811130:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.811142:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811144:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811164:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811167:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811174:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811181:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a82e462/0x5fb609b3016deea3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811200:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074060.811202:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074060.811204:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811213:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074060.811217:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811227:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811251:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.811252:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:3.0:1783074060.811257:0:26167:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00010000:00010000:0.0:1783074060.811266:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c02fb5/0x5fb609b3016deeaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811269:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074060.811279:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.811282:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074060.811286:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.811287:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.811291:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.811296:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811306:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811347:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.811356:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811365:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811387:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.811404:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.811410:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811417:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.811427:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.811431:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074060.811435:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811438:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811453:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:1.0:1783074060.811454:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811460:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074060.811468:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f046e80/0x5fb609b3016deeb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811471:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811488:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811490:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.811492:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.811495:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.811513:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811521:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811543:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074060.811582:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.811588:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811597:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:1.0:1783074060.811598:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074060.811601:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074060.811605:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811608:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811619:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811623:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.811629:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811631:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811652:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811653:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811676:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811690:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.811691:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000321a593b/0x5fb609b3016deeb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811707:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.811711:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811717:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.811724:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811731:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.811733:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.811744:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811748:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811760:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:1.0:1783074060.811763:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c9950f2/0x5fb609b3016deebf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811766:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.811774:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811784:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.811786:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811787:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.811790:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.811798:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811806:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811827:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783074060.811852:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:87021:x1869685723505280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14342us (14937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074060.811863:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887 00002000:00010000:2.0:1783074060.811865:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1783074060.811867:0:87021:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc495500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87021:1869685723505280:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1783074060.811873:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811882:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=2900s v=(0 0) 00000004:00080000:0.0:1783074060.811885:0:87021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x6a2:0x0] 00010000:00010000:2.0:1783074060.811895:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.811900:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811910:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811925:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811934:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074060.811935:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811940:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.811954:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074060.811955:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.811971:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074060.811977:0:87021:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87021:1869685723505664:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783074060.811982:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.811993:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.812000:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1aa18e/0x5fb609b3016deec6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.812067:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074060.812071:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.812078:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.812081:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.812088:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.812099:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.812112:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079f1decf/0x5fb609b3016deecd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074060.812112:0:87021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074060.812130:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.812133:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.812135:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074060.812140:0:87021:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4162840 going to sleep for 11 seconds 00010000:00010000:1.0:1783074060.812141:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074060.812159:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df2eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723505536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074060.812183:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074060.812195:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505664 00000100:00100000:3.0:1783074060.812203:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505664 00000100:00100000:1.0:1783074060.812258:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505536 00000100:00100000:1.0:1783074060.812261:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505536 00000100:00100000:3.0:1783074060.812468:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889 00000100:00100000:3.0:1783074060.812477:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:87021:x1869685723505664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783074060.812513:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00002000:00010000:2.0:1783074060.813209:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.813217:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813229:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.813233:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.813239:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813249:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813258:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813274:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813292:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783074060.813549:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.813555:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813564:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.813568:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.813573:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813582:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813591:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813598:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813614:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783074060.813722:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.813729:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813742:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.813745:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.813750:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813760:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813768:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813776:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813790:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783074060.813837:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.813843:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813851:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.813854:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.813858:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813867:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813885:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813892:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813901:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783074060.813936:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.813941:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813948:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.813951:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.813954:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813974:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813982:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.813990:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814008:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1783074060.814042:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.814047:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814054:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.814057:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.814061:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814069:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814076:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814083:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814092:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1783074060.814120:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.814125:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814131:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.814139:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.814144:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814153:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814161:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074060.814169:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00010000:00010000:2.0:1783074060.814172:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814182:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1783074060.814183:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1869685723505536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783074060.814202:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00010000:2.0:1783074060.814222:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.814229:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814236:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.814239:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.814243:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814251:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814259:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814276:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814286:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1783074060.814323:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:87021:x1869685723505664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1832us (2195us total) trans 4294968713 rc 0/0 00000100:00100000:3.0:1783074060.814332:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889 00002000:00010000:2.0:1783074060.814400:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.814406:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814414:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.814417:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.814431:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814441:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814449:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814457:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814467:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:3.0:1783074060.814477:0:87021:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87021:1869685723505664:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783074060.814490:0:87021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00002000:00010000:2.0:1783074060.814502:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.814510:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814516:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1783074060.814524:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814529:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.814537:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.814540:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.814543:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814546:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814555:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814576:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814577:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814599:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814606:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814609:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1783074060.814620:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016deed4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814642:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1783074060.814646:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.814649:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.814654:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.814658:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814666:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814676:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814683:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016deedb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814707:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783074060.814711:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814717:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.814721:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814728:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814739:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814746:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016deee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814760:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814761:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783074060.814767:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814775:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.814779:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.814781:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.814784:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814788:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814801:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814813:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814838:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814839:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814859:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814861:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016deee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814884:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1783074060.814890:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783074060.814895:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814903:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.814906:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814915:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.814924:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.814926:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814931:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814940:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016deef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814945:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.814951:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.814955:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.814988:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.814991:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074060.814997:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815001:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815010:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815016:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815017:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815037:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815060:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815061:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1783074060.815072:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016deef7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815086:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074060.815089:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815096:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815100:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.815105:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.815112:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815131:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815132:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.815140:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.815149:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815154:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815163:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815165:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016deefe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815187:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815193:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074060.815198:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815199:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815220:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.815223:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1783074060.815224:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815236:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815249:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815256:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016def05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.815259:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.815269:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815285:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.815297:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074060.815298:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.815303:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815335:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815338:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815346:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815357:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815364:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016def0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815377:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783074060.815381:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815385:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815389:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815394:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815406:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815427:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815439:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815447:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016def13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815461:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783074060.815464:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815471:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815474:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815484:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815486:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815508:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815510:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815527:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016def1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815532:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783074060.815547:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783074060.815550:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815555:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815557:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815562:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815569:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.815573:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.815574:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4b8388/0x5fb609b3016def21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815585:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815588:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074060.815592:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815602:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.815602:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.815607:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815609:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.815618:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815629:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815637:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815639:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815655:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186fc5b3/0x5fb609b3016def28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815662:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.815663:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815667:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815669:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815673:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815677:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815681:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016def2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815693:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.815694:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.815695:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.815713:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.815718:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.815719:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815722:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.815735:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815754:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783074060.815782:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723505536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1604us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074060.815790:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00002000:00010000:2.0:1783074060.815793:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.815800:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815808:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.815811:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.815815:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815823:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815830:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815838:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815842:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.815850:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815858:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815862:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815874:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815885:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815893:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e45bd3b/0x5fb609b3016def36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815900:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.815907:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.815911:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815933:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.815937:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.815941:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.815946:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815949:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815959:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815978:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016def3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.815981:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.815988:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.815991:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.815993:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.815995:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.816007:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816020:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816028:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074060.816035:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df2eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723505536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783074060.816512:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.816518:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.816519:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.816529:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074060.816533:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.816541:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.816563:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074060.816571:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.816573:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.816575:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.816620:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074060.816625:0:26174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141d89a7/0x5fb609b3016def44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.816672:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074060.816736:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.816741:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816749:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.816752:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.816757:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816770:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816778:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816785:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816800:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.816824:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.816831:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.816836:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.816841:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.816845:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.816847:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816867:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.816871:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.816880:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.816886:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816893:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.816902:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.816905:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.816922:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000692856a0/0x5fb609b3016def4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.816937:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.816939:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.816940:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.817110:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817125:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.817150:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.817156:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.817163:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.817165:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074060.817172:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817173:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817196:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:3.0:1783074060.817198:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817202:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.817212:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817219:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817223:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817234:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817258:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d920862/0x5fb609b3016def52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817259:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817287:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.817292:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817299:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086dc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.817302:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817341:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817354:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817378:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817380:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817399:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.817408:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074060.817415:0:26174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001125a10b/0x5fb609b3016def59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.817481:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.817486:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817493:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.817496:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.817500:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817509:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817516:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817523:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817536:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.817548:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.817554:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817562:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c200 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:2.0:1783074060.817567:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074060.817574:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817576:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817597:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817597:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.817602:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074060.817612:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817614:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817631:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a8fb769/0x5fb609b3016def60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817636:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817648:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817650:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817654:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817656:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.817670:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817684:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.817694:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.817699:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817708:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086de00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.817711:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817719:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074060.817719:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074060.817730:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817737:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817740:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=2900s v=(0 0) 00010000:00010000:2.0:1783074060.817743:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074060.817749:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817760:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030dc27f4/0x5fb609b3016def67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817765:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817779:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817782:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817785:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817788:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074060.817799:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074060.817814:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074060.817822:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074060.817827:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817835:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074060.817839:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817847:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817858:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817866:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072aafb01/0x5fb609b3016def6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074060.817882:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817885:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074060.817893:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074060.820572:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783074060.821155:0:26174:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1200 00000100:00100000:2.0:1783074060.821284:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:87023:x1869685723505408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23762us (24148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074060.821295:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4888 00000100:00100000:1.0:1783074060.821394:0:87023:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87023:1869685723505408:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783074060.821408:0:87023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x4b0:0x0] 00000100:00100000:0.0:1783074060.821536:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723505792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074060.821579:0:87023:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87023:1869685723505920:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783074060.821580:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074060.821619:0:87023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074060.821671:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505792 00000100:00100000:2.0:1783074060.821677:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505792 00000100:00100000:2.0:1783074060.821720:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:2.0:1783074060.821728:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723505792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074060.821747:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074060.821778:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723505792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074060.821785:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1783074060.821830:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723505792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074060.821899:0:87023:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c1084840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074060.821936:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723505920 00000100:00100000:3.0:1783074060.821940:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723505920 00000100:00100000:3.0:1783074060.822008:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890 00000100:00100000:3.0:1783074060.822015:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:87023:x1869685723505920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783074060.822044:0:26173:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:1.0:1783074060.823530:0:87023:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87023:1869685723505920:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783074060.823542:0:87023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00000100:00100000:3.0:1783074060.823598:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:87023:x1869685723505920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1583us (1978us total) trans 4294968708 rc 0/0 00000100:00100000:3.0:1783074060.823606:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890 00010000:00010000:3.0:1783074060.910775:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074061.743572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074061.743623:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032000 00000100:00100000:1.0:1783074061.743632:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032000 00000100:00100000:1.0:1783074061.743681:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:1.0:1783074061.743691:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:42363:x1869685708032000:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074061.743708:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074061.743725:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc000/0x5fb609b3016def75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afa9 expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.743751:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc000/0x5fb609b3016def75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa9 expref: 6 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.743769:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc000/0x5fb609b3016def75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa9 expref: 6 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.743778:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc000, rc 0) 00000100:00100000:1.0:1783074061.743824:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708032000:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074061.743831:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1783074061.748152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074061.748231:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032128 00000100:00100000:3.0:1783074061.748239:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032128 00000100:00100000:3.0:1783074061.748282:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1783074061.748292:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c579f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708032128:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783074061.748374:0:87011:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783074061.748389:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783074061.748393:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783074061.748395:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783074061.748397:0:87011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783074061.748399:0:87011:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:3.0:1783074061.754283:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c579f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708032128:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 5984us (6130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074061.754294:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1783074061.757991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074061.758112:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032256 00000100:00100000:1.0:1783074061.758122:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032256 00000100:00100000:1.0:1783074061.758178:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1783074061.758188:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708032256:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074061.758204:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074061.758219:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc400/0x5fb609b3016def7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afb0 expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.758246:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc400/0x5fb609b3016def7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afb0 expref: 7 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.758256:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc400/0x5fb609b3016def7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afb0 expref: 7 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.758264:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc400, rc 0) 00000100:00100000:1.0:1783074061.758334:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708032256:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 147us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074061.758342:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1783074061.760271:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074061.760343:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032384 00000100:00100000:3.0:1783074061.760349:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032384 00000100:00100000:3.0:1783074061.760378:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:3.0:1783074061.760385:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708032384:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074061.760514:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708032384:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 130us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074061.760531:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:3.0:1783074061.761899:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074061.761942:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032512 00000100:00100000:2.0:1783074061.761959:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032512 00000100:00100000:2.0:1783074061.761994:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:2.0:1783074061.762002:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708032512:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074061.762092:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708032512:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074061.762098:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:2.0:1783074061.764485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074061.764605:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032640 00000100:00100000:1.0:1783074061.764621:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032640 00000100:00100000:1.0:1783074061.764670:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:1.0:1783074061.764679:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708032640:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074061.764691:0:87010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074061.764708:0:87010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd400/0x5fb609b3016def83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afb7 expref: -99 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.764732:0:87010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd400/0x5fb609b3016def83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afb7 expref: 9 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.764743:0:87010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd400/0x5fb609b3016def83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afb7 expref: 9 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074061.764751:0:87010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd400, rc 0) 00000100:00100000:1.0:1783074061.764796:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708032640:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074061.764802:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1783074061.766197:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074061.766242:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032768 00000100:00100000:2.0:1783074061.766249:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032768 00000100:00100000:2.0:1783074061.766295:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:2.0:1783074061.766303:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708032768:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074061.766866:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708032768:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 561us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074061.766874:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:3.0:1783074061.768732:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074061.768833:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708032896 00000100:00100000:1.0:1783074061.768841:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708032896 00000100:00100000:3.0:1783074061.768999:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1783074061.769012:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708032896:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074061.769183:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708032896:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 175us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074061.769191:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:1.0:1783074061.773787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074061.773841:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033024 00000100:00100000:2.0:1783074061.773849:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033024 00000100:00100000:2.0:1783074061.773900:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1783074061.773910:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708033024:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074061.773925:0:87008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074061.773941:0:87008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086cc00/0x5fb609b3016def8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afbe expref: -99 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074061.773978:0:87008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086cc00/0x5fb609b3016def8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afbe expref: 10 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074061.773989:0:87008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086cc00/0x5fb609b3016def8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afbe expref: 10 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074061.773998:0:87008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086cc00, rc 0) 00000100:00100000:2.0:1783074061.774050:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708033024:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 142us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074061.774058:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:0.0:1783074061.779543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074061.779674:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033152 00000100:00100000:3.0:1783074061.779683:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033152 00000100:00100000:3.0:1783074061.779802:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:3.0:1783074061.779813:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708033152:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074061.779924:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708033152:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 113us (387us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783074061.779933:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00010000:00010000:1.0:1783074061.934698:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074062.959170:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783074063.612222:0:87583:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1783074063.982450:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074064.511792:0:87631:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1783074064.881543:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074064.881970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074064.882029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074064.882056:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074064.882082:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033792 00000100:00100000:0.0:1783074064.882092:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033792 00000100:00100000:2.0:1783074064.882093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074064.882122:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033536 00000100:00100000:2.0:1783074064.882127:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033536 00000100:00100000:0.0:1783074064.882142:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033664 00000100:00100000:0.0:1783074064.882145:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033664 00000100:00100000:2.0:1783074064.882171:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033408 00000100:00100000:0.0:1783074064.882176:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2085 00000100:00100000:2.0:1783074064.882178:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033408 00000100:00100000:0.0:1783074064.882188:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708033792:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074064.882212:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 756 00000100:00100000:2.0:1783074064.882223:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708033536:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074064.882265:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708033792:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074064.882266:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708033536:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074064.882281:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2085 00000100:00100000:2.0:1783074064.882283:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 756 00000100:00100000:0.0:1783074064.882302:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2086 00000100:00100000:2.0:1783074064.882307:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 757 00000100:00100000:2.0:1783074064.882340:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708033408:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074064.882363:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708033408:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074064.882369:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 757 00000100:00100000:0.0:1783074064.882374:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708033664:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074064.882400:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708033664:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074064.882407:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2086 00000100:00080000:2.0:1783074064.882412:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783074064.882418:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074064.882421:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074064.882423:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074064.883083:0:87010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033280 00000100:00100000:1.0:1783074064.883089:0:87010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033280 00000100:00100000:1.0:1783074064.883127:0:87010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1783074064.883134:0:87010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708033280:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074064.883179:0:87010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708033280:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 46us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074064.883198:0:87010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00010000:00010000:3.0:1783074065.006642:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074065.838573:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783074065.838597:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723506048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074065.838670:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074065.838707:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723506176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074065.838713:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074065.838726:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723506304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074065.838734:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074065.838764:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074065.838801:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506048 00000100:00100000:1.0:1783074065.838807:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506048 00000100:00100000:0.0:1783074065.838808:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074065.838819:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e4068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723506432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074065.838849:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074065.838856:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506176 00000100:00100000:1.0:1783074065.838860:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506176 00000100:00100000:1.0:1783074065.838900:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:1.0:1783074065.838911:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723506048:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074065.838929:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00002000:00000024:1.0:1783074065.838943:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074065.838944:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723506176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074065.838963:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506304 00000100:00100000:3.0:1783074065.838969:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506304 00002000:00000024:0.0:1783074065.838980:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074065.838994:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723506048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074065.839001:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:3.0:1783074065.839006:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506432 00000100:00100000:3.0:1783074065.839011:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506432 00000100:00100000:1.0:1783074065.839035:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613 00000100:00100000:0.0:1783074065.839036:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723506176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074065.839044:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614 00000100:00100000:1.0:1783074065.839047:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723506304:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074065.839050:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:3.0:1783074065.839058:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723506432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074065.839076:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000004:00000024:3.0:1783074065.839082:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:0.0:1783074065.839085:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723506560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074065.839128:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074065.839211:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506560 00000100:00100000:2.0:1783074065.839216:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506560 00000100:00100000:2.0:1783074065.839244:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1783074065.839250:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4c7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723506560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783074065.839261:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074065.839633:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e4068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723506432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074065.839665:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723506304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 620us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074065.839674:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613 00000100:00100000:0.0:1783074065.839681:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723506048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074065.839704:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723506176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074065.839718:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074065.839726:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723506688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074065.839751:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074065.839774:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506688 00000100:00100000:0.0:1783074065.839777:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506688 00000100:00100000:0.0:1783074065.839801:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:0.0:1783074065.839806:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723506688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074065.839814:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074065.839838:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723506688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.839844:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:0.0:1783074065.839881:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723506688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074065.840402:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723507072:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840434:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074065.840459:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723507584:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840479:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074065.840496:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783074065.840501:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723506944:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840518:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074065.840532:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723507456:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840548:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074065.840617:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507072 00000100:00100000:0.0:1783074065.840621:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507072 00000100:00100000:0.0:1783074065.840647:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507584 00000100:00100000:0.0:1783074065.840650:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507584 00000100:00100000:0.0:1783074065.840661:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506944 00000100:00100000:0.0:1783074065.840662:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506944 00000100:00100000:0.0:1783074065.840672:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507456 00000100:00100000:0.0:1783074065.840674:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507456 00000100:00100000:0.0:1783074065.840685:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1783074065.840690:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c643b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723507072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840727:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c643b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723507072:12345-0@lo:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.840733:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1783074065.840747:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1783074065.840752:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723507584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840778:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723507584:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.840784:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1783074065.840796:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1783074065.840802:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723506944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.840840:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723506944:12345-0@lo:400:kworker.0 Request processed in 39us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.840846:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1783074065.840858:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1783074065.840864:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723507456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074065.840929:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723506432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1873us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074065.840937:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614 00000100:00080000:3.0:1783074065.840970:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074065.840974:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783074065.840977:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074065.840978:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074065.841004:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723507200:0@lo:400:kworker.0 00000100:00100000:3.0:1783074065.841032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074065.841068:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723506304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074065.841084:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783074065.841090:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723506816:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.841119:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723507456:12345-0@lo:400:kworker.0 Request processed in 254us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.841128:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1783074065.841141:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507200 00000100:00100000:0.0:1783074065.841144:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507200 00000100:00100000:0.0:1783074065.841170:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1783074065.841176:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723507200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.841205:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723507200:12345-0@lo:400:kworker.0 Request processed in 30us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.841211:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00080000:0.0:1783074065.841230:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074065.841252:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723506944:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.841266:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723507456:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.841274:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723507072:0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.841283:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723507584:0@lo:400:kworker.0 00000100:00100000:2.0:1783074065.843431:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4c7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723506560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4174us (4296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074065.843452:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1783074065.843762:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723506560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074065.845962:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074065.846036:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723507328:0@lo:400:kworker.0 00000100:00100000:3.0:1783074065.846088:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074065.846108:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723506816 00000100:00100000:2.0:1783074065.846117:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723506816 00000100:00100000:3.0:1783074065.846126:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723507200:0@lo:400:kworker.0 00000100:00100000:2.0:1783074065.846172:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783074065.846186:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723506816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.846212:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507328 00000100:00100000:0.0:1783074065.846217:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507328 00000100:00100000:2.0:1783074065.846242:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723506816:12345-0@lo:400:kworker.0 Request processed in 57us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074065.846260:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1783074065.846276:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074065.846281:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1783074065.846301:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723507328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074065.846358:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723507328:12345-0@lo:400:kworker.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.846364:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1783074065.846428:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723506816:0@lo:400:kworker.0 00000100:00100000:3.0:1783074065.846438:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723507328:0@lo:400:kworker.0 00000100:00100000:2.0:1783074065.924178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.924281:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708033920 00000100:00100000:0.0:1783074065.924290:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708033920 00000100:00100000:0.0:1783074065.924383:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1097 00000100:00100000:0.0:1783074065.924393:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708033920:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074065.924412:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074065.924434:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016def91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afc5 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.924495:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016def98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.924508:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016def98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.924526:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016def98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074065.924570:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074065.924574:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074065.924595:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016def98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.924615:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016def91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afc5 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.924631:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016def98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afc5 expref: 7 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.924651:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074065.924654:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074065.924657:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144000, rc 0) 00000100:00100000:0.0:1783074065.924795:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:67113:x1869685708033920:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 403us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.924802:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1097 00000100:00100000:3.0:1783074065.929048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.929141:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708034048 00000100:00100000:0.0:1783074065.929150:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708034048 00000100:00100000:0.0:1783074065.929196:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1098 00000100:00100000:0.0:1783074065.929206:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:67113:x1869685708034048:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074065.929234:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:0.0:1783074065.929354:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:67113:x1869685708034048:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 147us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.929363:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1098 00000100:00100000:2.0:1783074065.930814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.931079:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708034176 00000100:00100000:0.0:1783074065.931084:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708034176 00000100:00100000:0.0:1783074065.931121:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1099 00000100:00100000:0.0:1783074065.931128:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708034176:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074065.931146:0:68632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:0.0:1783074065.931193:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708034176:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 66us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.931199:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1099 00000100:00100000:2.0:1783074065.933169:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.933293:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708034304 00000100:00100000:0.0:1783074065.933300:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708034304 00000100:00100000:0.0:1783074065.933371:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1657 00000100:00100000:0.0:1783074065.933392:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708034304:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074065.933412:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074065.933471:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708034304:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 80us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.933478:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1657 00000100:00100000:3.0:1783074065.935357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074065.935454:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708034432 00000100:00100000:2.0:1783074065.935461:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708034432 00000100:00100000:2.0:1783074065.935557:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1658 00000100:00100000:2.0:1783074065.935567:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708034432:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074065.935585:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074065.935649:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67113:x1869685708034432:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074065.935655:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1658 00000100:00100000:2.0:1783074065.955855:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.955934:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708034560 00000100:00100000:0.0:1783074065.955944:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708034560 00000100:00100000:0.0:1783074065.956017:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1100 00000100:00100000:0.0:1783074065.956030:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:67131:x1869685708034560:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074065.956049:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074065.956067:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016def9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afcc expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956135:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956151:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956161:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956179:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956185:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956191:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956275:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016defb4 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956282:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016defb4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956288:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016defb4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074065.956362:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783074065.956366:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074065.956384:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016defb4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956398:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956404:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956410:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956415:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.956420:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956427:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956439:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074065.956447:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.956452:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956459:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016defa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956473:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956479:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956485:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956490:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.956493:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956498:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956505:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9524d30b3200) 00010000:00010000:0.0:1783074065.956507:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.956510:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956515:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016defad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956549:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016def9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afcc expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956568:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016defb4 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afcc expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.956573:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:0.0:1783074065.956574:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074065.956576:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144a00, rc 0) 00000100:00100000:0.0:1783074065.956635:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67131:x1869685708034560:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 609us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.956653:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1100 00000100:00100000:3.0:1783074065.958189:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.958307:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708034816 00000100:00100000:0.0:1783074065.958346:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708034816 00000100:00100000:0.0:1783074065.958395:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1101 00000100:00100000:0.0:1783074065.958406:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67131:x1869685708034816:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074065.958421:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074065.958437:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016defbb lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afd3 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958499:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958511:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958537:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958562:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958580:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958589:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958661:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958669:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958675:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958681:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958686:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.958690:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958697:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958709:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:0.0:1783074065.958711:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.958714:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958720:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016defc2 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958741:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958746:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958751:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958755:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.958758:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958763:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958770:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9524d30b3100) 00010000:00010000:0.0:1783074065.958772:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.958774:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958779:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defc9 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958807:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016defbb lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afd3 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958817:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:0.0:1783074065.958819:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074065.958833:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016defbb lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afd3 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.958843:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144e00, rc 0) 00000100:00100000:0.0:1783074065.958918:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67131:x1869685708034816:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 507us (725us total) trans 0 rc 301/301 00000100:00100000:0.0:1783074065.958926:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1101 00000100:00100000:3.0:1783074065.965980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.966096:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708035072 00000100:00100000:0.0:1783074065.966109:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708035072 00000100:00100000:0.0:1783074065.966213:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1102 00000100:00100000:0.0:1783074065.966223:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67131:x1869685708035072:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074065.966241:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074065.966259:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afda expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074065.966360:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783074065.966465:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afda expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.966478:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074065.966481:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074065.966485:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016defd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afda expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.966499:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868a00, rc 0) 00000100:00100000:0.0:1783074065.966556:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:67131:x1869685708035072:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 334us (585us total) trans 107374182401 rc 301/301 00000100:00100000:0.0:1783074065.966563:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1102 00000100:00100000:2.0:1783074065.969159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.969925:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708035200 00000100:00100000:0.0:1783074065.969934:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708035200 00000100:00100000:0.0:1783074065.969994:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1103 00000100:00100000:0.0:1783074065.970003:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:67131:x1869685708035200:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:0.0:1783074065.970135:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970152:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970163:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970179:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970187:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970193:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970261:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970269:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970276:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074065.970335:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074065.970359:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970374:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970380:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 2/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970388:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970394:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.970398:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970406:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970418:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:0.0:1783074065.970422:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.970426:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970432:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016defde lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970446:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970452:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970458:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970469:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.970472:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970479:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970488:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9524d30b3100) 00010000:00010000:0.0:1783074065.970490:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.970493:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970498:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016defe5 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970515:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970521:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970527:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970532:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074065.970535:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970541:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970559:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:0.0:1783074065.970561:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074065.970565:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074065.970571:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016defec lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074065.970655:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:67131:x1869685708035200:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 653us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074065.970663:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1103 00000100:00100000:2.0:1783074065.976589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074065.976841:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708035456 00000100:00100000:0.0:1783074065.976851:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708035456 00000100:00100000:0.0:1783074065.976923:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:0.0:1783074065.976933:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c3cec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:67131:x1869685708035456:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1783074065.977226:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c3cec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67131:x1869685708035456:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 284us (634us total) trans 107374182402 rc 0/0 00000100:00100000:0.0:1783074065.977236:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 219 00000001:00080000:1.0:1783074065.979162:0:87004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00010000:00010000:1.0:1783074066.030528:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783074066.866452:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968708 is committed 00000001:00100000:1.0:1783074066.866493:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00080000:2.0:1783074066.866939:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968713 is committed 00000001:00100000:2.0:1783074066.866978:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00010000:00010000:3.0:1783074067.055139:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074068.079509:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783074069.091914:0:87826:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 06:21:07 (1783074067) 00010000:00010000:3.0:1783074069.104785:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074069.133391:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074069.133470:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708035584 00000100:00100000:0.0:1783074069.133480:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708035584 00000100:00080000:1.0:1783074069.133534:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074069.133588:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1104 00000100:00100000:0.0:1783074069.133600:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67716:x1869685708035584:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074069.133623:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074069.133642:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016deff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afe1 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133701:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133721:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133732:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133747:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133754:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133762:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133798:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133817:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133824:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133830:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133836:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074069.133841:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133847:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133863:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074069.133866:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074069.133871:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133876:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016deffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133888:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133894:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133900:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133905:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074069.133907:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133913:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133920:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9524d0a86300) 00010000:00010000:0.0:1783074069.133922:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074069.133924:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133930:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133970:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016deff3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe1 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133980:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074069.133983:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074069.133986:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016deff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe1 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.133997:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868200, rc 0) 00000100:00100000:0.0:1783074069.134057:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67716:x1869685708035584:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 461us (676us total) trans 0 rc 301/301 00000100:00100000:0.0:1783074069.134064:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1104 00000100:00100000:2.0:1783074069.141998:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074069.142084:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708035840 00000100:00100000:0.0:1783074069.142094:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708035840 00000100:00100000:0.0:1783074069.142157:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1105 00000100:00100000:0.0:1783074069.142167:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67716:x1869685708035840:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074069.142186:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074069.142189:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783074069.142214:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016def98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afc5 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142231:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074069.142242:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074069.142256:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016df008 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afe8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142379:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142392:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142401:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142414:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142421:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142427:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142802:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142824:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142831:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074069.142841:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:0.0:1783074069.142864:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142871:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142883:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142890:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142896:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074069.142900:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142907:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142915:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0a86200) 00010000:00010000:0.0:1783074069.142918:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074069.142922:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142927:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016df00f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074069.142939:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f3b288e reply state 00000000a8b4617a transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142950:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.142957:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9524d0a86600) 00010000:00010000:0.0:1783074069.142959:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074069.142962:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074069.142987:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016df008 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.143012:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.143020:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0a86800) 00010000:00010000:0.0:1783074069.143022:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074069.143025:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868000, rc 0) 00000100:00100000:0.0:1783074069.143081:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67716:x1869685708035840:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 916us (1093us total) trans 107374182403 rc 0/0 00000100:00100000:0.0:1783074069.143089:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1105 00000100:00100000:2.0:1783074069.152440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074069.152525:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708036096 00000100:00100000:1.0:1783074069.152535:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708036096 00000100:00100000:1.0:1783074069.152600:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1106 00000100:00100000:1.0:1783074069.152610:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67716:x1869685708036096:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074069.152633:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074069.152655:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263afef expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.152758:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.152772:0:66202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 11 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.152781:0:66202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.152825:0:66202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 11 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.152839:0:66202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 11 pid: 68632 timeout: 3008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074069.152853:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66202:1869685723507712:192.168.204.26@tcp:104: 00000100:00100000:1.0:1783074069.152939:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074069.157034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074069.157129:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66202:1869685723507712:192.168.204.26@tcp:104: 00000100:00100000:3.0:1783074069.157141:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708036224 00000100:00100000:3.0:1783074069.157152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708036224 00010000:00010000:2.0:1783074069.157156:0:66202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157182:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 12 pid: 68632 timeout: 3008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074069.157221:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2574 00000100:00100000:3.0:1783074069.157229:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2405:x1869685708036224:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074069.157242:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074069.157248:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 12 pid: 68632 timeout: 3008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157260:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 12 pid: 68632 timeout: 3008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157287:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016df01d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afe8 expref: 12 pid: 68632 timeout: 3008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157305:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0a86800) 00010000:00010000:3.0:1783074069.157336:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157346:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157354:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.157423:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074069.157478:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2405:x1869685708036224:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 248us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074069.157496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2574 00010000:00010000:2.0:1783074069.157534:0:66202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.157542:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074069.157559:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1783074069.157931:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.157939:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.157946:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.157952:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074069.157957:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.157964:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.157975:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0a86800) 00010000:00010000:2.0:1783074069.157978:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783074069.157982:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.158000:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df032 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.158056:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df02b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afef expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.158066:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9200) 00010000:00010000:2.0:1783074069.158069:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074069.158073:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afef expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.158086:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bca00, rc 0) 00000100:00100000:2.0:1783074069.158160:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67716:x1869685708036096:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 5552us (5728us total) trans 107374182404 rc 301/301 00000100:00100000:2.0:1783074069.158168:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1106 00000100:00100000:1.0:1783074069.160632:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074069.160709:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708036480 00000100:00100000:0.0:1783074069.160717:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708036480 00000100:00100000:0.0:1783074069.160791:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 220 00000100:00100000:0.0:1783074069.160801:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67716:x1869685708036480:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1783074069.161025:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:67716:x1869685708036480:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 224us (396us total) trans 107374182405 rc 0/0 00000100:00100000:0.0:1783074069.161034:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 220 00000100:00100000:1.0:1783074069.165428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074069.165506:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708036736 00000100:00100000:3.0:1783074069.165520:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708036736 00000100:00100000:3.0:1783074069.165575:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 221 00000100:00100000:3.0:1783074069.165585:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:67716:x1869685708036736:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1783074069.165813:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:67716:x1869685708036736:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 220us (383us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1783074069.165821:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 221 00000001:00080000:1.0:1783074069.566744:0:87004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:2.0:1783074069.566844:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.566856:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.566864:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.566870:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074069.566874:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.566896:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.566912:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9524d0a86600) 00010000:00010000:2.0:1783074069.566915:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074069.566919:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.566925:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016df016 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074069.607693:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074069.608007:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708036864 00000100:00100000:1.0:1783074069.608017:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708036864 00000100:00100000:1.0:1783074069.608081:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1107 00000100:00100000:1.0:1783074069.608093:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:67728:x1869685708036864:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074069.608120:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074069.608142:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df040 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263aff6 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.608201:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df047 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.608213:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.608222:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074069.608259:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783074069.608262:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074069.608277:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.608294:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aff6 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.608305:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aff6 expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.608339:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9300) 00010000:00010000:1.0:1783074069.608342:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783074069.608346:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd000, rc 0) 00000100:00100000:1.0:1783074069.608401:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67728:x1869685708036864:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 311us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074069.608408:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1107 00000100:00100000:0.0:1783074069.614448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074069.614552:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708036992 00000100:00100000:3.0:1783074069.614561:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708036992 00000100:00100000:3.0:1783074069.614645:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1108 00000100:00100000:3.0:1783074069.614656:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67728:x1869685708036992:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074069.614691:0:68632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00100000:3.0:1783074069.614751:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67728:x1869685708036992:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074069.614763:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1108 00000100:00100000:3.0:1783074069.620018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074069.620160:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037120 00000100:00100000:2.0:1783074069.620169:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037120 00000100:00100000:2.0:1783074069.620237:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1109 00000100:00100000:2.0:1783074069.620247:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67728:x1869685708037120:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074069.620289:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074069.620396:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:67728:x1869685708037120:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 149us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074069.620403:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1109 00000100:00080000:1.0:1783074069.620609:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074069.624287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074069.624906:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037248 00000100:00100000:0.0:1783074069.624914:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037248 00000100:00100000:0.0:1783074069.624991:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1659 00000100:00100000:0.0:1783074069.625002:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:67728:x1869685708037248:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074069.625035:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074069.625109:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:67728:x1869685708037248:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 108us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074069.625117:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1659 00000100:00080000:1.0:1783074069.625874:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074069.629878:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074069.630581:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037376 00000100:00100000:1.0:1783074069.630591:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037376 00000100:00100000:1.0:1783074069.630657:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1660 00000100:00100000:1.0:1783074069.630668:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:67728:x1869685708037376:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:1.0:1783074069.630697:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783074069.630741:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074069.630759:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:67728:x1869685708037376:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 91us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074069.630767:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1660 00000100:00100000:0.0:1783074069.667089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074069.667249:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037632 00000100:00100000:0.0:1783074069.667259:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037632 00000100:00100000:0.0:1783074069.667330:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1110 00000100:00100000:0.0:1783074069.667340:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:67735:x1869685708037632:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00010000:0.0:1783074069.667392:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074069.667417:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df047 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263aff6 expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.667434:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9300) 00010000:00010000:0.0:1783074069.667444:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074069.667669:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.667683:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.667693:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.667709:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.667716:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.667735:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668749:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668757:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668764:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668769:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074069.668774:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668782:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668901:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc2ffe00) 00010000:00010000:0.0:1783074069.668905:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074069.668908:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668915:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df04e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074069.668931:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e574169 reply state 000000008a719b9d transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668941:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074069.668955:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ff500) 00010000:00010000:0.0:1783074069.668958:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074069.668961:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074069.669045:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:67735:x1869685708037632:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 1705us (1963us total) trans 107374182407 rc 0/0 00000100:00100000:0.0:1783074069.669053:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1110 00000100:00100000:0.0:1783074069.684040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074069.684854:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037760 00000100:00100000:3.0:1783074069.684864:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037760 00000100:00100000:3.0:1783074069.684986:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1111 00000100:00100000:3.0:1783074069.685000:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:67738:x1869685708037760:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074069.685022:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074069.685043:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016df05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263affd expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.685126:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.685139:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.685151:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074069.685199:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074069.685203:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074069.685225:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.685249:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016df05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263affd expref: 11 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.685266:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263affd expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074069.685275:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc299500) 00010000:00010000:3.0:1783074069.685278:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074069.685282:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52000, rc 0) 00000100:00100000:3.0:1783074069.685364:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67738:x1869685708037760:12345-192.168.204.26@tcp:101:rm.0 Request processed in 367us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074069.685373:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1111 00000100:00100000:1.0:1783074069.688710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074069.688808:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037888 00000100:00100000:2.0:1783074069.688817:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037888 00000100:00100000:2.0:1783074069.688903:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1112 00000100:00100000:2.0:1783074069.688914:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:67738:x1869685708037888:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1783074069.688932:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074069.688950:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df06a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b004 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689027:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689041:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689052:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689064:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689071:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689077:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689169:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689178:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689184:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074069.689219:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783074069.689222:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074069.689240:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689259:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689268:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689274:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689279:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689284:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689290:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074069.689294:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689301:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689349:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc299500) 00010000:00010000:2.0:1783074069.689353:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074069.689358:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689364:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689379:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689391:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689397:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689402:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074069.689404:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689410:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689418:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ff500) 00010000:00010000:2.0:1783074069.689420:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074069.689424:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689429:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689453:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df06a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b004 expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689465:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b004 expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.689471:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9523c8d7c700) 00010000:00010000:2.0:1783074069.689473:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074069.689481:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c000, rc 0) 00000100:00100000:2.0:1783074069.689532:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:67738:x1869685708037888:12345-192.168.204.26@tcp:101:rm.0 Request processed in 620us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074069.689539:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1112 00000100:00100000:0.0:1783074069.693341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074069.693389:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038144 00000100:00100000:2.0:1783074069.693396:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038144 00000100:00100000:2.0:1783074069.693435:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1113 00000100:00100000:2.0:1783074069.693442:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:67738:x1869685708038144:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1783074069.693483:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783074069.693505:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df07f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b004 expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693522:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9523c8d7c700) 00010000:00010000:2.0:1783074069.693536:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263affd expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693546:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc299500) 00010000:00010000:2.0:1783074069.693552:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074069.693573:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693584:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693593:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693603:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693627:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693635:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693706:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693725:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.693733:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694195:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694205:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694213:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694221:0:66201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694227:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694233:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694292:0:66201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074069.694331:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694338:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694343:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694348:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074069.694352:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694359:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694368:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9523c8d7cd00) 00010000:00010000:2.0:1783074069.694371:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783074069.694374:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694379:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d000/0x5fb609b3016df094 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694393:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694399:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694416:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694421:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074069.694424:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694429:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694437:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:2.0:1783074069.694440:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074069.694443:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694449:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016df086 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074069.694461:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040085f80 reply state 000000002d92e500 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694472:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074069.694478:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ff500) 00010000:00010000:2.0:1783074069.694480:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074069.694483:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074069.694560:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:67738:x1869685708038144:12345-192.168.204.26@tcp:36:rm.0 Request processed in 1112us (1249us total) trans 107374182408 rc 0/0 00000100:00100000:2.0:1783074069.694568:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1113 00010000:00010000:1.0:1783074069.695160:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074069.695168:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.695175:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086dc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074069.695179:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.695186:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.695203:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9523c8d7cd00) 00010000:00010000:1.0:1783074069.695205:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783074069.695209:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.695215:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df09b lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074069.695229:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074069.695231:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074069.695233:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074070.001276:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074070.001381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074070.001424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074070.001433:0:87008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038272 00000100:00100000:3.0:1783074070.001441:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074070.001444:0:87008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038272 00000100:00100000:3.0:1783074070.001459:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074070.001511:0:87008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:2.0:1783074070.001521:0:87008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708038272:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074070.001592:0:87008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708038272:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074070.001601:0:87008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:1.0:1783074070.001672:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038400 00000100:00100000:1.0:1783074070.001677:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038400 00000100:00100000:1.0:1783074070.001712:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038528 00000100:00100000:1.0:1783074070.001715:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038528 00000100:00100000:1.0:1783074070.001737:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 764 00000100:00100000:1.0:1783074070.001744:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2404:x1869685708038400:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074070.001787:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2404:x1869685708038400:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.001800:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 765 00000100:00100000:1.0:1783074070.001810:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 764 00000100:00100000:3.0:1783074070.001816:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708038528:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074070.001842:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038784 00000100:00100000:3.0:1783074070.001843:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708038528:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.001849:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038784 00000100:00100000:3.0:1783074070.001851:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 765 00000100:00100000:1.0:1783074070.001875:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038656 00000100:00100000:1.0:1783074070.001878:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038656 00000100:00100000:1.0:1783074070.001895:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2087 00000100:00100000:1.0:1783074070.001902:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708038784:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074070.001929:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708038784:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.001945:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2087 00000100:00100000:1.0:1783074070.001971:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2088 00000100:00100000:1.0:1783074070.001976:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708038656:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074070.001998:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708038656:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.002004:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2088 00010000:00010000:3.0:1783074070.127409:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074070.959741:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e3c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723508096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074070.959819:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074070.959831:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723508224:0@lo:400:kworker.0 00000100:00100000:1.0:1783074070.959853:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723508608:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.959878:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074070.959888:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723507968:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.959922:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723508736:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.959953:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074070.959974:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723509248:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.959984:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e3c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723507840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074070.960001:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.960022:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074070.960025:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723509760:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.960064:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074070.960090:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074070.960124:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723508480:0@lo:400:kworker.0 00000100:00100000:1.0:1783074070.960146:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074070.960164:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723509120:0@lo:400:kworker.0 00000100:00100000:1.0:1783074070.960185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074070.960213:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723509504:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.960223:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509120 00000100:00100000:0.0:1783074070.960231:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509120 00000100:00100000:1.0:1783074070.960243:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074070.960285:0:87011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507968 00000100:00100000:0.0:1783074070.960286:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509504 00000100:00100000:1.0:1783074070.960290:0:87011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507968 00000100:00100000:0.0:1783074070.960292:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509504 00000100:00100000:0.0:1783074070.960347:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1783074070.960355:0:87011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783074070.960361:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508096 00000100:00100000:0.0:1783074070.960361:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723509120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.960368:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508096 00000100:00100000:1.0:1783074070.960368:0:87011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723507968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.960407:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723507840 00000100:00100000:2.0:1783074070.960411:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723507840 00000100:00100000:1.0:1783074070.960416:0:87011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723507968:12345-0@lo:400:kworker.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074070.960432:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1783074070.960437:0:87011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783074070.960444:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723508096:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074070.960474:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:1.0:1783074070.960482:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723509504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074070.960516:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723509504:12345-0@lo:400:kworker.0 Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.960523:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00002000:00000024:2.0:1783074070.960531:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074070.960537:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723509120:12345-0@lo:400:kworker.0 Request processed in 179us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074070.960547:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1783074070.960550:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:1.0:1783074070.960560:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723507840:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074070.960579:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723508096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (758us total) trans 0 rc 0/0 00002000:00000024:1.0:1783074070.960579:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074070.960590:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1783074070.960629:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723507840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.960640:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:2.0:1783074070.960659:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508224 00000100:00100000:2.0:1783074070.960664:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508224 00000100:00100000:1.0:1783074070.960666:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074070.960694:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1783074070.960702:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074070.960705:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c57edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723508224:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783074070.960721:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c57edc00 x1869685723508224/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1783074081 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074070.960734:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723507968:0@lo:400:kworker.0 00000100:00100000:1.0:1783074070.960751:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723509120:0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.960760:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c57edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723508224:12345-0@lo:400:kworker.0 Request processed in 58us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.960763:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968713 gen 2 00000100:00100000:2.0:1783074070.960783:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1783074070.960792:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723509504:0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.960798:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509248 00000100:00100000:2.0:1783074070.960808:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509248 00000100:00100000:1.0:1783074070.960821:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510016 00000100:00100000:1.0:1783074070.960826:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510016 00000100:00100000:2.0:1783074070.960834:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509760 00000100:00100000:2.0:1783074070.960838:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509760 00000100:00100000:1.0:1783074070.960858:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1783074070.960860:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508480 00000100:00100000:2.0:1783074070.960864:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508480 00000100:00100000:1.0:1783074070.960868:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723510016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783074070.960879:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074070.960914:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723510016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.960921:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1783074070.960925:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1783074070.960936:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723509248:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783074070.960949:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b17100 x1869685723509248/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1783074081 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074070.960950:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968708 gen 2 00000100:00100000:1.0:1783074070.960969:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074070.960986:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723509248:12345-0@lo:400:kworker.0 Request processed in 53us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074070.960991:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1783074070.961001:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1783074070.961006:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723509760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074070.961014:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1783074070.961024:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723508480:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783074070.961036:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4a03480 x1869685723508480/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1783074081 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:2.0:1783074070.961060:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b14380 x1869685723509760/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1783074081 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074070.961069:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723508480:12345-0@lo:400:kworker.0 Request processed in 44us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.961077:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1783074070.961091:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723509760:12345-0@lo:400:kworker.0 Request processed in 84us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074070.961097:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:1.0:1783074070.961102:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508736 00000100:00100000:1.0:1783074070.961107:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508736 00000100:00100000:1.0:1783074070.961137:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615 00000100:00100000:1.0:1783074070.961144:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723508736:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783074070.961158:0:8453:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b15c00 x1869685723508736/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/224 e 0 to 0 dl 1783074081 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074070.961183:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723508736:12345-0@lo:400:kworker.0 Request processed in 40us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074070.961188:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615 00000100:00080000:0.0:1783074070.961242:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783074070.961247:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074070.961249:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074070.961273:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723508224:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961283:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e3c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723507840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074070.961287:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723508736:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961295:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723508352:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.961298:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723509248:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.961305:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723509760:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961341:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.961369:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723508864:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961387:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.961405:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723509376:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961430:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.961452:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723509888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074070.961473:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074070.961477:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508352 00000100:00100000:2.0:1783074070.961482:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508352 00000100:00100000:3.0:1783074070.961516:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508864 00000100:00100000:0.0:1783074070.961552:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074070.961558:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723510144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074070.961576:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.961588:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508864 00000100:00080000:0.0:1783074070.961599:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074070.961618:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1783074070.961628:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723508864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961677:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723508864:12345-0@lo:400:kworker.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.961683:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1783074070.961698:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509376 00000100:00100000:3.0:1783074070.961701:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509376 00000100:00100000:3.0:1783074070.961755:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510144 00000100:00100000:3.0:1783074070.961758:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510144 00000100:00100000:3.0:1783074070.961783:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:3.0:1783074070.961789:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723509376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.961821:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723509376:12345-0@lo:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.961826:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:3.0:1783074070.961837:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:3.0:1783074070.961842:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723510144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783074070.961859:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:3.0:1783074070.961889:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723510144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.961894:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:3.0:1783074070.961912:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509888 00000100:00100000:3.0:1783074070.961915:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509888 00000100:00100000:3.0:1783074070.961940:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:2.0:1783074070.961946:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1783074070.961951:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723509888:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074070.961959:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723508352:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1783074070.961963:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074070.962000:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723509888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.962007:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:2.0:1783074070.962007:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723508352:12345-0@lo:400:kworker.0 Request processed in 52us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074070.962017:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1783074070.962053:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723510144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074070.962068:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723508480:0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.962072:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723508352:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.962092:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074070.962101:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723508864:0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.962119:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723508992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074070.962123:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723509376:0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.962143:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723509888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074070.962150:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.962174:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723509632:0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.962186:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508608 00000100:00100000:2.0:1783074070.962191:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508608 00000100:00100000:3.0:1783074070.962195:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074070.962232:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e3c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723508096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074070.962237:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1783074070.962245:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723508608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074070.962256:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723508992 00000100:00100000:3.0:1783074070.962260:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723508992 00000100:00100000:2.0:1783074070.962285:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723508608:12345-0@lo:400:kworker.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.962286:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:2.0:1783074070.962298:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1783074070.962300:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723508992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783074070.962340:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444753408 avail 1298513920 00000100:00080000:0.0:1783074070.962349:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000080:3.0:1783074070.962351:0:26189:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524edc4dc00 x1869685723508992/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/368 e 0 to 0 dl 1783074081 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074070.962363:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723509632 00000100:00100000:2.0:1783074070.962368:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723509632 00000100:00100000:3.0:1783074070.962387:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723508992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074070.962395:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:2.0:1783074070.962400:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1783074070.962408:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524edc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723509632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074070.962448:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524edc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723509632:12345-0@lo:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074070.962454:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1783074070.962496:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723508608:0@lo:400:kworker.0 00000100:00100000:0.0:1783074070.962516:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723508992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074070.962527:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723509632:0@lo:400:kworker.0 00010000:00010000:1.0:1783074071.151056:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074072.174864:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074072.795811:0:88221:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1783074072.830021:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074072.830794:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038912 00000100:00100000:3.0:1783074072.830804:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038912 00000100:00100000:3.0:1783074072.830880:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1114 00000100:00100000:3.0:1783074072.830891:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:67806:x1869685708038912:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074072.830909:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074072.830929:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016df0a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b00b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074072.831000:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df0a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074072.831012:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074072.831024:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074072.831070:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074072.831074:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074072.831104:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074072.831128:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016df0a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b00b expref: 13 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074072.831145:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b00b expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074072.831153:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc299b00) 00010000:00010000:3.0:1783074072.831156:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074072.831160:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53200, rc 0) 00010000:00000080:3.0:1783074072.831167:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b17800 x1869685708038912/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:398/0 lens 576/688 e 0 to 0 dl 1783074083 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074072.831224:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:67806:x1869685708038912:12345-192.168.204.26@tcp:101:dd.0 Request processed in 335us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074072.831231:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1114 00000100:00080000:1.0:1783074072.831501:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783074072.833405:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074072.833474:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039168 00000100:00100000:2.0:1783074072.833482:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039168 00000100:00100000:2.0:1783074072.833526:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1115 00000100:00100000:2.0:1783074072.833534:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:67806:x1869685708039168:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074072.833548:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074072.833550:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783074072.833569:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df0a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b00b expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833595:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc299b00) 00010000:00010000:2.0:1783074072.833604:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074072.833616:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df0b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b012 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833724:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833735:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833754:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833765:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833771:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833777:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833824:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833831:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.833837:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074072.834007:0:66202:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1783074072.834011:0:66202:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1783074068 00000004:00010000:2.0:1783074072.834014:0:66202:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1783074068 00000004:00010000:2.0:1783074072.834016:0:66202:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1783074068 00000004:00010000:2.0:1783074072.834019:0:66202:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1783074072.834022:0:66202:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1783074072.834028:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834034:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834040:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834046:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834052:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074072.834056:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834063:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834071:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0ae5b00) 00010000:00010000:2.0:1783074072.834073:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074072.834076:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834091:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016df0b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834101:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834106:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834112:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834117:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086ce00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074072.834120:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834125:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834131:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9524d0ae5700) 00010000:00010000:2.0:1783074072.834134:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074072.834136:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834141:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ce00/0x5fb609b3016df0be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834172:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c600/0x5fb609b3016df0b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834195:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 13 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074072.834201:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0ae5e00) 00010000:00010000:2.0:1783074072.834204:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783074072.834206:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c000, rc 0) 00010000:00000080:2.0:1783074072.834211:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b7b80 x1869685708039168/t107374182409(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:398/0 lens 752/824 e 0 to 0 dl 1783074083 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074072.834263:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:67806:x1869685708039168:12345-192.168.204.26@tcp:101:dd.0 Request processed in 730us (864us total) trans 107374182409 rc 0/0 00000100:00100000:2.0:1783074072.834270:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1115 00000100:00100000:0.0:1783074072.836690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074072.838981:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039296 00000100:00100000:1.0:1783074072.838993:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039296 00000100:00100000:1.0:1783074072.839053:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1116 00000100:00100000:1.0:1783074072.839063:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:67806:x1869685708039296:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074072.839084:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074072.839102:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df0d3 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b019 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.839133:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df0da lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.839147:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df0da lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.839158:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df0da lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.839258:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016df0d3 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b019 expref: 15 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.839273:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df0da lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b019 expref: 14 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.839280:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0ae5e00) 00010000:00010000:1.0:1783074072.839283:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074072.839286:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd000, rc 0) 00010000:00000080:1.0:1783074072.839292:0:66201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b16a00 x1869685708039296/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:398/0 lens 568/1272 e 0 to 0 dl 1783074083 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074072.839374:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:67806:x1869685708039296:12345-192.168.204.26@tcp:101:dd.0 Request processed in 312us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074072.839382:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1116 00000100:00100000:3.0:1783074072.842086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074072.842160:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039552 00000100:00100000:0.0:1783074072.842169:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039552 00000100:00100000:0.0:1783074072.842223:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1117 00000100:00100000:0.0:1783074072.842232:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e3c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:67806:x1869685708039552:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1783074072.842428:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.842451:0:66200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.842460:0:66200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.842494:0:66200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.842520:0:66200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 14 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074072.842535:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66200:1869685723510272:192.168.204.26@tcp:104: 00000100:00100000:0.0:1783074072.842654:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074072.844803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074072.844828:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66200:1869685723510272:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074072.844852:0:66200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074072.845299:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039680 00000100:00100000:1.0:1783074072.845305:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039680 00010000:00010000:1.0:1783074072.845346:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 15 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074072.845390:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2575 00000100:00100000:1.0:1783074072.845400:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:2405:x1869685708039680:12345-192.168.204.26@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1783074072.845415:0:19655:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 15 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.845426:0:19655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 15 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.845436:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 15 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.845456:0:19655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0ae5e00) 00010000:00010000:1.0:1783074072.845459:0:19655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1783074072.845463:0:19655:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.845471:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.845478:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074072.845505:0:19655:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 15 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074072.845570:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:2405:x1869685708039680:12345-192.168.204.26@tcp:102:ldlm_bl.0 Request processed in 162us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074072.845579:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2575 00010000:00010000:0.0:1783074072.845590:0:66200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.845601:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074072.845730:0:66200:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783074072.845734:0:66200:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783074068 -> 1783074072 00000004:00010000:0.0:1783074072.846597:0:66200:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783074068 -> 1783074068 00000004:00010000:0.0:1783074072.846600:0:66200:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783074068 -> 1783074072 00000004:00010000:0.0:1783074072.846602:0:66200:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1783074072.846610:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bce9f32 reply state 00000000ba20f13d transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.846630:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074072.846637:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0ae5e00) 00010000:00010000:0.0:1783074072.846640:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074072.846642:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783074072.846694:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524e3c54000 x1869685708039552/t107374182410(0) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:398/0 lens 488/456 e 0 to 0 dl 1783074083 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074072.846752:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e3c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+16:67806:x1869685708039552:12345-192.168.204.26@tcp:36:dd.0 Request processed in 4520us (4672us total) trans 107374182410 rc 0/0 00000100:00100000:0.0:1783074072.846759:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1117 00000100:00100000:0.0:1783074072.849834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074072.850137:0:66213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039808 00000100:00100000:3.0:1783074072.850147:0:66213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039808 00002000:00010000:3.0:1783074072.850188:0:66213:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1783074072.850194:0:66213:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9524c4b14a80 with x1869685708039808 00000100:00100000:3.0:1783074072.850234:0:66213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1783074072.850245:0:66213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+16:2405:x1869685708039808:12345-192.168.204.26@tcp:10:dd.0 00000004:00010000:3.0:1783074072.851380:0:66213:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1783074072.851387:0:66213:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783074072 -> 1783074072 00000004:00010000:3.0:1783074072.851390:0:66213:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783074068 -> 1783074068 00000004:00010000:3.0:1783074072.851393:0:66213:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783074072 -> 1783074072 00000004:00010000:3.0:1783074072.851396:0:66213:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783074072.851417:0:66213:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b14a80 x1869685708039808/t107374182411(0) o10->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:398/0 lens 440/432 e 0 to 0 dl 1783074083 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074072.851566:0:66213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+17:2405:x1869685708039808:12345-192.168.204.26@tcp:10:dd.0 Request processed in 1257us (1674us total) trans 107374182411 rc 0/0 00000100:00100000:3.0:1783074072.851576:0:66213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00002000:00010000:3.0:1783074072.851581:0:66213:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1783074072.851584:0:66213:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9524c4b14a80 with x1869685708039808 00000100:00100000:0.0:1783074072.855090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074072.855153:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040064 00000100:00100000:2.0:1783074072.855162:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040064 00000100:00100000:2.0:1783074072.855219:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 222 00000100:00100000:2.0:1783074072.855228:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+17:67806:x1869685708040064:12345-192.168.204.26@tcp:35:dd.0 00010000:00000080:2.0:1783074072.855414:0:66204:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c4b17b80 x1869685708040064/t107374182412(0) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:398/0 lens 392/456 e 0 to 0 dl 1783074083 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074072.855521:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+18:67806:x1869685708040064:12345-192.168.204.26@tcp:35:dd.0 Request processed in 285us (429us total) trans 107374182412 rc 0/0 00000100:00100000:2.0:1783074072.855530:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 222 00010000:00010000:1.0:1783074073.199850:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783074073.731306:0:88318:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783074073.731414:0:88318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.731428:0:88318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.731445:0:88318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.731452:0:88318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.731505:0:88318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783074073.731511:0:88318:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783074073.731539:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074073.731543:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783074073.731548:0:88318:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783074073.731570:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524de7c7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783074073.731610:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074073.731617:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.731634:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074073.731638:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.731647:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074073.731651:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723510400:0@lo:39:umount.0 10000000:00010000:3.0:1783074073.731658:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074073.731665:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783074073.731668:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783074073.731671:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783074073.731696:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.731702:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783074073.731731:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074073.731742:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.731751:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24600/0x5fb609b3016dec57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec5e expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.731763:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.731766:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074073.731769:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723510528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074073.731770:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074073.731809:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074073.731819:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510400 00000100:00100000:2.0:1783074073.731827:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510400 00000100:00100000:2.0:1783074073.731880:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1783074073.731894:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723510400:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783074073.731917:0:66202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016ded53 00000100:00080000:2.0:1783074073.731930:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524c2b7b000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1783074073.731960:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b5c00 x1869685723510400/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1783074084 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074073.732017:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869685723510400:12345-0@lo:39:umount.0 Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074073.732025:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000020:00000080:2.0:1783074073.732037:0:66202:0:(genops.c:906:class_export_put()) final put ffff9524c2b78800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1783074073.732051:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524de7c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783074073.732065:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723510400:0@lo:39:umount.0 00010000:00010000:1.0:1783074073.732073:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783074073.732087:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c2b78800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1783074073.732119:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074073.732123:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074073.732127:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074073.732142:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c2b7b000 for lustre-MDT0000 00000100:00100000:3.0:1783074073.732210:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510528 00000100:00100000:3.0:1783074073.732214:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510528 00000100:00100000:3.0:1783074073.732283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1783074073.732290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723510528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074073.732305:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074073.732345:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145400/0x5fb609b3016dec5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dec57 expref: 24 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.732361:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074073.732407:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723510528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074073.732420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3661:x1869685723510528:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074073.732428:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00010000:00010000:1.0:1783074073.733198:0:88318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733210:0:88318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733218:0:88318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733225:0:88318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733242:0:88318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074073.733248:0:88318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733255:0:88318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.733265:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074073.733273:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733276:0:88318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.733290:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:1.0:1783074073.733293:0:88318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074073.733296:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.733357:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074073.733363:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.733370:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074073.733374:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.733382:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074073.733388:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074073.733404:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783074073.733407:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1783074073.733434:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.733441:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074073.733465:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.733476:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074073.733479:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074073.733482:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074073.733487:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723510656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074073.733490:0:88318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783074073.733496:0:88318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25a00/0x5fb609b3016dec7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec81 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074073.733506:0:88318:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783074073.733513:0:88318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074073.733522:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074073.733527:0:88318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733534:0:88318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733540:0:88318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733555:0:88318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074073.733561:0:88318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733567:0:88318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733579:0:88318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733585:0:88318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074073.733599:0:88318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783074073.733602:0:88318:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1783074073.733621:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074073.733627:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783074073.733629:0:88318:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783074073.733635:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1783074073.733640:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1783074073.733647:0:88318:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1783074073.733650:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25200 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:3.0:1783074073.733655:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074073.733656:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733678:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074073.733679:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074073.733696:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1783074073.733696:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074073.733700:0:6517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1783074073.733704:0:6517:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783074073.733709:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783074073.733713:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783074073.733715:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783074073.733744:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733751:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074073.733762:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733769:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25200/0x5fb609b3016dec49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dec50 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733778:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074073.733781:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733787:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bda00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074073.733790:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733802:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074073.733808:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074073.733812:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783074073.733814:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783074073.733815:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783074073.733827:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733833:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074073.733846:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733852:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c69bda00/0x5fb609b3016deb70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016deb77 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074073.733860:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074073.733862:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074073.733864:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074073.733883:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723510912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074073.733917:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074073.733982:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.733989:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074073.733997:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.734010:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016deb7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016deb85 expref: -99 pid: 87003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.734019:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.734021:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.734023:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.734030:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074073.734043:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074073.734051:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723511040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074073.734073:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074073.734091:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510656 00000100:00100000:2.0:1783074073.734095:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510656 00000100:00100000:2.0:1783074073.734124:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510912 00000100:00100000:2.0:1783074073.734127:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510912 00000100:00100000:2.0:1783074073.734143:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1783074073.734150:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723510656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074073.734164:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074073.734173:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145c00/0x5fb609b3016dec81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dec7a expref: 24 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.734183:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074073.734206:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723510656:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074073.734212:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1783074073.734228:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1783074073.734234:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c40a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3660:x1869685723510912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074073.734242:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074073.734250:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0868e00/0x5fb609b3016deb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016deb70 expref: 22 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.734258:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074073.734276:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c40a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3660:x1869685723510912:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074073.734282:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1783074073.734591:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723510912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074073.734604:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511040 00000100:00100000:3.0:1783074073.734609:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511040 00000100:00100000:0.0:1783074073.734622:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723510784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074073.734642:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074073.734655:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723510784 00000100:00100000:3.0:1783074073.734660:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723510784 00000100:00100000:3.0:1783074073.734683:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1783074073.734692:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3660:x1869685723511040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074073.734700:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074073.734708:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016deb85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016deb7e expref: 22 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074073.734727:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00010000:00010000:3.0:1783074073.734731:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074073.734738:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3659:x1869685723510784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074073.734747:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074073.734762:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dec50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dec49 expref: 21 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.734771:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074073.734786:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723510656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074073.734805:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723511040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074073.735044:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3660:x1869685723511040:12345-0@lo:103:ldlm_bl.0 Request processed in 353us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074073.735052:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1783074073.735070:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3659:x1869685723510784:12345-0@lo:103:ldlm_bl.0 Request processed in 333us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074073.735085:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1783074073.735145:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723510784:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1783074073.736545:0:88318:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1783074073.736946:0:87004:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:3.0:1783074073.736990:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737000:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737007:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737020:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074073.737024:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737032:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737045:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ff500) 00010000:00010000:3.0:1783074073.737048:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074073.737052:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737059:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016df055 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737076:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737083:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737089:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737095:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074073.737098:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737105:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783074073.737107:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1783074073.737116:0:88318:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9523c6947000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074073.737129:0:88318:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524d2ead800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074073.737135:0:88318:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c2b7c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1783074073.737136:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ff500) 00010000:00010000:3.0:1783074073.737143:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1783074073.737144:0:88318:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9523c2c2f000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1783074073.737149:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074073.737154:0:88318:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524f0889800 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 192.168.204.26@tcp 10 (0 0 3) 0 0 0 1: ffff9523c718a000 107374182412 stale:0 00010000:00010000:3.0:1783074073.737163:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d800/0x5fb609b3016df08d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074073.737165:0:88318:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9524f3da3380) has exports, disconnecting them 00000020:00080000:1.0:1783074073.737174:0:88318:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9523c6947000), last request at 1783074070 00000020:00000080:1.0:1783074073.737181:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016ded5a 00000100:00080000:1.0:1783074073.737188:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9523c6942000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074073.737215:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c6947000): rc 0 00000020:00000080:1.0:1783074073.737217:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c6947000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783074073.737238:0:88318:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524d2ead800), last request at 1783074060 00010000:00010000:3.0:1783074073.737250:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783074073.737250:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016ded4c 00000100:00080000:1.0:1783074073.737256:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524d2ead000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783074073.737260:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.737268:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074073.737269:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524d2ead800): rc 0 00010000:00010000:2.0:1783074073.737274:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074073.737276:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524d2ead800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1783074073.737280:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074073.737286:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074073.737286:0:88318:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c2b7c000), last request at 1783074070 00000020:00000080:1.0:1783074073.737291:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016ded45 00010000:00010000:3.0:1783074073.737298:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074073.737299:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524c2b7a000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783074073.737335:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524d0ae5e00) 00010000:00010000:3.0:1783074073.737338:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074073.737342:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074073.737346:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c2b7c000): rc 0 00000020:00000080:1.0:1783074073.737351:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524c2b7c000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1783074073.737354:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016df0e1 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783074073.737358:0:88318:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9523c2c2f000), last request at 1783074055 00000020:00000080:1.0:1783074073.737368:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debcb 00000100:00080000:1.0:1783074073.737379:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524de7c5800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783074073.737448:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.737451:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783074073.738072:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c2c2f000): rc 0 00000020:00000080:1.0:1783074073.738075:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c2c2f000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1783074073.738080:0:88318:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.26@tcp (ffff9524f0889800), last request at 1783074072 00000020:00000080:1.0:1783074073.738084:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debc4 00000020:00010000:1.0:1783074073.738090:0:88318:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524f0889800: total 4 00000100:00080000:1.0:1783074073.738094:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524de7c3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074073.738112:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524f0889800): rc 0 00000004:00000080:1.0:1783074073.738118:0:88318:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd3bc21cfae0 00000020:00010000:2.0:1783074073.738129:0:8460:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524f0889800: total 4 00000100:00080000:1.0:1783074073.738134:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783074073.738139:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783074073.738174:0:8460:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524f0889800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1783074073.738205:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016df0da lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b019 expref: 4 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.738224:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016defb4 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afcc expref: 3 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.738249:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c000/0x5fb609b3016df0c5 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 2 pid: 66202 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074073.738267:0:8460:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524f0889800, canceled 3 locks, left on hash table 0. 00000020:00000080:0.0:1783074073.738685:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6947000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074073.738793:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ead800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074073.738830:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c2b7c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074073.738860:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c2f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074073.738945:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6942000 for lustre-MDT0000 00000020:00000080:0.0:1783074073.738951:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d2ead000 for lustre-MDT0000 00000020:00000080:0.0:1783074073.738955:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c2b7a000 for lustre-MDT0000 00000020:00000080:0.0:1783074073.738959:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524de7c5800 for lustre-MDT0000 00010000:00010000:0.0:1783074073.738969:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783074073.739745:0:88318:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783074073.739767:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9523c4b63800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783074073.739873:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723511168:0@lo:39:umount.0 00000100:00100000:0.0:1783074073.739948:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074073.740075:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783074073.740080:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968713 gen 3 00000004:00080000:1.0:1783074073.740099:0:88318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783074073.740359:0:88318:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783074073.740371:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524c783d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783074073.740405:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783074073.740407:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968708 gen 3 00000100:00100000:0.0:1783074073.740498:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723511296:0@lo:9:umount.0 00000100:00100000:3.0:1783074073.740510:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511168 00000100:00100000:3.0:1783074073.740517:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511168 00000100:00100000:0.0:1783074073.740528:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074073.740565:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619 00000100:00100000:0.0:1783074073.740573:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511296 00000100:00100000:3.0:1783074073.740577:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723511168:12345-0@lo:39:umount.0 00000100:00100000:0.0:1783074073.740578:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511296 00000020:00000080:3.0:1783074073.740605:0:8453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debfc 00000100:00080000:3.0:1783074073.740611:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9523c2c2b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783074073.740618:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4891 00000100:00100000:0.0:1783074073.740631:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723511296:12345-0@lo:9:umount.0 00000001:00000004:3.0:1783074073.740632:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411439 00000020:00000080:0.0:1783074073.740651:0:8443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec18 00000100:00080000:0.0:1783074073.740664:0:8443:0:(import.c:65:import_set_state_nolock()) ffff9524d2eac800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783074073.740816:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3657:x1869685723511168:12345-0@lo:39:umount.0 Request processed in 242us (867us total) trans 77309411440 rc 0/0 00000100:00100000:3.0:1783074073.740823:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619 00010000:00010000:3.0:1783074073.740848:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074073.740871:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4b63800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783074073.740877:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723511168:0@lo:39:umount.0 00010000:00010000:3.0:1783074073.740888:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783074073.740926:0:88318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783074073.741385:0:88318:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783074073.741397:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9524f0831000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783074073.741486:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723511424:0@lo:9:umount.0 00000100:00100000:3.0:1783074073.741519:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1783074073.741536:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968713 00000020:00080000:1.0:1783074073.741539:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f3da3380) has no exports 00000100:00100000:3.0:1783074073.741554:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511424 00000100:00100000:3.0:1783074073.741558:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511424 00000100:00080000:1.0:1783074073.741569:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074073.741573:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074073.741587:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:3.0:1783074073.741595:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723511424:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783074073.741608:0:26168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec34 00000100:00080000:3.0:1783074073.741615:0:26168:0:(import.c:65:import_set_state_nolock()) ffff9523c6943800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783074073.741676:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723511296:12345-0@lo:9:umount.0 Request processed in 1046us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074073.741683:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4891 00010000:00010000:0.0:1783074073.741930:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783074073.741948:0:26168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968708 00000100:00100000:3.0:1783074073.742033:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723511424:12345-0@lo:9:umount.0 Request processed in 440us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074073.742052:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00000100:00080000:3.0:1783074073.742149:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0831000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783074073.742163:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783074073.742165:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074073.742168:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723511424:0@lo:9:umount.0 00000100:00080000:3.0:1783074073.742180:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c783d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783074073.742190:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783074073.742192:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074073.742196:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723511296:0@lo:9:umount.0 00000020:00080000:1.0:1783074073.742574:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f3da3380) has no exports 00000020:00000080:2.0:1783074073.786943:0:8460:0:(genops.c:906:class_export_put()) final put ffff9524f0889800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:0.0:1783074073.787082:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f0889800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-MDT0000 00010000:00010000:3.0:1783074073.787151:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.787156:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.787159:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783074073.787219:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524de7c3800 for lustre-MDT0000 00000020:00000080:1.0:1783074073.807224:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debe0 00000020:00000080:1.0:1783074073.807238:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524c4405000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783074073.807262:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783074073.807272:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074073.807283:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783074073.807287:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9524f3da4d40) has no exports 00000020:00000080:0.0:1783074073.807374:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4405000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783074073.807916:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debd9 00000020:00000080:1.0:1783074073.807922:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524f7804800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074073.807974:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074073.807982:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783074073.808041:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c4e7b800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783074073.808044:0:88318:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783074073.808051:0:88318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783074073.808355:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7804800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783074073.808514:0:88318:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524c4c3da80 - data ffff9524df958ca8/ffff9523c38ab400 00000020:01000000:1.0:1783074073.808656:0:88318:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524c4c3dd80 - data ffff9524dfa30000/ffff9523c38aa400 00000100:00080000:0.0:1783074073.846003:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074073.846012:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074073.846025:0:88318:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9523c47b6680 x1869685723511168/t77309411440(77309411440) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074083 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074073.846047:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783074073.847223:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783074073.847227:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968713 gen 4 00000004:00080000:0.0:1783074073.847247:0:88318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074073.847248:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783074073.847852:0:87020:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783074073.847857:0:87020:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:2.0:1783074073.847865:0:87020:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:0.0:1783074073.848589:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783074073.848592:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968708 gen 4 00000004:00080000:0.0:1783074073.848754:0:88318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074073.848757:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783074073.848957:0:87022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783074073.848961:0:87022:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:2.0:1783074073.848967:0:87022:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:0.0:1783074073.849796:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016deb9a 00000020:00000080:0.0:1783074073.849805:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c2c2b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074073.850332:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debaf 00000020:00000080:0.0:1783074073.850337:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524fc253800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.850432:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c2b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783074073.850497:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783074073.850503:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074073.850513:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783074073.850517:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9524fab719c0) has no exports 00000004:01000000:0.0:1783074073.850662:0:88318:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783074073.850669:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec2d 00000020:00000080:0.0:1783074073.850673:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524c783c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.850702:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc253800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783074073.850769:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783074073.850773:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074073.850779:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783074073.850782:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9523c2c319c0) has no exports 00000020:00000080:0.0:1783074073.850787:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec26 00000020:00000080:0.0:1783074073.850790:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524f0834800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074073.850807:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c783c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1783074073.851152:0:88318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783074073.851156:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783074073.851159:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968708 gen 5 00000004:00080000:0.0:1783074073.851163:0:88318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074073.851164:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074073.851203:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f0834800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074073.851280:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074073.851288:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074073.851293:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec11 00000020:00000080:0.0:1783074073.851296:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c6a5b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.851329:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f0831000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783074073.851335:0:85943:0:(genops.c:906:class_export_put()) final put ffff9523c6a59000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.851343:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6a59000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783074073.851348:0:85943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783074073.851567:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783074073.851571:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074073.851577:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783074073.851579:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9523c2c33380) has no exports 00000020:00000080:0.0:1783074073.851584:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec0a 00000020:00000080:0.0:1783074073.851587:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524c783b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074073.851602:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6a5b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1783074073.851945:0:88318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783074073.851948:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783074073.851950:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968713 gen 5 00000004:00080000:0.0:1783074073.851953:0:88318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074073.851955:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074073.852205:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c783b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074073.852279:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074073.852286:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783074073.852297:0:88318:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783074073.852301:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debf5 00000020:00000080:0.0:1783074073.852306:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524c4403800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.852338:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c783d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783074073.852343:0:85943:0:(genops.c:906:class_export_put()) final put ffff9524c4404800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.852345:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4404800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783074073.852360:0:85943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783074073.852518:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783074073.852528:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074073.852534:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783074073.852537:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9524fb4db380) has no exports 00000020:00000080:0.0:1783074073.852541:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debee 00000020:00000080:0.0:1783074073.852545:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c4b62800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074073.852566:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4403800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783074073.853450:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4b62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783074073.854362:0:88318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783074073.854375:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783074073.854378:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783074073.854384:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074073.854424:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074073.854433:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074073.854459:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074073.854462:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074073.854466:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524fc3c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074073.854468:0:88318:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783074073.854473:0:88318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074073.854567:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debb6 00000020:00000080:2.0:1783074073.854575:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524c6211000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783074073.854581:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783074073.854585:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c4b63800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783074073.854585:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074073.854593:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1783074073.854597:0:85943:0:(genops.c:906:class_export_put()) final put ffff9523c2c29800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1783074073.854597:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9524f3da0000) has no exports 00000020:00000080:3.0:1783074073.854603:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c29800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783074073.854613:0:85943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074073.854622:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074073.854626:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783074073.854637:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016debbd 00000020:00000080:2.0:1783074073.854641:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524f088e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783074073.854665:0:88318:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524e6a75000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783074073.854669:0:88318:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524e6a75000 3 00000020:01000004:2.0:1783074073.854672:0:88318:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524e6a75000 from lustre-MDT0000 00000020:00000080:3.0:1783074073.854676:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6211000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783074073.854682:0:85943:0:(genops.c:906:class_export_put()) final put ffff9523c2c28000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783074073.854684:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c28000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783074073.854691:0:85943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783074073.854693:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074073.854699:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783074073.854702:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c2c28800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783074073.854704:0:88318:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c28800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783074073.854714:0:88318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1783074073.854736:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f088e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1783074073.854763:0:88318:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783074073.854767:0:88318:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783074073.854770:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783074073.854773:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074073.854775:0:88318:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783074073.854783:0:88318:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9523c6940800 da924155-7591-4a6a-a2d2-c0d2908d0bfb 192.168.204.26@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074073.854790:0:88318:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9523c316f000 522b6a34-04f4-4017-ab45-61a21d19bfef 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074073.854794:0:88318:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9523c2284d40) has exports, disconnecting them 00000020:00080000:2.0:1783074073.854798:0:88318:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.26@tcp (ffff9523c6940800), last request at 1783074059 00000020:00000080:2.0:1783074073.854815:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016ded3e 00000020:00010000:2.0:1783074073.854820:0:88318:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523c6940800: total 0 00000100:00080000:2.0:1783074073.854823:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9523c6945000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074073.854838:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9523c6940800): rc 0 00000020:00080000:2.0:1783074073.854841:0:88318:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9523c316f000), last request at 1783074055 00000020:00000080:2.0:1783074073.854887:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016deb5b 00000020:00010000:2.0:1783074073.854890:0:88318:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523c316f000: total 0 00000100:00080000:2.0:1783074073.854893:0:88318:0:(import.c:65:import_set_state_nolock()) ffff9523c316c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074073.854900:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c316f000): rc 0 00000020:00080000:2.0:1783074073.854904:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9523c2284d40) has no exports 00000020:00010000:3.0:1783074073.854912:0:46245:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523c6940800: total 0 00010000:00010000:3.0:1783074073.854941:0:46245:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523c6940800, canceled 0 locks, left on hash table 4. 00000100:00100000:2.0:1783074073.854958:0:87008:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9523c55a2800:87008] 0 exiting: rc = 1 00010000:00010000:3.0:1783074073.854973:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc000/0x5fb609b3016def75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afa9 expref: 5 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.854993:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd400/0x5fb609b3016def83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afb7 expref: 4 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855021:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc400/0x5fb609b3016def7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afb0 expref: 3 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855035:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086cc00/0x5fb609b3016def8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263afbe expref: 2 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855047:0:46245:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523c6940800, canceled 4 locks, left on hash table 0. 00000100:00100000:2.0:1783074073.855059:0:87010:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9523c55a3800:87010] 1 exiting: rc = 0 00000020:00000080:3.0:1783074073.855076:0:46245:0:(genops.c:906:class_export_put()) final put ffff9523c6940800/da924155-7591-4a6a-a2d2-c0d2908d0bfb 00000020:00010000:3.0:1783074073.855088:0:46245:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523c316f000: total 1 00010000:00010000:3.0:1783074073.855107:0:46245:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523c316f000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783074073.855123:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bce00/0x5fb609b3016ded1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016ded14 expref: 14 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855136:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145600/0x5fb609b3016decab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016deca4 expref: 13 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855146:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd800/0x5fb609b3016ded0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016ded06 expref: 12 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855156:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145000/0x5fb609b3016dec9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dec96 expref: 11 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855167:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0869200/0x5fb609b3016decc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016decc0 expref: 10 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855178:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bde00/0x5fb609b3016ded29 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016ded22 expref: 9 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855190:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c4b25600/0x5fb609b3016decb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016decb2 expref: 8 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855210:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bcc00/0x5fb609b3016ded37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016ded30 expref: 7 pid: 87008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855222:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0869a00/0x5fb609b3016decd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016decce expref: 6 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855232:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144600/0x5fb609b3016dece3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016decdc expref: 5 pid: 87010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855258:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145a00/0x5fb609b3016decf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016decea expref: 4 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855274:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc200/0x5fb609b3016decff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016decf8 expref: 3 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855286:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc600/0x5fb609b3016dec8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dec88 expref: 2 pid: 87011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074073.855308:0:46245:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523c316f000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1783074073.855350:0:87011:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9524c6ce7200:87011] 2 exiting: rc = 0 00000020:00000080:3.0:1783074073.855354:0:46245:0:(genops.c:906:class_export_put()) final put ffff9523c316f000/522b6a34-04f4-4017-ab45-61a21d19bfef 00010000:00010000:3.0:1783074073.855362:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.855365:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.855368:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074073.855376:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783074073.855384:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6940800/da924155-7591-4a6a-a2d2-c0d2908d0bfb for MGS 00000100:00100000:2.0:1783074073.855450:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855457:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855462:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855468:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855474:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855480:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855485:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855489:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855494:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855498:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855503:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855507:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855512:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855517:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855522:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855526:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855537:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855542:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855547:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855553:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855558:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855563:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855568:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855577:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855584:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855590:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855596:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855601:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855606:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855611:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855616:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855622:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855627:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855634:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855647:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855653:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855658:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855663:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855668:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855674:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855679:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855685:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855691:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855696:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855702:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855708:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.855713:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783074073.855755:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316f000/522b6a34-04f4-4017-ab45-61a21d19bfef for MGS 00000020:00000080:3.0:1783074073.855774:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6945000 for MGS 00000020:00000080:3.0:1783074073.855778:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c316c800 for MGS 00000100:00100000:2.0:1783074073.856492:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856501:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856506:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856515:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856521:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856527:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856533:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856538:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856543:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856548:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856554:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856560:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856565:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856571:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856577:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856583:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074073.856587:0:88318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783074073.857252:0:88318:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c680f420 - data ffff9523c1a60510/ffff9523c536dc00 00000020:01000000:2.0:1783074073.857455:0:88318:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c33ef420 - data ffff9524df924948/ffff9523c3185400 00000020:00000080:2.0:1783074073.857847:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016deb54 00000020:00000080:2.0:1783074073.857854:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524fc3c7000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783074073.857902:0:88318:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524e6a75000 from MGS, refs=2 00000020:01000004:2.0:1783074073.857906:0:88318:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524e6a75000 2 00000020:01000004:2.0:1783074073.857908:0:88318:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524e6a75000 from MGS 00000020:00000080:2.0:1783074073.858001:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074073.858009:0:88318:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783074073.858012:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524fc3c4000/MGS 00000020:00000080:2.0:1783074073.858015:0:88318:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c4000/MGS for MGS 00000020:01000000:2.0:1783074073.858021:0:88318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783074073.858084:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783074073.858087:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074073.858095:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783074073.858100:0:88318:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9524de7c4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074073.858105:0:88318:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9524fa8619c0) has exports, disconnecting them 00000020:00080000:2.0:1783074073.858109:0:88318:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9524de7c4000), last request at 1783074055 00000020:00000080:2.0:1783074073.858112:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dec6c 00000020:00080000:2.0:1783074073.858119:0:88318:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524de7c4000): rc 0 00000020:00000080:2.0:1783074073.858124:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524de7c4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783074073.858145:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074073.858437:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524de7c4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783074073.859345:0:88318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783074073.859349:0:88318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783074073.859353:0:88318:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783074073.859358:0:88318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783074073.859386:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524de7c7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783074073.859469:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074073.859477:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783074073.859481:0:88318:0:(genops.c:906:class_export_put()) final put ffff9523c6a5e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783074073.859483:0:88318:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6a5e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783074073.859486:0:88318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783074073.859538:0:88318:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524e6a75000 1 00000020:00000080:3.0:1783074073.859541:0:88318:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016deb46 00000020:00000080:3.0:1783074073.859545:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524fc3c1800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783074073.859551:0:88318:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783074073.859557:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074073.859563:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074073.859565:0:88318:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783074073.859568:0:88318:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9524fa864d40) has no exports 00000020:00000080:3.0:1783074073.898017:0:88318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074073.898031:0:88318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783074073.898037:0:88318:0:(genops.c:906:class_export_put()) final put ffff9524f462d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783074073.898042:0:88318:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f462d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783074073.898054:0:88318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783074073.898159:0:88318:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524e6a70000 00000020:02000400:3.0:1783074073.898219:0:88318:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783074074.226655:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783074075.120129:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708040192 offset 0 length 224: 4 00000100:00100000:0.0:1783074075.120170:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074075.120444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074075.120477:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074075.120535:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040704 00000100:00100000:2.0:1783074075.120545:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040704 00000100:00100000:2.0:1783074075.120618:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2093 00000100:00080000:1.0:1783074075.120800:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074075.120888:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708040704:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074075.120969:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708040704:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 87us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074075.120977:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2093 00000100:00100000:0.0:1783074075.121295:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074075.121453:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040448 00000100:00100000:3.0:1783074075.121460:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040448 00000100:00100000:2.0:1783074075.121716:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040320 00000100:00100000:2.0:1783074075.121721:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040320 00000100:00100000:2.0:1783074075.121750:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 772 00000100:00100000:2.0:1783074075.121758:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708040448:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074075.121794:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708040448:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074075.121809:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 772 00000100:00100000:2.0:1783074075.121822:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1119 00000100:00100000:2.0:1783074075.121825:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2405:x1869685708040320:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:2.0:1783074075.121830:0:68632:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:2.0:1783074075.121846:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2405:x1869685708040320:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 20us (1370us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074075.121850:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1119 00000100:00100000:1.0:1783074075.122065:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040576 00000100:00080000:0.0:1783074075.122071:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074075.122075:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040576 00000100:00080000:0.0:1783074075.122099:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074075.122125:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2094 00000100:00100000:1.0:1783074075.122134:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708040576:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074075.122172:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708040576:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074075.122179:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2094 00000100:00100000:0.0:1783074075.125438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074075.125726:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040832 00000100:00100000:2.0:1783074075.125735:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040832 00000100:00100000:2.0:1783074075.125791:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1120 00000100:00100000:2.0:1783074075.125799:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708040832:12345-192.168.204.26@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1783074075.125823:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074075.125889:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708040832:12345-192.168.204.26@tcp:38:ptlrpcd_01_01.0 Request processed in 88us (459us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074075.125897:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1120 00010000:00010000:3.0:1783074075.247700:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074076.079130:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c3bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723511552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074076.079199:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074076.079244:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723512064:0@lo:400:kworker.0 00000100:00100000:0.0:1783074076.079272:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.079282:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723511936:0@lo:400:kworker.0 00000100:00100000:0.0:1783074076.079292:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074076.079299:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723511808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074076.079343:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1783074076.079375:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723511936 offset 0 length 224: 4 00000100:00100000:0.0:1783074076.079379:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511552 00000100:00100000:0.0:1783074076.079386:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511552 00000100:00100000:0.0:1783074076.079443:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:0.0:1783074076.079451:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1869685723511552:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1783074076.079458:0:26189:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074076.079496:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1869685723511552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (297us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074076.079513:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:0.0:1783074076.079535:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512064 00000100:00100000:0.0:1783074076.079538:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512064 00000100:00100000:0.0:1783074076.079560:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1783074076.079565:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1869685723512064:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783074076.079569:0:66200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074076.079594:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1869685723512064:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074076.079599:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1783074076.079614:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074076.079643:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c52c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723511680:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783074076.079644:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074076.079651:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783074076.079655:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074076.079661:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074076.079664:0:3658:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2899 00000100:00080000:0.0:1783074076.079670:0:3658:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074076.079707:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.079793:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511808 00000100:00100000:3.0:1783074076.079798:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511808 00000100:00100000:3.0:1783074076.079886:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511680 00000100:00100000:3.0:1783074076.079902:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511680 00000100:00100000:3.0:1783074076.079953:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1783074076.079962:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723511808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783074076.080301:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074076.080426:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723511808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 452us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074076.080434:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1783074076.080463:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1783074076.080485:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723511680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074076.080501:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074076.080538:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723511680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074076.080545:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1783074076.080585:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c52c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723511680:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783074076.080656:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074076.080698:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074076.081217:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4b07100 x1869685723512192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074076.081280:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723512064:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.081323:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723512192:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783074076.081355:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:0.0:1783074076.081368:0:3658:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1783074076.081407:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512192 00000100:00100000:3.0:1783074076.081432:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512192 00000100:00100000:3.0:1783074076.081457:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1783074076.081462:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723512192:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783074076.081494:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074076.081533:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723512192:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (177us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074076.081540:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00080000:3.0:1783074076.081563:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074076.081584:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074076.081587:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723512192:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783074076.084305:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723512320:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.084381:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.084424:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074076.084430:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723512704:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.084449:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.084477:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723512448:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.084496:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.084515:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074076.084519:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723512576:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.084536:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.084559:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512320 00000100:00100000:3.0:1783074076.084565:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512320 00000100:00100000:3.0:1783074076.084600:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512704 00000100:00100000:3.0:1783074076.084602:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512704 00000100:00100000:3.0:1783074076.084610:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512448 00000100:00100000:3.0:1783074076.084613:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512448 00000100:00100000:3.0:1783074076.084619:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512576 00000100:00100000:3.0:1783074076.084630:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512576 00000100:00100000:3.0:1783074076.084647:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1783074076.084654:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723512320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.084715:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723512320:12345-0@lo:400:kworker.0 Request processed in 61us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074076.084721:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1783074076.084734:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1783074076.084740:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.084771:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723512576:12345-0@lo:400:kworker.0 Request processed in 31us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074076.084776:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1783074076.084787:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1783074076.084791:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c640a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1869685723512704:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783074076.084797:0:67186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074076.084822:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c640a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1869685723512704:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074076.084828:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1783074076.084838:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1783074076.084841:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1869685723512448:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783074076.084845:0:67186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074076.084866:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1869685723512448:12345-0@lo:400:kworker.0 Request processed in 23us (368us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074076.084871:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1783074076.084898:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723512576:0@lo:400:kworker.0 00000100:00080000:3.0:1783074076.084907:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783074076.084911:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783074076.084920:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783074076.084925:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074076.084928:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2899 00000100:00080000:3.0:1783074076.084933:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074076.084950:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c640b480 x1869685723512832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074076.084966:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723512448:0@lo:400:kworker.0 00000100:00080000:3.0:1783074076.084984:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074076.084994:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c640b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723512832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783074076.085018:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074076.085051:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783074076.085054:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783074076.085057:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783074076.085060:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074076.085063:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2899 00000100:00080000:3.0:1783074076.085066:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074076.085078:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e410b100 x1869685723512960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074076.085090:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723512704:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.085101:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723512320:0@lo:400:kworker.0 00000100:00100000:3.0:1783074076.085117:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723512960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783074076.085137:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074076.085168:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512832 00000100:00100000:3.0:1783074076.085171:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512832 00000100:00100000:3.0:1783074076.085182:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723512960 00000100:00100000:3.0:1783074076.085184:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723512960 00000100:00100000:3.0:1783074076.085193:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1783074076.085197:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723512832:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1783074076.085213:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074076.085246:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723512832:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 47us (227us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074076.085252:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1783074076.085263:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1783074076.085267:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723512960:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783074076.085275:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074076.085299:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723512960:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (161us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074076.085305:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:3.0:1783074076.085340:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074076.085345:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074076.085348:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723512960:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1783074076.085356:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074076.085359:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074076.085362:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c640b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723512832:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1783074076.093095:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074076.093103:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783074076.093108:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074076.093114:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074076.093117:0:3658:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2899 00000100:00080000:0.0:1783074076.093142:0:3658:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074076.093178:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4b07100 x1869685723513088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074076.093307:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723513088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783074076.093432:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074076.093601:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723511808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074076.093764:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513088 00000100:00100000:1.0:1783074076.093771:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513088 00000100:00100000:1.0:1783074076.093847:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621 00000100:00100000:1.0:1783074076.093854:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c640b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723513088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783074076.093875:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074076.093983:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c640b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723513088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 128us (550us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074076.093991:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621 00000100:00080000:3.0:1783074076.094040:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074076.094051:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074076.094054:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723513088:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1783074076.270454:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074077.294430:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074078.318627:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074079.342443:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783074079.666837:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074079.666846:0:9524:0:(genops.c:906:class_export_put()) final put ffff9523c6940000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074079.666923:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6940000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783074079.666973:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6943800 for lustre-OST0001 00000001:00100000:3.0:1783074079.667666:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074079.667671:0:8438:0:(genops.c:906:class_export_put()) final put ffff9523c2e03800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074079.667734:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2e03800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783074079.667768:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d2eac800 for lustre-OST0000 00000001:00100000:2.0:1783074079.667980:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783074079.667990:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411440 is committed 00000020:00000080:2.0:1783074079.667994:0:75594:0:(genops.c:906:class_export_put()) final put ffff9523c2c2a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074079.668110:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c2a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783074079.668248:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c2c2b800 for lustre-MDT0001 00000400:00000100:0.0:1783074080.243791:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708041216 offset 0 length 224: 4 00000100:00100000:0.0:1783074080.243849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074080.243921:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074080.243963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074080.244011:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708041600 00000100:00100000:1.0:1783074080.244021:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708041600 00000100:00100000:1.0:1783074080.244108:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2095 00000100:00100000:1.0:1783074080.244118:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708041600:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074080.244209:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2403:x1869685708041600:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074080.244217:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2095 00000100:00080000:2.0:1783074080.244748:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074080.245578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074080.245686:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708041728 00000100:00100000:1.0:1783074080.245704:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708041728 00000100:00100000:1.0:1783074080.245754:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2096 00000100:00100000:1.0:1783074080.245762:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708041728:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074080.245809:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2402:x1869685708041728:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074080.245816:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2096 00000100:00080000:0.0:1783074080.245948:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074080.246260:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708041344 00000100:00100000:3.0:1783074080.246265:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708041344 00000100:00100000:3.0:1783074080.246296:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708041472 00000100:00100000:3.0:1783074080.246300:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708041472 00000100:00100000:3.0:1783074080.246355:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 775 00000100:00100000:3.0:1783074080.246363:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708041472:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074080.246401:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708041472:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074080.246409:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 775 00000100:00100000:3.0:1783074080.246422:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1127 00000100:00100000:3.0:1783074080.246427:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708041344:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:3.0:1783074080.246447:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783074080.248279:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074080.267794:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708041344:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 21357us (23950us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074080.267807:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1127 00010000:00010000:3.0:1783074080.366551:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074081.198602:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074081.198619:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723513216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074081.198713:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074081.198757:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513216 00000100:00100000:0.0:1783074081.198766:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513216 00000100:00100000:0.0:1783074081.198838:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1783074081.198849:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723513216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074081.198879:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074081.198923:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723513216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074081.198930:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1783074081.198969:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723513216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074081.199535:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723513344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074081.199565:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074081.199650:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074081.199678:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074081.199683:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074081.199686:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074081.199690:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2915 00000100:00080000:3.0:1783074081.199694:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783074081.199699:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074081.199717:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e406df80 x1869685723513600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074081.199748:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074081.199752:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074081.199753:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074081.199756:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2915 00000100:00080000:3.0:1783074081.199759:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783074081.199762:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074081.199772:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e406ca80 x1869685723513856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074081.199786:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074081.199788:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074081.199790:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074081.199793:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2915 00000100:00080000:3.0:1783074081.199795:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783074081.199806:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074081.199817:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c2140000 x1869685723514112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074081.199828:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783074081.199829:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723513600:0@lo:38:kworker.0 00000100:00080000:3.0:1783074081.199835:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074081.199838:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074081.199841:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2915 00000100:00080000:3.0:1783074081.199844:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783074081.199847:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074081.199858:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c2143800 x1869685723514240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074081.199871:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074081.199879:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074081.199890:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723513472:0@lo:400:kworker.0 00000100:00100000:1.0:1783074081.199896:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723513856:0@lo:38:kworker.0 00000400:00000100:3.0:1783074081.199918:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723513472 offset 0 length 224: 4 00000100:00100000:3.0:1783074081.199954:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723513728:0@lo:400:kworker.0 00000100:00100000:3.0:1783074081.199991:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513600 00000100:00100000:3.0:1783074081.199995:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513600 00000100:00100000:3.0:1783074081.200019:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1783074081.200024:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723513600:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074081.200041:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074081.200070:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723514112:0@lo:38:kworker.0 00000100:00100000:1.0:1783074081.200094:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074081.200108:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723514240:0@lo:38:kworker.0 00010000:00020000:3.0:1783074081.200112:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074081.200132:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074081.200191:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513344 00000100:00100000:2.0:1783074081.200196:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513344 00000100:00100000:2.0:1783074081.200231:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:2.0:1783074081.200239:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723513344:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783074081.200257:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00002000:00000024:2.0:1783074081.200258:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783074081.200266:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074081.200271:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723513600:0@lo:38:kworker.0 00000100:00100000:2.0:1783074081.200301:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723513344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074081.200330:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513856 00000100:00100000:1.0:1783074081.200335:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513856 00000100:00100000:2.0:1783074081.200336:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:1.0:1783074081.200359:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723514240 00000100:00100000:1.0:1783074081.200363:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723514240 00000100:00100000:1.0:1783074081.200377:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1783074081.200382:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723513856:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074081.200391:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723513344:0@lo:13:osp-pre-0-1.0 00010000:00020000:1.0:1783074081.200395:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074081.200423:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1783074081.200430:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723514240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074081.200438:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723513856:12345-0@lo:38:kworker.0 Request processed in 54us (511us total) trans 0 rc -19/-19 00010000:00020000:2.0:1783074081.200442:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074081.200449:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1783074081.200478:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723514240:12345-0@lo:38:kworker.0 Request processed in 47us (346us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783074081.200485:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074081.200486:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:1.0:1783074081.200505:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074081.200510:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074081.200515:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723514240:0@lo:38:kworker.0 00000100:00080000:1.0:1783074081.200523:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074081.200526:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074081.200528:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723513856:0@lo:38:kworker.0 00000100:00100000:1.0:1783074081.200547:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074081.200598:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074081.200606:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723513984:0@lo:400:kworker.0 00000100:00100000:0.0:1783074081.200611:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723514112 00000100:00100000:0.0:1783074081.200617:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723514112 00000100:00100000:1.0:1783074081.200634:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074081.200647:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513728 00000100:00100000:0.0:1783074081.200650:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622 00000100:00100000:2.0:1783074081.200654:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513728 00000100:00100000:0.0:1783074081.200659:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723514112:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074081.200662:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723513984 00000100:00100000:1.0:1783074081.200667:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723513984 00010000:00020000:0.0:1783074081.200681:0:26189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074081.200695:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1783074081.200707:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:2.0:1783074081.200708:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723513728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074081.200720:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723513984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074081.200725:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723514112:12345-0@lo:38:kworker.0 Request processed in 65us (628us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074081.200734:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622 00000100:00100000:2.0:1783074081.200751:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723513728:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074081.200759:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:0.0:1783074081.200777:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074081.200783:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074081.200787:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723514112:0@lo:38:kworker.0 00000100:00080000:0.0:1783074081.200813:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074081.200830:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723513728:0@lo:400:kworker.0 00000100:00100000:3.0:1783074081.201731:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723513600:12345-0@lo:38:kworker.0 Request processed in 1703us (1860us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074081.201738:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1783074081.201987:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723513984:12345-0@lo:400:kworker.0 Request processed in 1269us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074081.201995:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1783074081.202756:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723513984:0@lo:400:kworker.0 00010000:00010000:3.0:1783074081.390544:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074082.415878:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074083.438662:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074084.462584:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074085.359735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074085.359901:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708041984 00000100:00100000:2.0:1783074085.359912:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708041984 00000100:00100000:2.0:1783074085.359969:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1131 00000100:00100000:2.0:1783074085.359978:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708041984:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:2.0:1783074085.360013:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074085.360136:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708041984:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 157us (409us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074085.360144:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1131 00000400:00000100:0.0:1783074085.362255:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708041856 offset 0 length 224: 4 00000100:00100000:0.0:1783074085.362289:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074085.362380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074085.362418:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074085.362498:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042368 00000100:00100000:1.0:1783074085.362517:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042112 00000100:00100000:1.0:1783074085.362525:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042112 00000100:00100000:2.0:1783074085.362529:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042368 00000100:00100000:3.0:1783074085.362556:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042240 00000100:00100000:3.0:1783074085.362561:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042240 00000100:00100000:1.0:1783074085.362641:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 778 00000100:00100000:2.0:1783074085.362642:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2097 00000100:00100000:2.0:1783074085.362656:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708042368:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:0.0:1783074085.362662:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074085.362667:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074085.362671:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074085.362679:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2098 00000100:00100000:3.0:1783074085.362690:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708042240:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074085.362724:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708042112:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074085.362734:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2405:x1869685708042368:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074085.362747:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2097 00000100:00100000:1.0:1783074085.362773:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708042112:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 52us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074085.362805:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2404:x1869685708042240:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074085.362814:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2098 00000100:00100000:1.0:1783074085.363746:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 778 00010000:00010000:2.0:1783074085.486425:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074086.319644:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074086.319651:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074086.319654:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074086.319662:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2920 00000100:00080000:2.0:1783074086.319666:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074086.319672:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074086.319693:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc496a00 x1869685723514496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074086.319697:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723514368:0@lo:400:kworker.0 00000100:00080000:2.0:1783074086.319715:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074086.319718:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074086.319720:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074086.319723:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2920 00000100:00080000:2.0:1783074086.319725:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074086.319728:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074086.319736:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc497800 x1869685723514752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1783074086.319742:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723514368 offset 0 length 224: 4 00000100:00080000:2.0:1783074086.319757:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074086.319761:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074086.319767:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074086.319770:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2920 00000100:00080000:2.0:1783074086.319772:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074086.319775:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074086.319780:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074086.319785:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723514624:0@lo:400:kworker.0 00000100:00100000:2.0:1783074086.319786:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c4b15f80 x1869685723515008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074086.319805:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074086.319808:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074086.319809:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074086.319812:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2920 00000100:00100000:0.0:1783074086.319813:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074086.319815:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074086.319817:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074086.319827:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efe300 x1869685723515392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074086.319834:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723515264:0@lo:400:kworker.0 00000100:00100000:2.0:1783074086.319849:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e41c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723514880:0@lo:400:kworker.0 00000100:00100000:0.0:1783074086.319866:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074086.319871:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074086.319886:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783074086.319891:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723515136:0@lo:400:kworker.0 00000100:00100000:0.0:1783074086.319892:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723514496:0@lo:38:kworker.0 00000100:00100000:2.0:1783074086.319910:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074086.319923:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074086.319938:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515264 00000100:00100000:0.0:1783074086.319938:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723514752:0@lo:38:kworker.0 00000100:00100000:2.0:1783074086.319944:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515264 00000100:00100000:0.0:1783074086.319957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074086.319976:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723515008:0@lo:38:kworker.0 00000100:00100000:2.0:1783074086.319991:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515136 00000100:00100000:2.0:1783074086.319994:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515136 00000100:00100000:0.0:1783074086.319995:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074086.320010:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723515392:0@lo:38:kworker.0 00000100:00100000:2.0:1783074086.320016:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1783074086.320023:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723515264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074086.320030:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074086.320056:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723514624 00000100:00100000:0.0:1783074086.320060:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723514624 00000100:00100000:2.0:1783074086.320067:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723515264:12345-0@lo:400:kworker.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074086.320079:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1783074086.320080:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723514880 00000100:00100000:0.0:1783074086.320082:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723514880 00000100:00100000:0.0:1783074086.320092:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723514496 00000100:00100000:2.0:1783074086.320093:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:0.0:1783074086.320094:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723514496 00000100:00100000:2.0:1783074086.320098:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723515136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074086.320102:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723514752 00000100:00100000:0.0:1783074086.320103:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723514752 00000100:00100000:0.0:1783074086.320109:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515392 00000100:00100000:0.0:1783074086.320111:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515392 00000100:00100000:0.0:1783074086.320120:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1783074086.320125:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723514624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074086.320128:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723515136:12345-0@lo:400:kworker.0 Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074086.320133:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:0.0:1783074086.320151:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723514624:12345-0@lo:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074086.320157:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1783074086.320167:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1783074086.320168:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723515136:0@lo:400:kworker.0 00000100:00100000:0.0:1783074086.320172:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723514880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074086.320200:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723514880:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074086.320211:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1783074086.320223:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1783074086.320226:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723514496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074086.320241:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074086.320271:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723514496:12345-0@lo:38:kworker.0 Request processed in 43us (347us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074086.320277:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1783074086.320287:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1783074086.320290:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723514752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074086.320300:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074086.320338:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723514752:12345-0@lo:38:kworker.0 Request processed in 45us (378us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074086.320343:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1783074086.320353:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1783074086.320357:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723515392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074086.320365:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074086.320386:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723515392:12345-0@lo:38:kworker.0 Request processed in 28us (354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074086.320391:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:0.0:1783074086.320414:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074086.320418:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074086.320420:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074086.320433:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515008 00000100:00100000:0.0:1783074086.320436:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515008 00000100:00100000:0.0:1783074086.320453:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623 00000100:00100000:0.0:1783074086.320462:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723515008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074086.320472:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074086.320993:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723515648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074086.321241:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723515008:12345-0@lo:38:kworker.0 Request processed in 776us (1243us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074086.321248:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623 00000100:00080000:0.0:1783074086.321280:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074086.321285:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074086.321289:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723514496:0@lo:38:kworker.0 00000100:00080000:0.0:1783074086.321297:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074086.321301:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074086.321304:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723514752:0@lo:38:kworker.0 00000100:00080000:0.0:1783074086.321329:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074086.321332:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074086.321335:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723515008:0@lo:38:kworker.0 00000100:00080000:0.0:1783074086.321344:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074086.321347:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074086.321349:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723515392:0@lo:38:kworker.0 00000100:00100000:3.0:1783074086.321445:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074086.321516:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e41c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723514880:0@lo:400:kworker.0 00000100:00100000:3.0:1783074086.321545:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723515264:0@lo:400:kworker.0 00000100:00100000:3.0:1783074086.321555:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723514624:0@lo:400:kworker.0 00000100:00100000:3.0:1783074086.321563:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074086.321568:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723515520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074086.321590:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074086.321661:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515648 00000100:00100000:0.0:1783074086.321665:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515648 00000100:00100000:0.0:1783074086.321696:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515520 00000100:00100000:0.0:1783074086.321699:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515520 00000100:00100000:0.0:1783074086.321717:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1783074086.321724:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723515648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074086.321742:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074086.321776:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723515648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074086.321788:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1783074086.321800:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1783074086.321805:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723515520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074086.321818:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074086.321846:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e41c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723515520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074086.321852:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1783074086.321881:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723515648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074086.321905:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723515520:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783074086.511180:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074087.535477:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074088.559529:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074089.583398:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783074090.171303:0:88937:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783074090.171337:0:88937:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783074090.171339:0:88937:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783074090.171690:0:88937:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9524f49fa800 00000020:01000004:0.0:1783074090.171707:0:88937:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783074090.171722:0:88937:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783074090.171736:0:88937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9524f3da3380) 00000020:00000080:0.0:1783074090.171753:0:88937:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783074090.246581:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783074090.249194:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783074090.250254:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783074090.250584:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783074090.253671:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783074090.253919:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783074090.254155:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1783074090.254423:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783074090.254661:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783074090.254892:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783074090.255179:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783074090.255405:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783074090.255602:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1783074090.255786:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783074090.256607:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783074090.260145:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.260354:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.260574:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.260752:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.260991:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.261176:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.261389:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.261622:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.261829:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.262046:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.262304:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.262584:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.262876:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.263146:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.263378:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.263605:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.263788:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.263957:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.264175:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.264392:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.264576:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.264749:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.264943:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.265120:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.265339:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.265563:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.265762:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.265935:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.266150:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.266361:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.266592:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783074090.266810:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1783074090.267210:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1783074090.267582:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783074090.267788:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783074090.268200:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783074090.268473:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783074090.268686:0:88937:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1783074090.269558:0:88937:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783074090.269756:0:88937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783074090.269765:0:88937:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783074090.269785:0:88937:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df0ef 00000020:01000004:1.0:1783074090.269791:0:88937:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783074090.269803:0:88937:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783074090.269807:0:88937:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524f49fa800 from MGS 00000020:01000004:1.0:1783074090.269811:0:88937:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783074090.269820:0:88937:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9524fb4d99c0) 00000020:00000080:1.0:1783074090.269842:0:88937:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1783074090.269898:0:88937:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524f49fa800 from MGS, refs=2 00080000:01000000:1.0:1783074090.269902:0:88937:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783074090.269920:0:88937:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df0fd 00010000:00010000:1.0:1783074090.270031:0:88937:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1783074090.273032:0:88937:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783074090.277009:0:88942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783074090.277067:0:88937:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783074090.277118:0:88937:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783074090.277730:0:88937:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783074090.278005:0:88937:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783074090.278200:0:88937:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783074090.278206:0:88937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783074090.278895:0:88937:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783074090.278957:0:88937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783074090.279708:0:88937:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783074090.279714:0:88937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783074090.280145:0:88937:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783074090.280166:0:88937:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783074090.280168:0:88937:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783074090.280171:0:88937:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1783074090.280177:0:88937:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783074090.280182:0:88937:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783074090.280185:0:88937:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783074090.280187:0:88937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783074090.280194:0:88937:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c47b6680 x1869685723511936/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074092 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074090.280216:0:88937:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524e410b100 x1869685723513472/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074097 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074090.280235:0:88937:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524fc494000 x1869685723514368/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074102 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783074090.280243:0:88937:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783074090.280245:0:88937:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783074090.280246:0:88937:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783074090.280249:0:88937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1783074090.280369:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723511936:0@lo:400:kworker.0 00000100:00100000:3.0:1783074090.280490:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723514368:0@lo:400:kworker.0 00000100:00100000:3.0:1783074090.280509:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723513472:0@lo:400:kworker.0 10000000:01000000:1.0:1783074090.280557:0:88937:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1783074090.280570:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280580:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280586:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1783074090.280602:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280618:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524e4144800/0x5fb609b3016ded22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016ded29 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280634:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280641:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280646:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280650:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280653:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24400/0x5fb609b3016dec88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dec8f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280661:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280667:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280672:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280674:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280677:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25800/0x5fb609b3016deca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016decab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280686:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280691:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280710:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280714:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280720:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016decce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016decd5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280733:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280740:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280745:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280749:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280752:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016decdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dece3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280761:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280767:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280772:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280775:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280778:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524e4145200/0x5fb609b3016decf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016decff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280786:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280801:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280807:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280811:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280814:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24800/0x5fb609b3016ded06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016ded0d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280823:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280829:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280834:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280837:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280840:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25000/0x5fb609b3016ded30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016ded37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280853:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280859:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280864:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280867:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280870:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25e00/0x5fb609b3016dec96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dec9d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280889:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280896:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280901:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074090.280904:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280907:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868800/0x5fb609b3016decb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016decb9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280917:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280924:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280928:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074090.280932:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280935:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016decc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016decc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280943:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280949:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280953:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074090.280961:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280964:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b24200/0x5fb609b3016decea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016decf1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.280973:0:88937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074090.280979:0:88937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074090.280984:0:88937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074090.280987:0:88937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074090.280991:0:88937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c4b25400/0x5fb609b3016ded14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016ded1b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074090.281004:0:88937:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 52, was 0): DISCONN 00000100:00080000:1.0:1783074090.281009:0:88937:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074090.281013:0:88937:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 2894 00000100:00080000:1.0:1783074090.281019:0:88937:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074090.281041:0:88937:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524e406dc00 x1869685723515776/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074090.281071:0:88937:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1783074090.281196:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723515776:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783074090.281249:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.281350:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515776 00000100:00100000:0.0:1783074090.281357:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515776 00000100:00100000:0.0:1783074090.281383:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783074090.281389:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1869685723515776:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783074090.281421:0:88943:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo t0 exp 0000000000000000 cur 2929 last 0 00000020:00000080:0.0:1783074090.281448:0:88943:0:(genops.c:1406:class_connect()) connect: client 522b6a34-04f4-4017-ab45-61a21d19bfef, cookie 0x5fb609b3016df104 00000100:00080000:0.0:1783074090.281560:0:88943:0:(import.c:65:import_set_state_nolock()) ffff9524fc200000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074090.281613:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3657:x1869685723515776:12345-0@lo:250:mount.lustre.0 Request processed in 222us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.281621:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783074090.281696:0:3657:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 26 00000100:00080000:2.0:1783074090.281704:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:2.0:1783074090.281710:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783074090.281712:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783074090.281715:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783074090.281718:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783074090.281746:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783074090.281753:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723515776:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1783074090.281838:0:53092:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.126@tcp 10000000:01000000:3.0:1783074090.281852:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1783074090.281860:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783074090.281862:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783074090.281863:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.281864:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.281866:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.281867:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.281868:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074090.281870:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.281872:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074090.281933:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:01000000:3.0:1783074090.281950:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783074090.281958:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1783074090.281960:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783074090.281962:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783074090.281963:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.281965:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.281967:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.281968:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.281969:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074090.281971:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.281972:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783074090.281993:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783074090.281998:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1783074090.282000:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783074090.282002:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783074090.282003:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.282004:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.282005:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.282006:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.282007:0:53092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074090.282008:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.282010:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783074090.282019:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1783074090.282046:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723516032:0@lo:253:kworker.0 00000100:00100000:3.0:1783074090.282082:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.282151:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074090.282157:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723516160:0@lo:253:kworker.0 00000100:00100000:3.0:1783074090.282185:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.282244:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516032 00000100:00100000:3.0:1783074090.282248:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516032 00000100:00100000:3.0:1783074090.282274:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516160 00000100:00100000:3.0:1783074090.282277:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516160 00000100:00100000:3.0:1783074090.282295:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783074090.282304:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:3660:x1869685723516032:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783074090.282348:0:88944:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1783074090.282392:0:88937:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1783074090.282400:0:88937:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783074090.282438:0:88937:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1783074090.282441:0:88937:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783074090.282523:0:88937:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783074090.282546:0:88937:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783074090.282549:0:88937:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783074090.282551:0:88937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783074090.282552:0:88937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.282554:0:88937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.282555:0:88937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.282556:0:88937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.282557:0:88937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074090.282559:0:88937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783074090.282560:0:88937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.282561:0:88937:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783074090.282564:0:88937:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783074090.282566:0:88937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783074090.282567:0:88937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783074090.282568:0:88937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.282569:0:88937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.282569:0:88937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.282570:0:88937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.282572:0:88937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074090.282572:0:88937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783074090.282573:0:88937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.282574:0:88937:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783074090.282586:0:88937:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783074090.282596:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783074090.282634:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.282661:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c53353c0 going to sleep for 11 seconds 10000000:01000000:1.0:1783074090.282663:0:88946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783074090.282732:0:88944:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 111 00000100:00100000:0.0:1783074090.282750:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516288 00000100:00100000:0.0:1783074090.282755:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516288 00000100:00100000:0.0:1783074090.282772:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783074090.282780:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3660:x1869685723516160:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783074090.282804:0:88945:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1783074090.283001:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723515904:0@lo:253:kworker.0 00000100:00100000:2.0:1783074090.283031:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.283060:0:88943:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783074090.283066:0:88943:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1783074090.283361:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723515904 00000100:00100000:2.0:1783074090.283366:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723515904 00000100:00100000:3.0:1783074090.283663:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783074090.283670:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88937:x1869685723516288:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783074090.284644:0:88948:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783074090.284649:0:88948:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783074090.284652:0:88948:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783074090.284654:0:88948:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783074090.284810:0:88948:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783074090.285053:0:88944:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783074090.285111:0:88945:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783074090.285270:0:88947:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074090.285275:0:88947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783074090.285279:0:88947:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1783074090.285284:0:88947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783074090.286828:0:88945:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783074090.286839:0:88945:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1783074090.286857:0:88946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783074090.286861:0:88946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783074090.286885:0:88944:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1783074090.286898:0:88946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286915:0:88946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074090.286924:0:88946:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063140s 00010000:00010000:1.0:1783074090.286928:0:88946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286933:0:88946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286938:0:88946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286942:0:88946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286945:0:88946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074090.286948:0:88946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286953:0:88946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286962:0:88946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286967:0:88946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.286970:0:88946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016df10b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074090.287080:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88937:x1869685723516288:12345-0@lo:253:mount.lustre.0 Request processed in 3408us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.287091:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783074090.287151:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516288:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783074090.287163:0:88937:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783074090.287166:0:88937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783074090.287168:0:88937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783074090.287170:0:88937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.287171:0:88937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.287173:0:88937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.287174:0:88937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.287175:0:88937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074090.287177:0:88937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783074090.287178:0:88937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.287179:0:88937:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783074090.287195:0:88937:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524f49fa800 from lustre-MDT0000 10000000:01000000:3.0:1783074090.287220:0:88937:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783074090.287223:0:88937:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783074090.287231:0:88937:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9524f49fa800 10000000:01000000:3.0:1783074090.287234:0:88937:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783074090.287238:0:88937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9524f49fa800 10000000:01000000:3.0:1783074090.287241:0:88937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783074090.287244:0:88937:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524f49fa800 from 1 10000000:01000000:3.0:1783074090.287252:0:88937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783074090.287276:0:88937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.287285:0:88937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.287293:0:88937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074090.287327:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074090.287361:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.287395:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.287432:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516416 00000100:00100000:3.0:1783074090.287438:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516416 00000100:00100000:1.0:1783074090.287439:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783074090.287452:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3658:x1869685723515904:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783074090.287544:0:88943:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1783074090.287926:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3660:x1869685723516160:12345-0@lo:253:kworker.0 Request processed in 5146us (5739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.287934:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1783074090.287962:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783074090.287965:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783074090.287966:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074090.287967:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074090.287968:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074090.287970:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074090.287971:0:3660:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074090.287972:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074090.287974:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783074090.287976:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723516160:0@lo:253:kworker.0 00000100:00100000:0.0:1783074090.288004:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783074090.288009:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:88937:x1869685723516416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074090.288017:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074090.288031:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0868e00/0x5fb609b3016df119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df112 expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.288049:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0868e00/0x5fb609b3016df119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df112 expref: 8 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.288058:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0868e00/0x5fb609b3016df119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df112 expref: 8 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.288066:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868e00, rc 0) 00000100:00100000:0.0:1783074090.288107:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88937:x1869685723516416:12345-0@lo:101:mount.lustre.0 Request processed in 87us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.288121:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783074090.288266:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074090.288279:0:88937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288286:0:88937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074090.288298:0:88937:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783074090.288327:0:88937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288335:0:88937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074090.288352:0:88937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783074090.288355:0:88937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783074090.288359:0:88937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9524f49fa800 10000000:01000000:3.0:1783074090.288362:0:88937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783074090.288364:0:88937:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783074090.288367:0:88937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783074090.288382:0:88937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288390:0:88937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288397:0:88937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074090.288420:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074090.288446:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.288482:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.288499:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516544 00000100:00100000:3.0:1783074090.288502:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516544 00000100:00100000:3.0:1783074090.288535:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783074090.288542:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88937:x1869685723516544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074090.288550:0:88947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074090.288559:0:88947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa53800/0x5fb609b3016df127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df120 expref: -99 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288574:0:88947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa53800/0x5fb609b3016df127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df120 expref: 9 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288593:0:88947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa53800/0x5fb609b3016df127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df120 expref: 9 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.288600:0:88947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53800, rc 0) 00000100:00100000:3.0:1783074090.288639:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88937:x1869685723516544:12345-0@lo:101:mount.lustre.0 Request processed in 98us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.288645:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783074090.288711:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074090.288724:0:88937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.288732:0:88937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074090.288776:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074090.288800:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.288861:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb7e5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074090.288896:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516672 00000100:00100000:1.0:1783074090.288900:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516672 00000100:00100000:1.0:1783074090.288930:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783074090.288936:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c467b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88937:x1869685723516672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074090.289221:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c467b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723516672:12345-0@lo:501:mount.lustre.0 Request processed in 284us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.289228:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783074090.289404:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074090.289447:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074090.289486:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.289510:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb7e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.289752:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516800 00000100:00100000:3.0:1783074090.289756:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516800 00000100:00100000:3.0:1783074090.289808:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783074090.289814:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c357b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723516800:12345-0@lo:503:mount.lustre.0 20000000:01000000:2.0:1783074090.293387:0:88944:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783074090.293397:0:88944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783074090.293434:0:88946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783074090.293439:0:88946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783074090.293458:0:88946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293475:0:88946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074090.293484:0:88946:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063140s 00010000:00010000:1.0:1783074090.293489:0:88946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293496:0:88946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293502:0:88946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293510:0:88946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293524:0:88946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074090.293528:0:88946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074090.293534:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c357b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723516800:12345-0@lo:503:mount.lustre.0 Request processed in 3717us (4044us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074090.293536:0:88946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074090.293543:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783074090.293547:0:88946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293555:0:88946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.293560:0:88946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df12e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074090.293587:0:88943:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783074090.293714:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723516800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074090.294128:0:88949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88949:1869685723516928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074090.294169:0:88949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.294233:0:88949:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074090.294267:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723516928 00000100:00100000:2.0:1783074090.294273:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723516928 00000100:00100000:2.0:1783074090.294393:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783074090.294401:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88949:x1869685723516928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074090.294436:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3660:x1869685723516032:12345-0@lo:253:kworker.0 Request processed in 12134us (12355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.294442:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1783074090.294497:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783074090.294501:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783074090.294502:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074090.294503:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074090.294504:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074090.294506:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074090.294507:0:3660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074090.294509:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074090.294510:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783074090.294513:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723516032:0@lo:253:kworker.0 00000100:00100000:2.0:1783074090.295735:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88949:x1869685723516928:12345-0@lo:502:llog_process_th.0 Request processed in 1331us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074090.295743:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783074090.295889:0:88949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88949:1869685723516928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074090.295972:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074090.295982:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074090.295985:0:88949:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783074090.295990:0:88949:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783074090.295993:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074090.296006:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9524f3da0000) 00000020:00000080:0.0:1783074090.296027:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783074090.296032:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783074090.296111:0:88949:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783074090.296118:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df13c 00000020:00000080:0.0:1783074090.296306:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783074090.296345:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074090.296349:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074090.296350:0:88949:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783074090.296353:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074090.296356:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074090.296358:0:88949:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783074090.296361:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074090.296368:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9524f3da4d40) 00000020:00000080:0.0:1783074090.296379:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783074090.296382:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783074090.296390:0:88949:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783074090.296393:0:88949:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783074090.296399:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783074090.296454:0:88949:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524f49fa800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783074090.296468:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9524e69d0000) 00000020:00000080:0.0:1783074090.296480:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783074090.296524:0:88949:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783074090.296529:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df151 20000000:01000000:1.0:1783074090.297467:0:88943:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783074090.297478:0:88943:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783074090.297639:0:88946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783074090.297643:0:88946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783074090.297662:0:88946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297683:0:88946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074090.297691:0:88946:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063140s 00010000:00010000:2.0:1783074090.297695:0:88946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297702:0:88946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297708:0:88946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297715:0:88946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297720:0:88946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074090.297725:0:88946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297737:0:88946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297749:0:88946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297756:0:88946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.297762:0:88946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d200/0x5fb609b3016df158 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783074090.298089:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783074090.298098:0:88949:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783074090.298103:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb609b3016df15f 00080000:01000000:0.0:1783074090.298108:0:88949:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783074090.298111:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df166 00000100:00100000:1.0:1783074090.298380:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3658:x1869685723515904:12345-0@lo:253:kworker.0 Request processed in 10928us (15344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.298388:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1783074090.301282:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783074090.301286:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783074090.301288:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074090.301289:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074090.301290:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074090.301293:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074090.301294:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783074090.301296:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074090.301298:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074090.301302:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723515904:0@lo:253:kworker.0 00010000:00010000:2.0:1783074090.349203:0:88949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1783074090.349357:0:88949:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0510a7c0-d9c1-4de9-a6c3-ede973deaaff idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:2.0:1783074090.349401:0:88949:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:2.0:1783074090.349440:0:88949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:2.0:1783074090.349542:0:88949:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1783074090.349595:0:88949:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524fb7e5d80: xid 1869685708036480, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:2.0:1783074090.349606:0:88949:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524d0b62e40: xid 1869685708036736, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:2.0:1783074090.349996:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9523c2c33380) 00000020:00000080:2.0:1783074090.350014:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1783074090.350076:0:88949:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783074090.350083:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df182 00000020:00000080:2.0:1783074090.350702:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783074090.355806:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb609b3016df189 00000020:00000080:3.0:1783074090.356095:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783074090.356164:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074090.356171:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074090.356173:0:88949:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783074090.356178:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783074090.356180:0:88949:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1783074090.356182:0:88949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074090.356188:0:88949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074090.356189:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783074090.356192:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074090.356193:0:88949:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783074090.356196:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074090.356201:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074090.356202:0:88949:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783074090.356206:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783074090.356249:0:88949:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783074090.356265:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074090.356268:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074090.356269:0:88949:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783074090.356271:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074090.356274:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074090.356275:0:88949:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783074090.356277:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783074090.356282:0:88949:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:3.0:1783074090.356304:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783074090.356348:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9524fa864d40) 00000020:00000080:3.0:1783074090.356366:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783074090.356373:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783074090.356440:0:88949:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783074090.356445:0:88949:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783074090.356452:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df197 00010000:00080000:3.0:1783074090.356482:0:88949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524ee2c5000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1783074090.359423:0:88949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783074090.360142:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074090.360153:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783074090.360185:0:88949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074090.360206:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df19e 00000100:00080000:2.0:1783074090.360216:0:88949:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074090.360227:0:88949:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9524ee2c5000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074090.360258:0:88949:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c4b15f80 x1869685723517056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074090.360285:0:88949:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783074090.360385:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723517056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074090.360459:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.360519:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517056 00000100:00100000:1.0:1783074090.360525:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517056 00000100:00100000:1.0:1783074090.360566:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:1.0:1783074090.360575:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723517056:12345-0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783074090.360606:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:1.0:1783074090.360606:0:23954:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2929 last 0 00000020:00000080:2.0:1783074090.360614:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.360617:0:88949:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783074090.360621:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074090.360623:0:88949:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1783074090.360625:0:88949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074090.360626:0:88949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074090.360628:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783074090.360631:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.360633:0:88949:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074090.360636:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783074090.360640:0:88949:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783074090.360644:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.360646:0:88949:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783074090.360651:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074090.360656:0:88949:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:1.0:1783074090.360656:0:23954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df1a5 00000004:00100000:1.0:1783074090.360675:0:23954:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1783074090.360678:0:88949:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783074090.360682:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074090.360695:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9523c2c319c0) 00000020:00000080:2.0:1783074090.360712:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783074090.360718:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1783074090.360768:0:23954:0:(import.c:65:import_set_state_nolock()) ffff9524c4406800 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1783074090.360777:0:88949:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783074090.360783:0:88949:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783074090.360789:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df1b3 00010000:00080000:2.0:1783074090.360815:0:88949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c4b3a000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:1.0:1783074090.360833:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723517056:12345-0@lo:38:llog_process_th.0 Request processed in 257us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.360841:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00010000:00010000:2.0:1783074090.360990:0:88949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1783074090.361227:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783074090.361236:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783074090.361242:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783074090.361246:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783074090.361248:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074090.361267:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723517056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074090.361385:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783074090.361395:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723517184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074090.361442:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.361500:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517184 00000100:00100000:0.0:1783074090.361505:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517184 00000100:00100000:0.0:1783074090.361539:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625 00000100:00100000:0.0:1783074090.361547:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723517184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783074090.361568:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:0.0:1783074090.361612:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723517184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.361619:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625 00000100:00100000:2.0:1783074090.361720:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723517184:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1783074090.362034:0:88949:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783074090.362053:0:88949:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783074090.362118:0:88949:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1783074090.362720:0:88949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074090.362746:0:88949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000100:00080000:3.0:1783074090.363445:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074090.363451:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074090.363454:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074090.363460:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2925 00000100:00080000:3.0:1783074090.363465:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783074090.363476:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074090.363499:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ffdf80 x1869685723517312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074090.363570:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723517440:0@lo:400:kworker.0 00000100:00100000:1.0:1783074090.363602:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723517312:0@lo:38:kworker.0 00000100:00100000:2.0:1783074090.363621:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074090.363649:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074090.363653:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074090.363655:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074090.363660:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2925 00000100:00080000:3.0:1783074090.363663:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783074090.363667:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074090.363683:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8fffb80 x1869685723517568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074090.363770:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723517696:0@lo:400:kworker.0 00000100:00100000:2.0:1783074090.363792:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.363818:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074090.363840:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074090.363846:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074090.363849:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074090.363853:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2925 00000100:00080000:3.0:1783074090.363857:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1783074090.363858:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723517568:0@lo:38:kworker.0 00000100:00080000:3.0:1783074090.363863:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074090.363882:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df293800 x1869685723517824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074090.363894:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.363921:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723517824:0@lo:38:kworker.0 00000100:00080000:3.0:1783074090.363923:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074090.363928:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074090.363930:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074090.363934:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2925 00000100:00080000:3.0:1783074090.363937:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1783074090.363946:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517440 00000100:00080000:3.0:1783074090.363948:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074090.363953:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517440 00000100:00100000:1.0:1783074090.363954:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.363965:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4698380 x1869685723518208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074090.363980:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723518208:0@lo:38:kworker.0 00000100:00080000:3.0:1783074090.364000:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074090.364010:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.364018:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723517952:0@lo:400:kworker.0 00000100:00100000:0.0:1783074090.364040:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517696 00000100:00100000:0.0:1783074090.364043:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517696 00000100:00100000:3.0:1783074090.364053:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.364056:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517312 00000100:00100000:1.0:1783074090.364062:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517312 00000100:00100000:0.0:1783074090.364070:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517568 00000100:00100000:0.0:1783074090.364075:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517568 00000100:00100000:1.0:1783074090.364081:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518208 00000100:00100000:1.0:1783074090.364085:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518208 00000100:00100000:0.0:1783074090.364093:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1783074090.364101:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723517440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074090.364199:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723517440:12345-0@lo:400:kworker.0 Request processed in 98us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074090.364501:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1783074090.364509:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1783074090.364516:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723517696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074090.364519:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723517312:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074090.364549:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723517696:12345-0@lo:400:kworker.0 Request processed in 40us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074090.364556:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1783074090.364571:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1783074090.364575:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723517568:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074090.364604:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723517568:12345-0@lo:38:kworker.0 Request processed in 28us (714us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074090.364609:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1783074090.364617:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1783074090.364621:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723518208:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074090.364641:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723518208:12345-0@lo:38:kworker.0 Request processed in 19us (635us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074090.364646:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1783074090.364671:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723517696:0@lo:400:kworker.0 00000100:00100000:2.0:1783074090.364689:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723517440:0@lo:400:kworker.0 00000100:00100000:2.0:1783074090.364697:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074090.364703:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723518080:0@lo:400:kworker.0 00000100:00100000:2.0:1783074090.364720:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.364749:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517952 00000100:00100000:2.0:1783074090.364752:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517952 00000100:00100000:2.0:1783074090.364776:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518080 00000100:00100000:2.0:1783074090.364778:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518080 00000100:00100000:2.0:1783074090.364794:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1783074090.364800:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074090.364831:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723517952:12345-0@lo:400:kworker.0 Request processed in 32us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074090.364838:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1783074090.364849:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1783074090.364855:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074090.364886:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723518080:12345-0@lo:400:kworker.0 Request processed in 31us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074090.364894:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1783074090.364909:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723517312:12345-0@lo:38:kworker.0 Request processed in 389us (1090us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074090.364930:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723517952:0@lo:400:kworker.0 00000100:00100000:1.0:1783074090.364930:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1783074090.364964:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723518080:0@lo:400:kworker.0 00000100:00080000:1.0:1783074090.364986:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074090.364992:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074090.364996:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723518208:0@lo:38:kworker.0 00000100:00080000:1.0:1783074090.365007:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074090.365010:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074090.365013:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723517568:0@lo:38:kworker.0 00000100:00080000:1.0:1783074090.365020:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074090.365024:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074090.365028:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723517312:0@lo:38:kworker.0 00000100:00100000:0.0:1783074090.365036:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00080000:3.0:1783074090.365044:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074090.365048:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074090.365051:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074090.365062:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723517824 00000100:00100000:1.0:1783074090.365066:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723517824 00000100:00100000:1.0:1783074090.365090:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626 00000100:00100000:1.0:1783074090.365095:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723517824:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074090.365138:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723517824:12345-0@lo:38:kworker.0 Request processed in 42us (1189us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783074090.365144:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626 00000100:00080000:0.0:1783074090.365191:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074090.365196:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783074090.365199:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723517824:0@lo:38:kworker.0 00000040:00080000:3.0:1783074090.367081:0:88949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1783074090.367945:0:88955:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1783074090.367950:0:88955:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783074090.368096:0:88955:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1783074090.368511:0:88955:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783074090.368627:0:88955:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1783074090.368631:0:88955:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783074090.368987:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074090.368999:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074090.369036:0:88949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783074090.369057:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df1ba 00000100:00080000:2.0:1783074090.369066:0:88949:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074090.369072:0:88949:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9524c4b3a000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074090.369207:0:88949:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ffdf80 x1869685723518336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074090.369261:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723518336:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783074090.369390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074090.369473:0:88949:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783074090.369542:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074090.369550:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.369552:0:88949:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783074090.369555:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074090.369557:0:88949:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783074090.369559:0:88949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074090.369560:0:88949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074090.369561:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783074090.369563:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.369565:0:88949:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074090.369567:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783074090.369571:0:88949:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783074090.369573:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.369575:0:88949:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783074090.369577:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074090.369581:0:88949:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1783074090.369598:0:88949:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783074090.369601:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074090.369610:0:88949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9523c2c34d40) 00000100:00100000:1.0:1783074090.369625:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518336 00000020:00000080:2.0:1783074090.369627:0:88949:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000100:00100000:1.0:1783074090.369633:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518336 00000020:00000080:2.0:1783074090.369634:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783074090.369667:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893 00000100:00100000:1.0:1783074090.369674:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3657:x1869685723518336:12345-0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783074090.369698:0:88949:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00010000:00080000:1.0:1783074090.369699:0:26171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2929 last 0 00080000:01000000:2.0:1783074090.369704:0:88949:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783074090.369715:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df1cf 00000020:00000080:1.0:1783074090.369728:0:26171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df1c8 00002000:00100000:1.0:1783074090.369743:0:26171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9524debea000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00080000:2.0:1783074090.369747:0:88949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c4b62000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00002000:00080000:1.0:1783074090.369756:0:26171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783074090.369760:0:26171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783074090.369818:0:26171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783074090.369840:0:26171:0:(import.c:65:import_set_state_nolock()) ffff9524debeb800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1783074090.370092:0:88949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1783074090.370166:0:88949:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783074090.370179:0:88949:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1783074090.370476:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723518336:12345-0@lo:8:llog_process_th.0 Request processed in 800us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.370485:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893 00000100:00100000:0.0:1783074090.370491:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783074090.370499:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783074090.370506:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783074090.370510:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783074090.370513:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783074090.370638:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783074090.370645:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723518336:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783074090.370749:0:88955:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783074090.370792:0:88955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2929588480589ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783074090.370798:0:88955:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:0.0:1783074090.370957:0:88949:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:2.0:1783074090.371065:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723518464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074090.371112:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.371230:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518464 00000100:00100000:0.0:1783074090.371236:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518464 00000100:00100000:0.0:1783074090.371291:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1783074090.371299:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723518464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783074090.371352:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783074090.371428:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074090.371554:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723518464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.371561:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:2.0:1783074090.371623:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723518464:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1783074090.372453:0:88938:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1783074090.373875:0:88949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783074090.373908:0:88949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:1.0:1783074090.374030:0:88949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:3.0:1783074090.374586:0:88957:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1783074090.374591:0:88957:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074090.374711:0:88957:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1783074090.374729:0:88957:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074090.374832:0:88957:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1783074090.374836:0:88957:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783074090.380662:0:88949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074090.380676:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074090.380719:0:88949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074090.380743:0:88949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df1d6 00000100:00080000:2.0:1783074090.380753:0:88949:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074090.380758:0:88949:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9523c4b62000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074090.380792:0:88949:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ffed80 x1869685723518592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074090.380813:0:88949:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783074090.380872:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074090.380876:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.380878:0:88949:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783074090.380880:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074090.380884:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.380885:0:88949:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783074090.380888:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783074090.380890:0:88949:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783074090.380892:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074090.380894:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.380895:0:88949:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783074090.380897:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074090.380900:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.380901:0:88949:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783074090.380904:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783074090.380932:0:88949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88949:1869685723518720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074090.381005:0:88949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.381049:0:88949:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.381075:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518720 00000100:00100000:3.0:1783074090.381082:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518720 00000100:00100000:0.0:1783074090.381112:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723518592:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783074090.381132:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783074090.381144:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88949:x1869685723518720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074090.381152:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.381187:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518592 00000100:00100000:0.0:1783074090.381191:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518592 00000100:00100000:0.0:1783074090.381220:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4894 00000100:00100000:0.0:1783074090.381225:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3657:x1869685723518592:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783074090.381247:0:26175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2929 last 0 00000020:00000080:0.0:1783074090.381273:0:26175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df1dd 00000100:00100000:2.0:1783074090.381353:0:88949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88949:1869685723518720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074090.381390:0:88949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074090.381394:0:88949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074090.381395:0:88949:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783074090.381399:0:88949:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783074090.381472:0:88937:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783074090.381496:0:88937:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783074090.381590:0:88937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.381602:0:88937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074090.381609:0:88937:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524f49fa800 from 1 10000000:01000000:2.0:1783074090.381612:0:88937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783074090.381646:0:88937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.381655:0:88937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.381663:0:88937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074090.381675:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723518848:0@lo:101:mount.lustre.0 00002000:00100000:0.0:1783074090.381818:0:26175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9523c6940800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783074090.381823:0:26175:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783074090.381826:0:26175:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783074090.381890:0:26175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074090.381910:0:26175:0:(import.c:65:import_set_state_nolock()) ffff9523c6945000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074090.381954:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723518592:12345-0@lo:8:llog_process_th.0 Request processed in 727us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.381961:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4894 00000100:00100000:1.0:1783074090.382035:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783074090.382042:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783074090.382049:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783074090.382053:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783074090.382056:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4b62000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783074090.382076:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783074090.382081:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723518592:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1783074090.382101:0:88957:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783074090.382142:0:88957:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2929599830469ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783074090.382148:0:88957:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783074090.382483:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074090.382499:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723518976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074090.382526:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.382554:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518976 00000100:00100000:0.0:1783074090.382558:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518976 00000100:00100000:0.0:1783074090.382591:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1783074090.382597:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723518976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074090.382614:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074090.382646:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723518976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.382652:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00080000:0.0:1783074090.382666:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074090.382690:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723518976:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1783074090.384259:0:88938:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783074090.384504:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88949:x1869685723518720:12345-0@lo:502:llog_process_th.0 Request processed in 3360us (3497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.384522:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783074090.384571:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.384603:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.384623:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723518848 00000100:00100000:0.0:1783074090.384630:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723518848 00000100:00100000:0.0:1783074090.384702:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783074090.384709:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:88937:x1869685723518848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074090.384720:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074090.384737:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df1e4 expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.384758:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 9 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.384768:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 9 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.384776:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868a00, rc 0) 00000100:00100000:0.0:1783074090.384818:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88937:x1869685723518848:12345-0@lo:101:mount.lustre.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.384830:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783074090.384893:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723518848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074090.384907:0:88937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.384926:0:88937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074090.385505:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519104:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783074090.385539:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.385563:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783074090.385583:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519104 00000100:00100000:1.0:1783074090.385589:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519104 00000100:00100000:1.0:1783074090.385622:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783074090.385630:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88937:x1869685723519104:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783074090.385644:0:88944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783074090.385670:0:88944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783074090.385675:0:88944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783074090.385682:0:88944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783074090.385685:0:88944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 114 00000100:00100000:1.0:1783074090.385953:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88937:x1869685723519104:12345-0@lo:256:mount.lustre.0 Request processed in 323us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.385961:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783074090.385986:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519104:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783074090.386666:0:88937:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074090.386689:0:88937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.386698:0:88937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074090.386706:0:88937:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49fa800 from 1 10000000:01000000:2.0:1783074090.386708:0:88937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074090.386729:0:88937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.386737:0:88937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.386745:0:88937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074090.386757:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074090.386783:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.386814:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.387014:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519232 00000100:00100000:3.0:1783074090.387019:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519232 00000100:00100000:3.0:1783074090.387051:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783074090.387059:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:88937:x1869685723519232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074090.387069:0:88943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074090.387081:0:88943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa53e00/0x5fb609b3016df1f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df1f2 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.387100:0:88943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa53e00/0x5fb609b3016df1f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df1f2 expref: 10 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.387109:0:88943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa53e00/0x5fb609b3016df1f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df1f2 expref: 10 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.387115:0:88943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53e00, rc 0) 00000100:00100000:3.0:1783074090.387184:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723519232:12345-0@lo:101:mount.lustre.0 Request processed in 126us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.387191:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783074090.387220:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074090.387233:0:88937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.387241:0:88937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074090.387287:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074090.387451:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.387539:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783074090.387572:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519360 00000100:00100000:1.0:1783074090.387576:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519360 00000100:00100000:1.0:1783074090.387607:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783074090.387613:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723519360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074090.388154:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723519360:12345-0@lo:501:mount.lustre.0 Request processed in 540us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.388162:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783074090.388216:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074090.388244:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074090.388280:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.388373:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.388442:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519488 00000100:00100000:0.0:1783074090.388447:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519488 00000100:00100000:0.0:1783074090.388479:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783074090.388488:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723519488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074090.388569:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723519488:12345-0@lo:503:mount.lustre.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.388576:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783074090.388647:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074090.389041:0:88959:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88959:1869685723519616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074090.389072:0:88959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.389092:0:88959:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c558d840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.389374:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519616 00000100:00100000:3.0:1783074090.389379:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519616 00000100:00100000:3.0:1783074090.389420:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783074090.389428:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88959:x1869685723519616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074090.389830:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88959:x1869685723519616:12345-0@lo:502:llog_process_th.0 Request processed in 401us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.389839:0:88959:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88959:1869685723519616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074090.389840:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:1.0:1783074090.389870:0:88959:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074090.389880:0:88959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074090.389882:0:88959:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783074090.389889:0:88959:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524f49fa800 00000020:00000080:1.0:1783074090.389892:0:88959:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783074090.389899:0:88959:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074090.389901:0:88959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074090.389902:0:88959:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783074090.389904:0:88959:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074090.389907:0:88959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074090.389908:0:88959:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783074090.389912:0:88959:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524f49fa800 00000020:00000080:1.0:1783074090.389913:0:88959:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783074090.390040:0:88959:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88959:1869685723519744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074090.390071:0:88959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.390097:0:88959:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c558d840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.390188:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519744 00000100:00100000:0.0:1783074090.390193:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519744 00000100:00100000:0.0:1783074090.390224:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783074090.390230:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88959:x1869685723519744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074090.390303:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88959:x1869685723519744:12345-0@lo:502:llog_process_th.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.390333:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783074090.390420:0:88959:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88959:1869685723519744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074090.390440:0:88959:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074090.390444:0:88959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074090.390445:0:88959:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783074090.390449:0:88959:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783074090.390558:0:88937:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783074090.390584:0:88937:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783074090.390602:0:88937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.390611:0:88937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074090.390664:0:88937:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783074090.390667:0:88937:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9524f49fa800 10000000:01000000:3.0:1783074090.390670:0:88937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9524f49fa800 10000000:01000000:3.0:1783074090.390674:0:88937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783074090.390678:0:88937:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49fa800 from 1 10000000:01000000:3.0:1783074090.390680:0:88937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074090.390701:0:88937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.390709:0:88937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.390717:0:88937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074090.390730:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074090.390757:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.390893:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.391030:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723519872 00000100:00100000:0.0:1783074090.391034:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723519872 00000100:00100000:0.0:1783074090.391089:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783074090.391097:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:88937:x1869685723519872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074090.391106:0:88944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074090.391126:0:88944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0869400/0x5fb609b3016df207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df200 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.391146:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0869400/0x5fb609b3016df207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df200 expref: 11 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.391157:0:88944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0869400/0x5fb609b3016df207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df200 expref: 11 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.391171:0:88944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869400, rc 0) 00000100:00100000:0.0:1783074090.391211:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723519872:12345-0@lo:101:mount.lustre.0 Request processed in 115us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.391228:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783074090.391300:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723519872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074090.391327:0:88937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.391337:0:88937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074090.391380:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723520000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074090.391404:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.391437:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c558d840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.391448:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520000 00000100:00100000:3.0:1783074090.391454:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520000 00000100:00100000:3.0:1783074090.391546:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783074090.391554:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723520000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783074090.391773:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723520000:12345-0@lo:501:mount.lustre.0 Request processed in 220us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.391883:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783074090.392087:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723520000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074090.392114:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723520128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074090.392144:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.392167:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c558d840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.392220:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520128 00000100:00100000:3.0:1783074090.392224:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520128 00000100:00100000:3.0:1783074090.392254:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783074090.392261:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723520128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074090.393291:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723520128:12345-0@lo:503:mount.lustre.0 Request processed in 1028us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.393299:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783074090.393564:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723520128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074090.393923:0:88961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88961:1869685723520256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074090.393969:0:88961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074090.394093:0:88961:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074090.394126:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520256 00000100:00100000:1.0:1783074090.394131:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520256 00000100:00100000:1.0:1783074090.394207:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783074090.394221:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88961:x1869685723520256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074090.394337:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88961:x1869685723520256:12345-0@lo:502:llog_process_th.0 Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.394344:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783074090.394421:0:88961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88961:1869685723520256:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783074090.394473:0:88961:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783074090.394486:0:88961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9523c2284d40) 00000020:00000080:2.0:1783074090.394511:0:88961:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783074090.396554:0:88961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524f49fa800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074090.396561:0:88961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524f49fa800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074090.396571:0:88961:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49fa800 4 00010000:00080000:2.0:1783074090.396607:0:88961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c4e7a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1783074090.400913:0:88961:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783074090.401017:0:88961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783074090.401077:0:88961:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783074090.401089:0:88961:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb609b3016df215 00000100:00080000:2.0:1783074090.401098:0:88961:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074090.401104:0:88961:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9523c4e7a800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074090.401137:0:88961:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ffd500 x1869685723520384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074090.401171:0:88961:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783074090.401482:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723520384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074090.401549:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.401711:0:88961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88961:1869685723520512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074090.401755:0:88961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.401785:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520512 00000100:00100000:0.0:1783074090.401793:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520512 00000100:00100000:3.0:1783074090.401811:0:88961:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c53353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.401830:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783074090.401837:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c44eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88961:x1869685723520512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074090.401942:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520384 00000100:00100000:0.0:1783074090.401947:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c44eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88961:x1869685723520512:12345-0@lo:502:llog_process_th.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074090.401948:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520384 00000100:00100000:0.0:1783074090.401958:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783074090.402029:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1783074090.402035:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fab51450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723520384:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074090.402097:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fab51450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723520384:12345-0@lo:38:llog_process_th.0 Request processed in 61us (548us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074090.402104:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1783074090.403475:0:88961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88961:1869685723520512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074090.403527:0:88961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88961:1869685723520640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074090.403574:0:88961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074090.403621:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520640 00000100:00100000:3.0:1783074090.403626:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520640 00000100:00100000:3.0:1783074090.403663:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783074090.403671:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c44ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88961:x1869685723520640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074090.403763:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c44ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88961:x1869685723520640:12345-0@lo:502:llog_process_th.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.403772:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783074090.403815:0:88961:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3249840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.403830:0:88961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:88961:1869685723520640:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783074090.403848:0:88961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783074090.404043:0:88937:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783074090.404079:0:88937:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074090.404094:0:88937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.404104:0:88937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783074090.404159:0:88937:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783074090.404162:0:88937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783074090.404164:0:88937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074090.404165:0:88937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074090.404167:0:88937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074090.404169:0:88937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074090.404170:0:88937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074090.404172:0:88937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783074090.404174:0:88937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074090.404176:0:88937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783074090.404184:0:88937:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783074090.404186:0:88937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783074090.404188:0:88937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783074090.404189:0:88937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074090.404191:0:88937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074090.404192:0:88937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074090.404193:0:88937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074090.404195:0:88937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074090.404196:0:88937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783074090.404197:0:88937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074090.404198:0:88937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783074090.404212:0:88937:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783074090.404223:0:88937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723520768:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783074090.404261:0:88937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.404280:0:88937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c497b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.404300:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520768 00000100:00100000:0.0:1783074090.404303:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520768 00000100:00100000:0.0:1783074090.404373:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783074090.404381:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c44ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723520768:12345-0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783074090.404383:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783074090.404390:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074090.404395:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783074090.404399:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723520384:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783074090.404400:0:88944:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783074090.404427:0:88944:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783074090.408516:0:88944:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783074090.408533:0:88944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783074090.408626:0:88946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783074090.408631:0:88946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783074090.408651:0:88946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.408667:0:88946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.408675:0:88946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.408710:0:88946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.408724:0:88946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 3029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074090.408737:0:88946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88946:1869685723520896:0@lo:104: 00000100:00100000:0.0:1783074090.409242:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c44ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:88937:x1869685723520768:12345-0@lo:253:mount.lustre.0 Request processed in 4861us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.409250:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783074090.409293:0:88946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074090.409433:0:88946:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c558d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.409512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723520896 00000100:00100000:3.0:1783074090.409519:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723520896 00000100:00100000:3.0:1783074090.409564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1783074090.409564:0:88937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:88937:1869685723520768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783074090.409572:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:88946:x1869685723520896:12345-0@lo:104: 10000000:01000000:0.0:1783074090.409577:0:88937:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783074090.409580:0:88937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783074090.409581:0:88937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783074090.409583:0:88937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:3.0:1783074090.409584:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783074090.409585:0:88937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074090.409593:0:88937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074090.409595:0:88937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074090.409596:0:88937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074090.409597:0:88937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783074090.409599:0:88937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074090.409601:0:88937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783074090.409615:0:88937:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783074090.409699:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074090.409704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:88946:x1869685723520896:12345-0@lo:104: Request processed in 135us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074090.409710:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:2.0:1783074090.409731:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074090.409740:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.409749:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074090.409753:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.409763:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074090.409783:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074090.409789:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074090.409819:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.409827:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074090.409877:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723521024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074090.409893:0:88946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88946:1869685723520896:0@lo:104: 00010000:00010000:1.0:1783074090.409910:0:88946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074090.409919:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074090.409991:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.410000:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df1e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016df1eb expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074090.410015:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074090.410017:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074090.410018:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074090.410095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521024 00000100:00100000:3.0:1783074090.410100:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521024 00010000:00010000:3.0:1783074090.410119:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 3029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074090.410189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:3.0:1783074090.410199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3661:x1869685723521024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074090.410210:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074090.410216:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 3029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.410239:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 3029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.410252:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0868a00/0x5fb609b3016df1eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016df1e4 expref: 11 pid: 88945 timeout: 3029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.410264:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074090.410272:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074090.410335:0:6514:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001704532s 00010000:00010000:0.0:1783074090.410341:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410350:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410357:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410363:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410368:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074090.410372:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410380:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410396:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074090.410416:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074090.410436:0:88946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074090.410444:0:88946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074090.410448:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3661:x1869685723521024:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (533us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074090.410451:0:88946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd200/0x5fb609b3016df21c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074090.410456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:3.0:1783074090.410578:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723521024:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783074090.416617:0:88937:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:1.0:1783074090.417343:0:88937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783074090.417373:0:88967:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:0.0:1783074090.417378:0:88967:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:1.0:1783074090.417593:0:88968:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783074090.417815:0:88937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783074090.418174:0:88968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783074090.419491:0:88969:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88969:1869685723521152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074090.419556:0:88969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.419593:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521152 00000100:00100000:0.0:1783074090.419599:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521152 00000100:00100000:0.0:1783074090.419640:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627 00000100:00100000:0.0:1783074090.419647:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88969:x1869685723521152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074090.419718:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88969:x1869685723521152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.419725:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627 00000100:00100000:0.0:1783074090.419762:0:88969:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d08d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.419785:0:88969:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88969:1869685723521152:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1783074090.419811:0:88969:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783074090.419834:0:88969:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88969:1869685723521280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074090.419861:0:88969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.419884:0:88969:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d08d4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074090.419965:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521280 00000100:00100000:3.0:1783074090.419971:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521280 00000100:00100000:3.0:1783074090.420200:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628 00000100:00100000:3.0:1783074090.420209:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88969:x1869685723521280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074090.420427:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88969:x1869685723521280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 219us (563us total) trans 0 rc 0/0 00000040:00080000:2.0:1783074090.420433:0:88968:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000100:00100000:3.0:1783074090.420437:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628 00000100:00100000:0.0:1783074090.420438:0:88969:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88969:1869685723521280:0@lo:1000:lod0000_rec0001.0 00000004:00080000:2.0:1783074090.420503:0:88968:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1783074090.420506:0:88969:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88969:1869685723521408:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074090.420534:0:88969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074090.420556:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521408 00000100:00100000:0.0:1783074090.420560:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521408 00000100:00100000:0.0:1783074090.420591:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629 00000100:00100000:0.0:1783074090.420601:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88969:x1869685723521408:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074090.420661:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88969:x1869685723521408:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.420668:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629 00000100:00100000:0.0:1783074090.420694:0:88969:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d08d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074090.420709:0:88969:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88969:1869685723521408:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783074090.420746:0:88969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783074090.420864:0:88937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783074090.420900:0:88937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074090.428022:0:88969:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783074090.428101:0:88969:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783074090.428106:0:88969:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1783074090.428916:0:88937:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783074090.428932:0:88937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783074090.429100:0:88937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783074090.430070:0:88937:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783074090.430644:0:88937:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783074090.430671:0:88937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783074090.430735:0:88937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783074090.431199:0:88937:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:0.0:1783074090.433705:0:88937:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00010000:00080000:0.0:1783074090.437453:0:88970:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88970 00010000:02000000:0.0:1783074090.437465:0:88970:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1783074090.437469:0:88970:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783074090.437472:0:88970:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783074090.437583:0:88937:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783074090.437597:0:88937:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783074090.437613:0:88937:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783074090.437635:0:88937:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783074090.438480:0:88937:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074090.438759:0:88937:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783074090.480042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074090.480088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074090.480107:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042496 00000100:00100000:1.0:1783074090.480115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074090.480118:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042496 00000100:00100000:1.0:1783074090.480140:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074090.480159:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1783074090.480163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074090.480168:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c44e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2403:x1869685708042496:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:3.0:1783074090.480176:0:88945:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:1.0:1783074090.480183:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042752 00000100:00100000:1.0:1783074090.480186:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042752 00000100:00100000:1.0:1783074090.480227:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042624 00000100:00100000:1.0:1783074090.480230:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042624 00000100:00100000:3.0:1783074090.480231:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c44e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2403:x1869685708042496:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 63us (199us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074090.480247:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1783074090.480258:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 783 00000100:00100000:1.0:1783074090.480265:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708042752:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074090.480300:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708042752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.480308:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 783 00000100:00100000:1.0:1783074090.480341:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1139 00000100:00100000:1.0:1783074090.480346:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708042624:12345-192.168.204.26@tcp:38:kworker.0 00010000:00080000:1.0:1783074090.480369:0:66202:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0510a7c0-d9c1-4de9-a6c3-ede973deaaff' at ffff9524c6e2d000, cookie 0x5fb609b3016df16d 00010000:00080000:1.0:1783074090.480375:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp recovering/t107374182407 exp ffff9524c6e2d000 cur 2929 last 1783074090 00010000:02000400:1.0:1783074090.480382:0:66202:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1783074090.480389:0:66202:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783074090.480420:0:66202:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783074090.480536:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524fb73f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074090.480582:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708042624:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 233us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.480589:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1139 00000100:00100000:1.0:1783074090.480613:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708042880 00000100:00100000:1.0:1783074090.480617:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708042880 00000100:00080000:0.0:1783074090.480627:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074090.480633:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074090.480645:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043008 00000100:00100000:1.0:1783074090.480649:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043008 00000100:00100000:0.0:1783074090.480657:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4895 00000100:00100000:0.0:1783074090.480668:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708042880:12345-192.168.204.26@tcp:9:kworker.0 00000100:00100000:1.0:1783074090.480687:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4896 00000020:00000080:0.0:1783074090.480688:0:26178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016deda7 00000100:00080000:0.0:1783074090.480695:0:26178:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c4800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783074090.480703:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708043008:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:1.0:1783074090.480717:0:8487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dedae 00000100:00080000:1.0:1783074090.480727:0:8487:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783074090.480742:0:26178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968713 00000001:00000004:1.0:1783074090.480762:0:8487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968708 00000100:00100000:1.0:1783074090.480860:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+2:2401:x1869685708043008:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 158us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074090.480868:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4896 00010000:00010000:1.0:1783074090.480893:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074090.480922:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+2:2401:x1869685708042880:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 255us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.480930:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4895 00010000:00010000:0.0:1783074090.480958:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074090.481035:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074090.489672:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074090.489760:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708037632 00000100:00100000:3.0:1783074090.489772:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708037632 00000100:00100000:3.0:1783074090.489861:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1140 00000100:00100000:3.0:1783074090.489873:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708037632:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00080000:3.0:1783074090.489894:0:68632:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00010000:00080000:0.0:1783074090.490601:0:88970:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783074090.490658:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708037632:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 784us (997us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074090.490669:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1140 00000100:00100000:2.0:1783074090.494866:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074090.494921:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043136 00000100:00100000:0.0:1783074090.494935:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043136 00000100:00100000:0.0:1783074090.495057:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:0.0:1783074090.495065:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c641f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1869685708043136:12345-192.168.204.26@tcp:250:ptlrpcd_00_01.0 00010000:00080000:0.0:1783074090.495096:0:88943:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from da924155-7591-4a6a-a2d2-c0d2908d0bfb@192.168.204.26@tcp t0 exp 0000000000000000 cur 2929 last 0 00000020:00000080:0.0:1783074090.495133:0:88943:0:(genops.c:1406:class_connect()) connect: client da924155-7591-4a6a-a2d2-c0d2908d0bfb, cookie 0x5fb609b3016df223 00000100:00080000:0.0:1783074090.495432:0:88943:0:(import.c:65:import_set_state_nolock()) ffff9524c356e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074090.495533:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c641f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:2401:x1869685708043136:12345-192.168.204.26@tcp:250:ptlrpcd_00_01.0 Request processed in 466us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074090.495542:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00010000:00010000:1.0:1783074090.607022:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783074091.374547:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783074091.374554:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524f49fa800 from 115 10000000:01000000:0.0:1783074091.374559:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783074091.374600:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.374611:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.374622:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.374644:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.374707:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.374779:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.376122:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521536 00000100:00100000:3.0:1783074091.376132:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521536 00000100:00100000:3.0:1783074091.376197:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783074091.376208:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c641d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:6527:x1869685723521536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.376223:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074091.376240:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa53a00/0x5fb609b3016df231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df22a expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.376265:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa53a00/0x5fb609b3016df231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df22a expref: 11 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.376276:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa53a00/0x5fb609b3016df231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df22a expref: 11 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.376285:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53a00, rc 0) 00000100:00100000:3.0:1783074091.376518:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c641d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723521536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.376527:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783074091.376766:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.376782:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.376799:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.376858:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.376894:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.377125:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.377644:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521664 00000100:00100000:2.0:1783074091.377650:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521664 00000100:00100000:2.0:1783074091.377690:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783074091.377699:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723521664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074091.377715:0:88944:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783074091.377729:0:88944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074091.377732:0:88944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 115 00000100:00100000:2.0:1783074091.377822:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723521664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.377831:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783074091.377852:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783074091.377900:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783074091.377908:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.377918:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.377928:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074091.377931:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 52 10000000:01000000:0.0:1783074091.377934:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074091.377954:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.377963:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.377971:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.377984:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.378018:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.378044:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.378666:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521792 00000100:00100000:2.0:1783074091.378670:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521792 00000100:00100000:2.0:1783074091.378693:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783074091.378698:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723521792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.378706:0:88947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074091.378718:0:88947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086d400/0x5fb609b3016df23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df238 expref: -99 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.378738:0:88947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086d400/0x5fb609b3016df23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df238 expref: 12 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.378747:0:88947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086d400/0x5fb609b3016df23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df238 expref: 12 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.378756:0:88947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086d400, rc 0) 00000100:00100000:2.0:1783074091.378793:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723521792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.378800:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783074091.378863:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074091.378874:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.378882:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074091.378933:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.378957:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074091.378980:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b780 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.378993:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723521920 00000100:00100000:3.0:1783074091.378999:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723521920 00000100:00100000:3.0:1783074091.379033:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783074091.379044:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723521920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.379187:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723521920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.379194:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783074091.379685:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723521920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.379714:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.379753:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074091.379777:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.379892:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522048 00000100:00100000:2.0:1783074091.379896:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522048 00000100:00100000:2.0:1783074091.379954:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783074091.379968:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723522048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.380054:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723522048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.380062:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783074091.380119:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074091.381260:0:89047:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783074091.381346:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783074091.381399:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074091.381408:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.381419:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074091.381429:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783074091.381431:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 112 10000000:01000000:2.0:1783074091.381433:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783074091.381456:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.381465:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.381473:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.381490:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.381529:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.381573:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.381687:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522176 00000100:00100000:0.0:1783074091.381693:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522176 00000100:00100000:0.0:1783074091.381728:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783074091.381737:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723522176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.381746:0:88943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074091.381758:0:88943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0868800/0x5fb609b3016df24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df246 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.381776:0:88943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0868800/0x5fb609b3016df24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df246 expref: 13 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.381786:0:88943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0868800/0x5fb609b3016df24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df246 expref: 13 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.381794:0:88943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868800, rc 0) 00000100:00100000:0.0:1783074091.381831:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723522176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.381838:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783074091.381867:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.381880:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.381888:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074091.381940:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.382192:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.382243:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522304 00000100:00100000:0.0:1783074091.382247:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522304 00000100:00100000:3.0:1783074091.382251:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d018d840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.382281:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783074091.382288:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723522304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783074091.382302:0:88945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783074091.382336:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783074091.382341:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783074091.382351:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783074091.382354:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783074091.382357:0:88945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:0.0:1783074091.382437:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723522304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.382445:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783074091.382515:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783074091.382635:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074091.382646:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.382655:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074091.382662:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783074091.382663:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783074091.382666:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074091.382679:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.382684:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.382689:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.382698:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.382717:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.382738:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.382753:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522432 00000100:00100000:3.0:1783074091.382758:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522432 00000100:00100000:3.0:1783074091.382784:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783074091.382788:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723522432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.382794:0:88944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074091.382800:0:88944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa52400/0x5fb609b3016df25b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df254 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.382811:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa52400/0x5fb609b3016df25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df254 expref: 14 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.382826:0:88944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa52400/0x5fb609b3016df25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df254 expref: 14 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.382831:0:88944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52400, rc 0) 00000100:00100000:3.0:1783074091.382906:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723522432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.382912:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783074091.382920:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.382930:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.382939:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.382984:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.383016:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.383033:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.383037:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522560 00000100:00100000:3.0:1783074091.383041:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522560 00000100:00100000:3.0:1783074091.383178:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783074091.383186:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723522560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.383364:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.383428:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723522560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.383436:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783074091.383455:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.383499:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.383532:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522688 00000100:00100000:0.0:1783074091.383537:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522688 00000100:00100000:0.0:1783074091.383565:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783074091.383572:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723522688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.383629:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.385066:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723522688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1490us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.385076:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783074091.386291:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074091.387127:0:89049:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1783074091.387354:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1783074091.387378:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783074091.387401:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.387412:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.387421:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1783074091.387424:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9523c6b72800 from 1 10000000:01000000:0.0:1783074091.387427:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783074091.387459:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.387468:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.387489:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.387507:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.387557:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.387592:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.387660:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522816 00000100:00100000:1.0:1783074091.387667:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522816 00000100:00100000:1.0:1783074091.387709:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783074091.387718:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723522816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074091.387730:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074091.387748:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc000/0x5fb609b3016df269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df262 expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.387770:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc000/0x5fb609b3016df269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df262 expref: 15 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.387780:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc000/0x5fb609b3016df269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df262 expref: 15 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.387789:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc000, rc 0) 00000100:00100000:1.0:1783074091.387832:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723522816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.387838:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783074091.388004:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.388016:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.388026:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.388038:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783074091.388042:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.388049:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.388055:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783074091.388056:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c6b72800 from 7 10000000:01000000:0.0:1783074091.388058:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783074091.388070:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.388077:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.388101:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.388117:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.388140:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.388166:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.388222:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723522944 00000100:00100000:1.0:1783074091.388226:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723522944 00000100:00100000:1.0:1783074091.388255:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783074091.388262:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723522944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074091.388269:0:88944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074091.388277:0:88944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd400/0x5fb609b3016df277 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df270 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.388290:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd400/0x5fb609b3016df277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df270 expref: 16 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.388298:0:88944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd400/0x5fb609b3016df277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df270 expref: 16 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.388304:0:88944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd400, rc 0) 00000100:00100000:1.0:1783074091.388466:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723522944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.388481:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783074091.388484:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723522944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.388498:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.388505:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.388550:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.388573:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.388598:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e000 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.389144:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523072 00000100:00100000:2.0:1783074091.389149:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523072 00000100:00100000:2.0:1783074091.389184:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783074091.389191:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723523072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.389294:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723523072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.389302:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783074091.389350:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.389378:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.389424:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.389446:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c2f1e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.389460:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523200 00000100:00100000:1.0:1783074091.389465:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523200 00000100:00100000:1.0:1783074091.389551:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783074091.389560:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723523200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.389647:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723523200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.389655:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783074091.389736:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074091.390917:0:89050:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783074091.390982:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783074091.391012:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783074091.391021:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.391031:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074091.391038:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783074091.391041:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 52 10000000:01000000:2.0:1783074091.391043:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783074091.391072:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.391081:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.391090:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.391105:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.391138:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.391181:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523328 00000100:00100000:2.0:1783074091.391184:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.391186:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523328 00000100:00100000:0.0:1783074091.391225:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783074091.391232:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723523328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.391241:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074091.391256:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0868200/0x5fb609b3016df285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df27e expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.391275:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0868200/0x5fb609b3016df285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df27e expref: 17 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.391284:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0868200/0x5fb609b3016df285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df27e expref: 17 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.391292:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868200, rc 0) 00000100:00100000:0.0:1783074091.391341:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723523328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.391348:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783074091.391406:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.391419:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.391428:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.391471:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.391509:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.391528:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.391542:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523456 00000100:00100000:0.0:1783074091.391547:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523456 00000100:00100000:0.0:1783074091.391632:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783074091.391640:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723523456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.391734:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723523456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.391741:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783074091.392022:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.392049:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.392085:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074091.392140:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c86540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.392184:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523584 00000100:00100000:2.0:1783074091.392188:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523584 00000100:00100000:2.0:1783074091.392216:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783074091.392222:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723523584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.392290:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723523584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.392300:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783074091.392377:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074091.393663:0:89051:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783074091.393736:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783074091.393759:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074091.393767:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.393776:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074091.393784:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783074091.393786:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783074091.393789:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074091.393809:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.393817:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.393826:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.393840:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.393873:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.393907:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e035a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.393937:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523712 00000100:00100000:1.0:1783074091.393941:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523712 00000100:00100000:1.0:1783074091.393969:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783074091.393974:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c22ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723523712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074091.393981:0:88943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074091.393989:0:88943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc400/0x5fb609b3016df293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df28c expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.394004:0:88943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc400/0x5fb609b3016df293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df28c expref: 18 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.394011:0:88943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc400/0x5fb609b3016df293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df28c expref: 18 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.394017:0:88943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc400, rc 0) 00000100:00100000:1.0:1783074091.394047:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c22ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723523712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.394052:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783074091.394237:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.394248:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.394268:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.394308:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.394360:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.394379:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e035a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.394413:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523840 00000100:00100000:0.0:1783074091.394418:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523840 00000100:00100000:0.0:1783074091.394450:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783074091.394458:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c22ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723523840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.394574:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c22ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723523840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.394581:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783074091.396660:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.396706:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.396769:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.396831:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723523968 00000100:00100000:3.0:1783074091.396838:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.396843:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723523968 00000100:00100000:0.0:1783074091.396897:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783074091.396906:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c496e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723523968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.397544:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c496e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723523968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 638us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.397554:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783074091.397570:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723523968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074091.398965:0:89052:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783074091.399050:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783074091.399082:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783074091.399093:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.399103:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074091.399112:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783074091.399115:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49f9000 from 7 10000000:01000000:2.0:1783074091.399117:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074091.399144:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.399152:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.399161:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.399178:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.399219:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.399264:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e035a240 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.399269:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524096 00000100:00100000:3.0:1783074091.399276:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524096 00000100:00100000:3.0:1783074091.399328:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783074091.399338:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c496fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723524096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.399348:0:88947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074091.399361:0:88947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa53000/0x5fb609b3016df2a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df29a expref: -99 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.399426:0:88947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa53000/0x5fb609b3016df2a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df29a expref: 19 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.399438:0:88947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa53000/0x5fb609b3016df2a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df29a expref: 19 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.399446:0:88947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53000, rc 0) 00000100:00100000:3.0:1783074091.399504:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c496fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723524096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.399510:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783074091.399785:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.399799:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.399807:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074091.399852:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.399878:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.399904:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e035a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.400084:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524224 00000100:00100000:1.0:1783074091.400095:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524224 00000100:00100000:1.0:1783074091.400133:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783074091.400140:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723524224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.400249:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723524224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.400256:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783074091.400402:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.400437:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.400477:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074091.400506:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e035a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.400629:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524352 00000100:00100000:0.0:1783074091.400634:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524352 00000100:00100000:0.0:1783074091.400668:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783074091.400675:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723524352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.400771:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723524352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.400778:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783074091.400854:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074091.401777:0:89053:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783074091.401871:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783074091.401892:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783074091.401901:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.401910:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074091.401926:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783074091.401929:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 52 10000000:01000000:3.0:1783074091.401932:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074091.401955:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.401962:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.401971:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074091.401985:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.402018:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.402058:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524480 00000100:00100000:0.0:1783074091.402064:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524480 00000100:00100000:3.0:1783074091.402087:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.402106:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783074091.402115:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723524480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.402123:0:88944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074091.402133:0:88944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f0869200/0x5fb609b3016df2af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df2a8 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.402151:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f0869200/0x5fb609b3016df2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df2a8 expref: 20 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.402160:0:88944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f0869200/0x5fb609b3016df2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df2a8 expref: 20 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.402167:0:88944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869200, rc 0) 00000100:00100000:0.0:1783074091.402209:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723524480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.402215:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783074091.402273:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.402285:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.402292:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074091.402384:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.402421:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074091.402436:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524608 00000100:00100000:1.0:1783074091.402441:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524608 00000100:00100000:3.0:1783074091.402457:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.402482:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783074091.402491:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723524608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.402589:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723524608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.402597:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783074091.402672:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.402696:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.402730:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074091.402783:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.402812:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524736 00000100:00100000:0.0:1783074091.402815:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524736 00000100:00100000:0.0:1783074091.402844:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783074091.402850:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723524736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.402950:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723524736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.402956:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783074091.403005:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074091.404372:0:89054:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783074091.405406:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783074091.405433:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074091.405443:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.405453:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.405463:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783074091.405465:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783074091.405468:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783074091.405508:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.405515:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.405525:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.405557:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.405607:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.405647:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c2ab1840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.405778:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524864 00000100:00100000:1.0:1783074091.405785:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524864 00000100:00100000:1.0:1783074091.405833:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783074091.405843:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723524864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074091.405860:0:88947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074091.405873:0:88947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bce00/0x5fb609b3016df2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df2b6 expref: -99 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.405895:0:88947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bce00/0x5fb609b3016df2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df2b6 expref: 21 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.405906:0:88947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bce00/0x5fb609b3016df2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df2b6 expref: 21 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.405926:0:88947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bce00, rc 0) 00000100:00100000:1.0:1783074091.405966:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723524864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.405973:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783074091.405999:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.406013:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.406022:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.406072:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.406097:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.406150:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c2ab1840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.406180:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723524992 00000100:00100000:2.0:1783074091.406185:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723524992 00000100:00100000:2.0:1783074091.406243:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783074091.406253:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723524992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.406430:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723524992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.406437:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783074091.406512:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723524992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.406540:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.406578:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074091.410186:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.410239:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525120 00000100:00100000:0.0:1783074091.410247:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525120 00000100:00100000:0.0:1783074091.410299:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783074091.410335:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723525120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.411014:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723525120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 705us (4433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.411022:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783074091.411095:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074091.412166:0:89055:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783074091.412483:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783074091.412611:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783074091.412622:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.412633:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074091.412641:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783074091.412644:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f4a91000 from 7 10000000:01000000:3.0:1783074091.412646:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074091.412679:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.412687:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.412697:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074091.412728:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.412772:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074091.413117:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654600 going to sleep for 11 seconds 00000100:00100000:1.0:1783074091.413244:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525248 00000100:00100000:1.0:1783074091.413250:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525248 00000100:00100000:1.0:1783074091.413342:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783074091.413351:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723525248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074091.413363:0:88947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074091.413375:0:88947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd800/0x5fb609b3016df2cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df2c4 expref: -99 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.413409:0:88947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd800/0x5fb609b3016df2cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df2c4 expref: 22 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.413420:0:88947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd800/0x5fb609b3016df2cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df2c4 expref: 22 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.413428:0:88947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd800, rc 0) 00000100:00100000:1.0:1783074091.413473:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723525248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.413480:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783074091.413557:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.413570:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.413579:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074091.413629:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.413654:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074091.413877:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.413938:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525376 00000100:00100000:2.0:1783074091.413942:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525376 00000100:00100000:2.0:1783074091.413994:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783074091.414001:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723525376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074091.414108:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723525376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.414115:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783074091.414125:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.414150:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.414187:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.414199:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525504 00000100:00100000:0.0:1783074091.414203:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525504 00000100:00100000:3.0:1783074091.414212:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074091.414261:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783074091.414272:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723525504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.414349:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723525504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.414360:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783074091.414433:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074091.415282:0:89056:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074091.415726:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074091.415748:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074091.415756:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.415765:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.415774:0:6527:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783074091.415776:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074091.415779:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783074091.415803:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.415811:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.415818:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.415832:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.415864:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.415922:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074091.415962:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525632 00000100:00100000:2.0:1783074091.415968:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525632 00000100:00100000:2.0:1783074091.416036:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783074091.416045:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723525632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.416054:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074091.416066:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086d600/0x5fb609b3016df2d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df2d2 expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.416083:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086d600/0x5fb609b3016df2d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df2d2 expref: 23 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.416092:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086d600/0x5fb609b3016df2d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df2d2 expref: 23 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.416100:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086d600, rc 0) 00000100:00100000:2.0:1783074091.416139:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723525632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.416146:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783074091.416204:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.416215:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.416223:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.416245:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783074091.416249:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.416255:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074091.416262:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783074091.416263:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074091.416265:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783074091.416278:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.416284:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.416291:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.416302:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.416357:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.416479:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.416608:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525760 00000100:00100000:3.0:1783074091.416612:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525760 00000100:00100000:3.0:1783074091.416676:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783074091.416683:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723525760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.416690:0:88944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074091.416698:0:88944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa52a00/0x5fb609b3016df2e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df2e0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.416721:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa52a00/0x5fb609b3016df2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df2e0 expref: 24 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.416728:0:88944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa52a00/0x5fb609b3016df2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df2e0 expref: 24 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.416735:0:88944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52a00, rc 0) 00000100:00100000:3.0:1783074091.416784:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723525760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.416791:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783074091.416852:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074091.416864:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074091.416871:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074091.416927:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.416949:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.416971:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074091.417006:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723525888 00000100:00100000:3.0:1783074091.417010:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723525888 00000100:00100000:3.0:1783074091.417071:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783074091.417078:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723525888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074091.417146:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723525888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (196us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783074091.417153:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783074091.417222:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723525888:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783074091.417253:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783074091.417260:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074091.417274:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074091.438492:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723526016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074091.438758:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.438774:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723526144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074091.438837:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526016 00000100:00100000:3.0:1783074091.438844:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526016 00000100:00100000:3.0:1783074091.438885:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:3.0:1783074091.438892:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723526016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074091.438913:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074091.438987:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723526016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.438993:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1783074091.439059:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074091.439101:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526144 00000100:00100000:0.0:1783074091.439105:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526144 00000100:00100000:0.0:1783074091.439129:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1783074091.439136:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723526144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074091.439146:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074091.439177:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723526144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.439183:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1783074091.439222:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723526144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074091.439255:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723526016:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074091.630631:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074091.886577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074091.886638:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043264 00000100:00100000:3.0:1783074091.886648:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043264 00000100:00100000:3.0:1783074091.886702:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:3.0:1783074091.886713:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:42363:x1869685708043264:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074091.886731:0:88943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074091.886748:0:88943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524faa52e00/0x5fb609b3016df2ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b020 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.886776:0:88943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524faa52e00/0x5fb609b3016df2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b020 expref: 6 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.886787:0:88943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524faa52e00/0x5fb609b3016df2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b020 expref: 6 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074091.886796:0:88943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52e00, rc 0) 00000100:00100000:3.0:1783074091.886857:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708043264:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074091.886886:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:3.0:1783074091.888478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074091.888573:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043392 00000100:00100000:2.0:1783074091.888579:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043392 00000100:00100000:2.0:1783074091.888621:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1783074091.888641:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e7c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708043392:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074091.888658:0:88945:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1783074091.888672:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074091.888676:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783074091.888679:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783074091.888681:0:88945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783074091.888684:0:88945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:1.0:1783074091.890141:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e7c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708043392:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 1485us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.890152:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1783074091.891554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074091.891646:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043520 00000100:00100000:2.0:1783074091.891654:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043520 00000100:00100000:2.0:1783074091.891703:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:2.0:1783074091.891712:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708043520:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.891727:0:88944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074091.891743:0:88944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086d800/0x5fb609b3016df2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b027 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.891768:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086d800/0x5fb609b3016df2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b027 expref: 7 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.891778:0:88944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086d800/0x5fb609b3016df2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b027 expref: 7 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.891787:0:88944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086d800, rc 0) 00000100:00100000:2.0:1783074091.891823:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708043520:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.891831:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1783074091.897148:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074091.897290:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043648 00000100:00100000:0.0:1783074091.897308:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043648 00000100:00100000:0.0:1783074091.897386:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1783074091.897398:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708043648:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.897556:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708043648:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 160us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.897564:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1783074091.899064:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074091.899331:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043776 00000100:00100000:1.0:1783074091.899338:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043776 00000100:00100000:1.0:1783074091.899393:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:1.0:1783074091.899402:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708043776:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.899567:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708043776:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 165us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.899575:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:1.0:1783074091.904864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074091.904974:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708043904 00000100:00100000:2.0:1783074091.904984:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708043904 00000100:00100000:2.0:1783074091.905141:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1783074091.905160:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708043904:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.905174:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074091.905190:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086c000/0x5fb609b3016df2fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b02e expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.905216:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c000/0x5fb609b3016df2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b02e expref: 9 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.905226:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086c000/0x5fb609b3016df2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b02e expref: 9 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.905235:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c000, rc 0) 00000100:00100000:2.0:1783074091.905293:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708043904:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 136us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.905300:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1783074091.907011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074091.907090:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044032 00000100:00100000:1.0:1783074091.907095:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044032 00000100:00100000:1.0:1783074091.907210:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1783074091.907218:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708044032:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074091.907336:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708044032:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074091.907352:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:3.0:1783074091.909250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074091.909936:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044160 00000100:00100000:0.0:1783074091.909945:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044160 00000100:00100000:0.0:1783074091.909994:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:0.0:1783074091.910003:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c467b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708044160:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.910332:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c467b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708044160:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 330us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074091.910340:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:1.0:1783074091.915122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074091.915236:0:88945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044288 00000100:00100000:2.0:1783074091.915246:0:88945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044288 00000100:00100000:2.0:1783074091.915295:0:88945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1783074091.915305:0:88945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c357b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708044288:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074091.915347:0:88945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074091.915363:0:88945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086da00/0x5fb609b3016df303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b035 expref: -99 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.915402:0:88945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086da00/0x5fb609b3016df303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b035 expref: 10 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.915413:0:88945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086da00/0x5fb609b3016df303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b035 expref: 10 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074091.915434:0:88945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086da00, rc 0) 00000100:00100000:2.0:1783074091.915486:0:88945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c357b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708044288:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074091.915494:0:88945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:1.0:1783074091.918272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074091.918370:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044416 00000100:00100000:0.0:1783074091.918389:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044416 00000100:00100000:0.0:1783074091.918480:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:0.0:1783074091.918490:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708044416:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074091.918589:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708044416:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 101us (323us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783074091.918597:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00010000:00010000:0.0:1783074092.655537:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783074092.690619:0:89220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1783074093.235848:0:89272:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783074093.236090:0:89272:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1783074093.672836:0:89324:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074093.673033:0:89324:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783074093.680008:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074094.702581:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074095.534831:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074095.534838:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074095.534841:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074095.534853:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074095.534879:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f469b480 x1869685723526400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074095.534917:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074095.534920:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074095.534923:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074095.534928:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074095.534934:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723526400:0@lo:38:kworker.0 00000100:00100000:3.0:1783074095.534941:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4699500 x1869685723526656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074095.534969:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074095.534973:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074095.534975:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074095.534979:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074095.534994:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f469a680 x1869685723526912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074095.535001:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074095.535028:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723526656:0@lo:38:kworker.0 00000100:00100000:0.0:1783074095.535044:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074095.535064:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723526528:0@lo:400:kworker.0 00000100:00100000:0.0:1783074095.535088:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074095.535104:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074095.535108:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783074095.535109:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:3.0:1783074095.535111:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783074095.535117:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723526272:0@lo:400:kworker.0 00000100:00080000:3.0:1783074095.535129:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074095.535145:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f469b100 x1869685723527296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074095.535148:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074095.535184:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:0.0:1783074095.535186:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723527168:0@lo:400:kworker.0 00000100:00080000:3.0:1783074095.535190:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074095.535195:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074095.535200:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9523c4e7a800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074095.535214:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4698380 x1869685723527808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074095.535217:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074095.535237:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723527424:0@lo:400:kworker.0 00000100:00100000:0.0:1783074095.535261:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074095.535272:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526400 00000100:00100000:3.0:1783074095.535279:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526400 00000100:00100000:0.0:1783074095.535291:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723526912:0@lo:38:kworker.0 00000100:00100000:3.0:1783074095.535338:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526656 00000100:00100000:3.0:1783074095.535342:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526656 00000100:00100000:0.0:1783074095.535347:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074095.535365:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526528 00000100:00100000:0.0:1783074095.535367:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723527296:0@lo:38:kworker.0 00000100:00100000:3.0:1783074095.535369:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526528 00000100:00100000:0.0:1783074095.535396:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074095.535409:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527296 00000100:00100000:3.0:1783074095.535414:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527296 00000100:00100000:0.0:1783074095.535415:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723527808:0@lo:38:kworker.0 00000100:00100000:3.0:1783074095.535433:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1783074095.535443:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723526528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074095.535449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074095.535514:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074095.535515:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723526528:12345-0@lo:400:kworker.0 Request processed in 75us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074095.535523:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1783074095.535532:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527808 00000100:00100000:0.0:1783074095.535537:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527808 00000100:00100000:3.0:1783074095.535546:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1783074095.535551:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723526400:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074095.535562:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1783074095.535570:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723526656:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783074095.535571:0:66200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2934 last 0 00000100:00100000:2.0:1783074095.535576:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1783074095.535586:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723527296:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783074095.535595:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2934 last 0 00000020:00000080:3.0:1783074095.535602:0:66200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016df30a 00010000:00080000:2.0:1783074095.535607:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2934 last 0 00000004:00100000:3.0:1783074095.535615:0:66200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:0.0:1783074095.535640:0:67186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb609b3016df311 00000020:00000080:2.0:1783074095.535647:0:68632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb609b3016df318 00000004:00100000:0.0:1783074095.535653:0:67186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:2.0:1783074095.535658:0:68632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783074095.535688:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9523c6946000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783074095.535689:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074095.535738:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869685723526656:12345-0@lo:38:kworker.0 Request processed in 168us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.535745:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869685723527296:12345-0@lo:38:kworker.0 Request processed in 156us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.535750:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1783074095.535760:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1783074095.535780:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1783074095.535785:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723527808:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783074095.535799:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2934 last 0 00000100:00100000:2.0:1783074095.535801:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527424 00000100:00100000:2.0:1783074095.535806:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527424 00000020:00000080:0.0:1783074095.535836:0:67186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb609b3016df31f 00000100:00100000:2.0:1783074095.535839:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526912 00000100:00100000:2.0:1783074095.535844:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526912 00000004:00100000:0.0:1783074095.535844:0:67186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783074095.535868:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630 00000100:00080000:0.0:1783074095.535869:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074095.535880:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723527424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074095.535902:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723527808:12345-0@lo:38:kworker.0 Request processed in 114us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.535910:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1783074095.535934:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527168 00000100:00100000:0.0:1783074095.535938:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527168 00000100:00100000:2.0:1783074095.535969:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723527424:12345-0@lo:400:kworker.0 Request processed in 90us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.535975:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1783074095.535981:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630 00000100:00100000:0.0:1783074095.535985:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723527168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536012:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631 00000100:00100000:2.0:1783074095.536018:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723526912:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074095.536022:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723527168:12345-0@lo:400:kworker.0 Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.536029:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00010000:00080000:2.0:1783074095.536037:0:8454:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9524c6e2c800, cookie 0x5fb609b3016df174 00010000:00080000:2.0:1783074095.536043:0:8454:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9524c6e2c800 cur 2934 last 1783074090 00000100:00080000:0.0:1783074095.536049:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00100000:2.0:1783074095.536054:0:8454:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783074095.536072:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9523c6943000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1783074095.536074:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f469b100 x1869685723527296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.536090:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00100000:2.0:1783074095.536114:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723526912:12345-0@lo:38:kworker.0 Request processed in 95us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.536121:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631 00000100:00100000:2.0:1783074095.536142:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723527040:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536168:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.536191:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723527680:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536215:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.536236:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783074095.536244:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723526784:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536277:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.536295:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723527552:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536349:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.536380:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527040 00000100:00100000:2.0:1783074095.536384:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527040 00000100:00100000:2.0:1783074095.536414:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527680 00000100:00100000:2.0:1783074095.536417:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527680 00000100:00100000:2.0:1783074095.536433:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527552 00000100:00100000:2.0:1783074095.536435:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527552 00000100:00100000:2.0:1783074095.536452:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1783074095.536458:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723527040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536507:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723527040:12345-0@lo:400:kworker.0 Request processed in 47us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.536514:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1783074095.536530:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00080000:3.0:1783074095.536533:0:66200:0:(import.c:65:import_set_state_nolock()) ffff9524fc200800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074095.536539:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723527680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.536657:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723527680:12345-0@lo:400:kworker.0 Request processed in 121us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074095.536666:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723526400:12345-0@lo:38:kworker.0 Request processed in 1110us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.536666:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1783074095.536679:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1783074095.536687:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:2.0:1783074095.536697:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723527552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074095.536699:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526784 00000100:00100000:3.0:1783074095.536704:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526784 00000100:00100000:2.0:1783074095.536736:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723527552:12345-0@lo:400:kworker.0 Request processed in 40us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074095.536742:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1783074095.536748:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1783074095.536753:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723526784:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074095.536786:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074095.536791:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074095.536794:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074095.536801:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723526784:12345-0@lo:400:kworker.0 Request processed in 49us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074095.536815:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1783074095.536861:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723527936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074095.536903:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723526784:0@lo:400:kworker.0 00000100:00080000:0.0:1783074095.537810:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9524f469b100 x1869685723527296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074120 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.537820:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074095.537824:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074095.537828:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074095.537834:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723527296:0@lo:38:kworker.0 00000100:00100000:1.0:1783074095.537959:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074095.538029:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723527424:0@lo:400:kworker.0 00000100:00100000:3.0:1783074095.538061:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723527168:0@lo:400:kworker.0 00000100:00100000:3.0:1783074095.538130:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723526528:0@lo:400:kworker.0 00010000:00080000:0.0:1783074095.538187:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f4698380 x1869685723527808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.538219:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1783074095.538225:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783074095.538230:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783074095.538232:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074095.538237:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723527808:0@lo:38:kworker.0 00010000:00080000:0.0:1783074095.538253:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f4699500 x1869685723526656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.538262:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00100000:2.0:1783074095.538940:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723527552:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.538978:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723527040:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.538987:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723527680:0@lo:400:kworker.0 00000100:00100000:3.0:1783074095.539540:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723527936 00000100:00100000:2.0:1783074095.539541:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723526272 00000100:00100000:3.0:1783074095.539548:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723527936 00000100:00100000:2.0:1783074095.539549:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723526272 00000100:00100000:3.0:1783074095.539596:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3632 00000100:00100000:2.0:1783074095.539601:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783074095.539609:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723527936:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074095.539613:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723526272:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1783074095.539643:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00010000:00080000:1.0:1783074095.540138:0:88970:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783074095.540144:0:88970:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:1.0:1783074095.540149:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.540153:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:1.0:1783074095.540157:0:88970:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:1.0:1783074095.540159:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.540169:0:88970:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708037632 t107374182407 from 192.168.204.26@tcp req@ffff9524df769f80 x1869685708037632/t0(107374182407) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:416/0 lens 528/0 e 0 to 0 dl 1783074101 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.540385:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9524f4699500 x1869685723526656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074120 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.540395:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074095.540398:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074095.540408:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783074095.540413:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723526272:12345-0@lo:400:kworker.0 Request processed in 802us (5264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.540415:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723526656:0@lo:38:kworker.0 00000100:00100000:3.0:1783074095.540422:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723527936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 816us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.540427:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783074095.540429:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3632 00010000:00080000:0.0:1783074095.540443:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f469b480 x1869685723526400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.540456:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:3.0:1783074095.540485:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723526272:0@lo:400:kworker.0 00000100:00100000:2.0:1783074095.540544:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723527936:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783074095.541278:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9524f469b480 x1869685723526400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074120 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074095.541287:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074095.541291:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074095.541295:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074095.541300:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723526400:0@lo:38:kworker.0 00000001:00100000:3.0:1783074095.541365:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:3.0:1783074095.541370:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524d2ca4000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000100:00080000:0.0:1783074095.541381:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000001:00100000:3.0:1783074095.541387:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1783074095.541390:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783074095.541396:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783074095.541398:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:0.0:1783074095.541403:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9524f0d24800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:0.0:1783074095.541406:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000080:2.0:1783074095.541465:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca4000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0000 00000020:00000080:2.0:1783074095.541511:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c4800 for lustre-OST0000 00000001:00100000:2.0:1783074095.541795:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783074095.541862:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723526912:0@lo:38:kworker.0 00010000:00080000:2.0:1783074095.541881:0:89337:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1783074095.541886:0:89337:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1783074095.541892:0:89337:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1783074095.542383:0:89337:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000004:00080000:3.0:1783074095.544788:0:88970:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4572us 00000100:00100000:3.0:1783074095.544816:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723528064:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783074095.544880:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.545166:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528064 00000100:00100000:2.0:1783074095.545173:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528064 00000100:00100000:2.0:1783074095.545221:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633 00000100:00100000:2.0:1783074095.545229:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723528064:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783074095.545247:0:8453:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524f469a680 x1869685723528064/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:421/0 lens 224/0 e 0 to 0 dl 1783074106 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074095.545258:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723528064:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 30us (379us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074095.545265:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633 00000001:00100000:2.0:1783074095.548364:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:2.0:1783074095.548372:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524ee2c5800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:2.0:1783074095.548396:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074095.548496:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c5800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0001 00000020:00000080:0.0:1783074095.548544:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c0800 for lustre-OST0001 00010000:00010000:0.0:1783074095.551952:0:88970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.551967:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.551977:0:88970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.551984:0:88970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.551988:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.551992:0:88970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552348:0:88970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552356:0:88970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552370:0:88970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552375:0:88970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074095.552380:0:88970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552387:0:88970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552399:0:88970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc2ff000) 00010000:00010000:0.0:1783074095.552403:0:88970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074095.552407:0:88970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552413:0:88970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016df326 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074095.552431:0:88970:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b3b1b3f reply state 00000000caa504e4 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552441:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.552447:0:88970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ffd00) 00010000:00010000:0.0:1783074095.552450:0:88970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074095.552453:0:88970:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074095.552553:0:88970:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1783074095.552571:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074095.552574:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:0.0:1783074095.552584:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074095.552586:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000100:00100000:3.0:1783074095.558608:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074095.558710:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708038144 00000100:00100000:0.0:1783074095.558719:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708038144 00000100:00100000:0.0:1783074095.558780:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1145 00000100:00100000:0.0:1783074095.558791:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708038144:12345-192.168.204.26@tcp:36:rm.0 00010000:00080000:0.0:1783074095.558810:0:66200:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:0.0:1783074095.558829:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708038144:12345-192.168.204.26@tcp:36:rm.0 Request processed in 40us (231us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074095.558835:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1145 00000020:00080000:3.0:1783074095.558877:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.558881:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:3.0:1783074095.558894:0:88970:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:3.0:1783074095.558897:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.558905:0:88970:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708038144 t107374182408 from 192.168.204.26@tcp req@ffff9524f4698000 x1869685708038144/t0(107374182408) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 512/0 e 0 to 0 dl 1783074106 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783074095.558987:0:88970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559002:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559014:0:88970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559025:0:88970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559033:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559039:0:88970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559122:0:88970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559129:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559135:0:88970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559555:0:88970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559567:0:88970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559575:0:88970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559580:0:88970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074095.559584:0:88970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559591:0:88970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559602:0:88970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:3.0:1783074095.559606:0:88970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783074095.559610:0:88970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559616:0:88970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016df342 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559636:0:88970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559642:0:88970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559648:0:88970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559653:0:88970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074095.559661:0:88970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559668:0:88970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559675:0:88970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f44ee800) 00010000:00010000:3.0:1783074095.559678:0:88970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074095.559680:0:88970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559686:0:88970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016df334 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074095.559697:0:88970:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000247751b7 reply state 00000000d8739270 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559706:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.559712:0:88970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524fc2ffd00) 00010000:00010000:3.0:1783074095.559714:0:88970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074095.559717:0:88970:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783074095.559822:0:88970:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783074095.559837:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.559840:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:3.0:1783074095.559843:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.559845:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:3.0:1783074095.561636:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.561676:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039552 00000100:00100000:2.0:1783074095.561690:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039552 00000100:00100000:2.0:1783074095.561725:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1146 00000100:00100000:2.0:1783074095.561731:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708039552:12345-192.168.204.26@tcp:36:dd.0 00010000:00080000:2.0:1783074095.561743:0:68632:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:2.0:1783074095.561756:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708039552:12345-192.168.204.26@tcp:36:dd.0 Request processed in 27us (127us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074095.561761:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1146 00000020:00080000:3.0:1783074095.561778:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.561782:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:3.0:1783074095.561792:0:88970:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182406) 00000020:00080000:3.0:1783074095.561796:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.561804:0:88970:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708039552 t107374182410 from 192.168.204.26@tcp req@ffff9524f4699180 x1869685708039552/t0(107374182410) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 488/0 e 0 to 0 dl 1783074106 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783074095.561982:0:88970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.562057:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.562069:0:88970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074095.562156:0:88970:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3a472d9 reply state 00000000c2d4c4e5 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.562168:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.562174:0:88970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524f44ee000) 00010000:00010000:3.0:1783074095.562177:0:88970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074095.562179:0:88970:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783074095.562348:0:88970:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783074095.562364:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.562367:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:3.0:1783074095.562370:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074095.562372:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:1.0:1783074095.563814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074095.563875:0:66214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708039808 00000100:00100000:3.0:1783074095.563880:0:66214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708039808 00000100:00100000:3.0:1783074095.563921:0:66214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1783074095.563927:0:66214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2401:x1869685708039808:12345-192.168.204.26@tcp:10:dd.0 00010000:00080000:3.0:1783074095.563936:0:66214:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:3.0:1783074095.563948:0:66214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:2401:x1869685708039808:12345-192.168.204.26@tcp:10:dd.0 Request processed in 22us (137us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074095.563953:0:66214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000020:00080000:1.0:1783074095.563987:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.563990:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:1.0:1783074095.564002:0:88970:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:1.0:1783074095.564004:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.564010:0:88970:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708039808 t107374182411 from 192.168.204.26@tcp req@ffff9523caed1880 x1869685708039808/t0(107374182411) o10->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 440/0 e 0 to 0 dl 1783074106 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074095.564305:0:88970:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783074095.564353:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.564355:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:1.0:1783074095.564364:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.564366:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000100:00100000:0.0:1783074095.568513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.568871:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044672 00000100:00100000:2.0:1783074095.568881:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044672 00000100:00100000:2.0:1783074095.568938:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1147 00000100:00100000:2.0:1783074095.568947:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708044672:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1783074095.568969:0:67186:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524df76aa00 x1869685708044672/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 328/0 e 0 to 0 dl 1783074106 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074095.569002:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708044672:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 56us (498us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074095.569009:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1147 00000020:00080000:1.0:1783074095.569068:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.569073:0:88970:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:1.0:1783074095.569077:0:88970:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783074095.569080:0:88970:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074095.569087:0:88970:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074095.569090:0:88970:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074095.569098:0:88970:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9524df76aa00 x1869685708044672/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 328/0 e 0 to 0 dl 1783074106 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783074095.569116:0:88970:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074095.569141:0:88970:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b012 expref: -99 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.569166:0:88970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 14 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.569196:0:88970:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 14 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.569206:0:88970:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bca00, rc 0) 00010000:00080000:1.0:1783074095.569269:0:88970:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1783074095.569282:0:88970:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1783074095.571516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074095.571624:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044800 00000100:00100000:1.0:1783074095.571630:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044800 00000100:00100000:1.0:1783074095.571683:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 786 00000100:00100000:1.0:1783074095.571693:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:2401:x1869685708044800:12345-192.168.204.26@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1783074095.571709:0:66202:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524f4699f80 x1869685708044800/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 224/0 e 0 to 0 dl 1783074106 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074095.571758:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:2401:x1869685708044800:12345-192.168.204.26@tcp:400:ptlrpcd_rcv.0 Request processed in 66us (246us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074095.571767:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 786 00010000:00080000:0.0:1783074095.571775:0:88970:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783074095.571890:0:88970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:2.0:1783074095.573628:0:88938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:2.0:1783074095.573636:0:88938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783074095.574259:0:88938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00010000:00010000:0.0:1783074095.574274:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574286:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574379:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574387:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074095.574392:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574400:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574430:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574436:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869c00/0x5fb609b3016df32d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574452:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574458:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574464:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574468:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074095.574471:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574477:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574484:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574489:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016df33b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574515:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574530:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574536:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574540:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074095.574544:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574549:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574557:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.574563:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016df349 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88970 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783074095.574606:0:88970:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1783074095.574642:0:88970:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1783074095.574656:0:88970:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9524f469a680 x1869685723528064/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:421/0 lens 224/0 e 0 to 0 dl 1783074106 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783074095.574760:0:88970:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.26@tcp: req@ffff9524f4699f80 x1869685708044800/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 224/0 e 0 to 0 dl 1783074106 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074095.574792:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1783074095.574810:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9524c8ffc000 x1869685723528064/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074111 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074095.574821:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9524c8ffc000 x1869685723528064/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074111 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074095.574823:0:88970:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1783074095.574834:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783074095.574854:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1783074095.574860:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004d630abb): req@ffff9523c3bf3b80 x1869685723511552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074092 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074095.574879:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723528064:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783074095.574983:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074095.575085:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723528192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074095.575113:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.575182:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723511552 00000100:00100000:2.0:1783074095.575188:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723511552 00000100:00100000:2.0:1783074095.575224:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528192 00000100:00100000:2.0:1783074095.575227:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528192 00000100:00100000:2.0:1783074095.575246:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634 00000100:00100000:2.0:1783074095.575254:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723511552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783074095.575277:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444753408 avail 1298513920 00000100:00100000:2.0:1783074095.575347:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723511552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.575355:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634 00000100:00100000:2.0:1783074095.575372:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635 00000100:00100000:2.0:1783074095.575379:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723528192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783074095.575389:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444753408 avail 1298513920 00000100:00100000:2.0:1783074095.575426:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723528192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.575432:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635 00000100:00100000:0.0:1783074095.575500:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723528192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074095.575726:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c3bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723511552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074095.577157:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.577194:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.577220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.577241:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708041088 00000100:00100000:2.0:1783074095.577247:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708041088 00000100:00100000:2.0:1783074095.577274:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044544 00000100:00100000:2.0:1783074095.577277:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044544 00000100:00100000:2.0:1783074095.577301:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1148 00000100:00100000:2.0:1783074095.577334:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:0:x1869685708041088:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:2.0:1783074095.577428:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:0:x1869685708041088:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 120us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.577436:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1148 00000100:00100000:2.0:1783074095.577453:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1149 00000100:00100000:0.0:1783074095.577454:0:66215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708040960 00000100:00100000:0.0:1783074095.577460:0:66215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708040960 00000100:00100000:2.0:1783074095.577462:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:68126:x1869685708044544:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074095.577473:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1783074095.577487:0:66215:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9524c8fff100 x1869685708040960/t0(0) o4->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 496/0 e 0 to 0 dl 1783074106 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1783074095.577493:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b03c expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.577560:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016df35e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1783074095.577570:0:66215:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9524c8fff100 with x1869685708040960 00002000:00010000:0.0:1783074095.577580:0:66215:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 9 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.577589:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016df35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.577602:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016df35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074095.577609:0:66215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1783074095.577625:0:66215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:0:x1869685708040960:12345-192.168.204.26@tcp:4:dd.0 00000004:00200000:2.0:1783074095.577714:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074095.577719:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074095.577752:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016df35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.577775:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b03c expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.577791:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016df35e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b03c expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.577800:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0ae5f00) 00010000:00010000:2.0:1783074095.577803:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074095.577807:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c400, rc 0) 00000100:00100000:2.0:1783074095.577840:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:68126:x1869685708044544:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 380us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.577848:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1149 00000100:00100000:0.0:1783074095.578496:0:66215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:0:x1869685708040960:12345-192.168.204.26@tcp:4:dd.0 Request processed in 871us (1304us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1783074095.578516:0:66215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00002000:00100000:0.0:1783074095.578524:0:66215:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9524c8fff100 x1869685708040960/t111669149697(0) o4->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:421/0 lens 496/448 e 0 to 0 dl 1783074106 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074095.578534:0:66215:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9524c8fff100 with x1869685708040960 00002000:00010000:0.0:1783074095.578540:0:66215:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 10 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074095.580688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.580751:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708044928 00000100:00100000:2.0:1783074095.580759:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708044928 00000100:00100000:2.0:1783074095.580818:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1150 00000100:00100000:2.0:1783074095.580827:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:68126:x1869685708044928:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074095.580854:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1444753408 avail 1298513920 00000100:00100000:2.0:1783074095.580922:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:68126:x1869685708044928:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.580931:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1150 00000100:00100000:2.0:1783074095.582615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074095.582667:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045056 00000100:00100000:3.0:1783074095.582674:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045056 00000100:00100000:3.0:1783074095.582729:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1151 00000100:00100000:3.0:1783074095.582750:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68126:x1869685708045056:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074095.582870:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:3.0:1783074095.582921:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68126:x1869685708045056:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 172us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074095.582928:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1151 00000100:00080000:2.0:1783074095.583077:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074095.585300:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.585420:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045184 00000100:00100000:2.0:1783074095.585428:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045184 00000100:00100000:2.0:1783074095.585468:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4897 00000100:00100000:2.0:1783074095.585475:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2401:x1869685708045184:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:2.0:1783074095.585506:0:26172:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2934 last 0 00000020:00000080:2.0:1783074095.585536:0:26172:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016df365 00002000:00100000:2.0:1783074095.585549:0:26172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9524d2ca4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783074095.585566:0:26172:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783074095.585640:0:26172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783074095.585666:0:26172:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074095.585728:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708045184:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 251us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.585735:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4897 00000100:00100000:3.0:1783074095.587480:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074095.587802:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045312 00000100:00100000:0.0:1783074095.587810:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045312 00000100:00100000:0.0:1783074095.587874:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1675 00000100:00100000:0.0:1783074095.587883:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68126:x1869685708045312:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074095.587906:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783074095.587921:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074095.587970:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68126:x1869685708045312:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 87us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.587977:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1675 00000100:00100000:3.0:1783074095.590483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.590538:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045440 00000100:00100000:2.0:1783074095.590546:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045440 00000100:00100000:2.0:1783074095.590581:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4898 00000100:00100000:2.0:1783074095.590587:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1869685708045440:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:2.0:1783074095.590623:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp t0 exp 0000000000000000 cur 2934 last 0 00000020:00000080:2.0:1783074095.590649:0:8445:0:(genops.c:1406:class_connect()) connect: client 0510a7c0-d9c1-4de9-a6c3-ede973deaaff, cookie 0x5fb609b3016df36c 00002000:00100000:2.0:1783074095.590661:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0510a7c0-d9c1-4de9-a6c3-ede973deaaff/ffff9524ee2c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783074095.590678:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783074095.590754:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783074095.590782:0:8445:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074095.590842:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708045440:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 253us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.590849:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4898 00000100:00100000:2.0:1783074095.593390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074095.594710:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045568 00000100:00100000:3.0:1783074095.594720:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045568 00000100:00080000:2.0:1783074095.594773:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074095.594780:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1676 00000100:00100000:3.0:1783074095.594789:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68126:x1869685708045568:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074095.594811:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074095.594878:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68126:x1869685708045568:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 90us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074095.594883:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1676 00000004:00000080:1.0:1783074095.596050:0:88970:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc7f73e10 00100000:10000000:1.0:1783074095.596061:0:88970:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1783074095.598801:0:88956:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:3.0:1783074095.598852:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88956:1869685723528320:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783074095.598922:0:88956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074095.598989:0:88956:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074095.599042:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528320 00000100:00100000:0.0:1783074095.599048:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528320 00000100:00100000:0.0:1783074095.599099:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899 00000100:00100000:0.0:1783074095.599108:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:88956:x1869685723528320:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783074095.599136:0:17659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -127 00002000:02000040:0.0:1783074095.599141:0:17659:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1825) 00000004:00080000:2.0:1783074095.599156:0:88958:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x4b0:0x0] 00000100:00100000:2.0:1783074095.599180:0:88958:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88958:1869685723528448:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783074095.599208:0:88958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.599235:0:88958:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074095.599964:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528448 00000100:00100000:1.0:1783074095.599970:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528448 00000100:00100000:1.0:1783074095.600007:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4900 00000100:00100000:1.0:1783074095.600017:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88958:x1869685723528448:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783074095.600036:0:26175:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -625 00002000:02000040:1.0:1783074095.600039:0:26175:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1201 to 0x2c0000401:1825) 00000100:00100000:3.0:1783074095.601417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074095.601564:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045696 00000100:00100000:2.0:1783074095.601571:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045696 00000100:00100000:2.0:1783074095.601617:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:2.0:1783074095.601626:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708045696:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074095.601690:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708045696:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 65us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074095.601698:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00002000:00010000:0.0:1783074095.606187:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.606200:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606218:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.606223:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.606231:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606247:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606259:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606267:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606300:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783074095.606432:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.606438:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606449:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.606453:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.606457:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606485:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606494:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606500:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606516:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074095.606527:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074095.606534:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606542:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074095.606547:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606556:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606571:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606578:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016df373 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606606:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074095.606609:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606615:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074095.606618:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606624:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606633:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606639:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016df37a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606649:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.606651:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.606653:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783074095.606702:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.606707:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606714:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.606724:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.606728:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606737:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606743:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606751:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606867:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.606870:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.606878:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.606887:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.606892:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.606909:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.606912:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.606922:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.606929:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606932:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.606938:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.606946:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.606948:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000321a593b/0x5fb609b3016df381 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606966:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.606975:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.606977:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.606980:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.606984:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.606993:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607020:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607030:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607035:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607044:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607048:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607057:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607063:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.607069:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607071:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607089:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.607094:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.607102:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607108:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c02fb5/0x5fb609b3016df388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607118:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607127:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607128:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607132:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607136:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607141:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607159:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607167:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607173:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607182:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607186:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607195:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607197:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.607209:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607214:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607237:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d756abd0/0x5fb609b3016df38f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607238:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.607245:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.607255:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607261:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607265:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607268:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607275:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607282:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607290:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607305:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607340:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607347:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607355:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607360:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607369:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607376:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.607382:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607383:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607405:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.607406:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf427fdd/0x5fb609b3016df396 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607410:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.607420:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607430:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607431:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607434:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607438:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607454:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607460:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607475:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607483:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607489:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607498:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607501:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607511:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.607521:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607527:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607545:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.607550:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.607552:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607555:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607573:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6eb5e18/0x5fb609b3016df39d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607577:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607593:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607597:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607602:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607602:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607604:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607630:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607638:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607644:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607652:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607657:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607666:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607670:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.607678:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607679:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607697:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.607701:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.607709:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607719:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059db4ba6/0x5fb609b3016df3a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607724:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607738:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607741:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607745:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607747:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607749:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607765:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607773:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607779:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607787:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607791:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607799:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607802:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.607812:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607816:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607825:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.607829:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b740ae/0x5fb609b3016df3ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607838:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.607845:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607848:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607852:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607857:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607862:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607869:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607876:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607890:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.607898:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.607904:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607913:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.607917:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607926:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.607929:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.607941:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607944:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607952:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.607961:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.607962:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac9df4ea/0x5fb609b3016df3b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607966:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.607984:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.607987:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607990:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.607994:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.607997:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608012:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608028:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608035:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608041:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608048:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608052:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608071:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.608073:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608081:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608089:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608091:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.608099:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.608107:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608109:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d0f19dc/0x5fb609b3016df3b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608130:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608137:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608140:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608141:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608143:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608153:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608168:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608175:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608180:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608189:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608193:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608202:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608205:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.608216:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608219:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608241:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.608247:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.608256:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608259:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b5f5ba/0x5fb609b3016df3c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608277:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608284:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608287:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608287:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608289:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608299:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608342:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608350:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608356:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608365:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608369:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608377:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608383:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.608389:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608391:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608413:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb5634a2/0x5fb609b3016df3c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608414:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.608421:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.608430:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608437:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608441:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608442:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608451:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608466:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608475:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608490:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608498:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608504:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608513:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608517:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608527:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608529:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.608540:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608545:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608550:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.608558:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.608561:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71f8a80/0x5fb609b3016df3ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608563:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608586:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608590:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608594:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608598:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608598:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608609:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608634:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608642:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608648:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608656:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608660:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608675:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.608687:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608688:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608708:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.608713:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.608714:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608718:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608733:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073cfc8be/0x5fb609b3016df3d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608738:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608753:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608756:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608760:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608764:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608764:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608782:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608789:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608795:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608803:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608807:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608815:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608820:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.608828:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608829:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608848:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.608864:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.608866:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083dc1367/0x5fb609b3016df3dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608870:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608888:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608890:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608894:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.608897:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.608900:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608910:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608925:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.608933:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.608939:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608947:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.608950:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608959:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.608964:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.608972:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608973:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.608995:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000894c505/0x5fb609b3016df3e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.608996:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.609003:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.609012:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609018:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609022:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609024:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609031:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609038:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609053:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609067:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.609075:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.609081:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609090:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.609094:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609102:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.609106:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.609118:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609121:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609132:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.609137:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c6a5d0e/0x5fb609b3016df3ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609138:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.609147:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609158:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609161:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609162:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609165:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609173:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609182:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609195:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.609203:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.609208:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609217:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.609220:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.609235:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.609240:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609242:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609253:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609260:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.609267:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4cf11cf/0x5fb609b3016df3f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609267:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.609275:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609288:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609289:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609292:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609297:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609304:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.609378:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609517:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609533:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.609555:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.609560:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609569:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.609573:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.609578:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.609583:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609586:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609604:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.609607:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609608:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.609618:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609632:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609636:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d0fe614/0x5fb609b3016df3f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609655:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609658:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609658:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609662:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609671:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609686:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.609694:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.609700:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609709:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.609713:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609722:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.609727:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.609735:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609735:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609758:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016df3ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609759:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.609767:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.609776:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609784:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609788:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609789:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609797:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609801:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609810:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609836:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.609845:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.609850:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609859:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.609863:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609872:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.609875:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.609885:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609890:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609896:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.609904:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.609906:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016df406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609910:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609927:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.609929:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609933:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.609936:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.609940:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609951:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.609968:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074095.610074:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1783074095.610078:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074095.610079:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610085:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610100:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074095.610105:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610105:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:2.0:1783074095.610112:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610118:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.610126:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610129:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610143:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610144:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016df40d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610167:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610177:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610180:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.610184:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.610189:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074095.610195:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074095.610197:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610206:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074095.610211:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610216:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.610218:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610236:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.610239:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074095.610243:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016df414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610248:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.610255:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.610258:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610259:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:2.0:1783074095.610260:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610265:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.610271:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610279:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610288:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610302:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610346:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.610377:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.610383:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.610386:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.610396:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610397:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.610405:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610408:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.610411:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.610419:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610432:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610434:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610455:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610459:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610465:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610473:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016df41b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610491:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.610494:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610497:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783074095.610505:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.610509:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610518:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610530:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610538:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.610541:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.610551:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610570:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.610572:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610574:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.610576:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.610580:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610582:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610593:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610603:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610611:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610626:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.610634:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.610640:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610648:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.610652:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610661:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.610667:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.610673:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610675:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610695:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016df429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610697:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.610703:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074095.610712:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610719:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.610723:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610724:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610726:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610747:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610755:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610771:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.610780:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.610785:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610804:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.610808:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.610810:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.610820:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610822:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610840:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:0.0:1783074095.610845:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.610848:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610851:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610868:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016df430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610872:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610888:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610892:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.610895:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.610899:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.610899:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.610921:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.610929:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074095.610930:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610936:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.610941:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610949:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.610949:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.610953:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.610953:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.610958:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610962:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.610973:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.610978:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.610978:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.610981:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.610993:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016df437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.610994:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611004:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611011:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611012:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611015:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611019:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783074095.611022:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bda00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611026:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611026:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611033:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611042:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611050:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016df43e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611061:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611068:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611070:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074095.611079:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.611085:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611093:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.611096:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.611100:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611109:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611117:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611134:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611147:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611154:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611158:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611165:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611168:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611175:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611182:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.611185:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611186:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611193:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016df44c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611194:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.611197:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.611201:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611205:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611206:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611208:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611208:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611216:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611223:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611236:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611242:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611246:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611252:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611256:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611268:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611270:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.611274:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611279:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611286:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.611287:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016df453 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611289:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.611294:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611299:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611300:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611302:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611302:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611349:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611357:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611383:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611389:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611392:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611399:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611402:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611409:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611421:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611421:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.611426:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611433:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.611436:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.611438:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016df45a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611450:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611452:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611453:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611507:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611518:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611537:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611544:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611560:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611578:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611582:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611589:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611592:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611596:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.611599:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611600:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611608:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.611611:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611611:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.611615:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611618:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016df461 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611624:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611630:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611631:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611632:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611637:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611639:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611660:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611666:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611670:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611677:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bcc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611680:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611688:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611694:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.611697:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611698:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611706:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016df468 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611706:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.611709:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.611713:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611718:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611719:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611721:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611721:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611728:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611736:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.611800:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611811:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611821:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611825:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611831:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611835:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611847:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.611851:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611854:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611859:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.611865:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611866:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.611870:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611872:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016df46f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611879:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611884:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611885:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611886:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611887:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611894:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611906:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.611912:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.611916:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611922:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.611925:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611933:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611942:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.611942:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.611947:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611954:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.611957:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.611959:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016df476 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611961:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611969:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.611971:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611972:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.611974:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.611977:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.611989:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612002:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.612008:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.612012:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612019:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.612022:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612029:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.612036:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.612039:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612040:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612047:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016df47d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612048:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.612051:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.612055:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612058:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.612060:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.612063:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612065:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.612070:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612077:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612095:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074095.612126:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.612131:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612143:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.612146:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.612150:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612159:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612167:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612175:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612188:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783074095.612195:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074095.612199:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612206:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.612209:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612217:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.612221:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.612224:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612227:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612231:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.612234:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df484 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612234:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.612238:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612246:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074095.612246:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612249:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612255:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39da00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.612258:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612263:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612265:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612271:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612279:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612283:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.612286:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f967f2/0x5fb609b3016df48b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612297:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.612300:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.612344:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.612348:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612355:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.612357:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.612360:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612368:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612374:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612380:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612405:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074095.612413:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074095.612416:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612422:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.612423:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.612427:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612427:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612437:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612437:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612446:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612454:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe466ef6/0x5fb609b3016df492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612465:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.612467:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.612474:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.612480:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.612516:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612525:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f429a65a/0x5fb609b3016df499 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612537:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.612541:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.612545:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.612546:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.612546:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.612548:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.612555:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612581:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.612587:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.612591:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612594:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612611:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612612:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.612623:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.612628:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612629:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.612638:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074095.612642:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612643:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612650:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.612651:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612654:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612660:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612663:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612675:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612682:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016df445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612684:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783074095.612687:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.612694:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612698:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.612704:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612706:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.612712:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39ca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074095.612718:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.612719:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.612724:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074095.612725:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612729:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612747:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612748:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612771:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612774:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612786:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612789:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee8ab82/0x5fb609b3016df4a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612807:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074095.612808:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.612812:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074095.612813:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.612815:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612817:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612822:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.612826:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612827:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612836:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612836:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612846:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612848:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074095.612849:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.612859:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016df4a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612862:0:17659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612869:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074095.612878:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074095.612878:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.612884:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612885:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.612887:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.612890:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.612893:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074095.612895:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612896:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39cc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.612903:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612910:0:17659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612916:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612923:0:17659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612930:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074095.612951:0:17659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612952:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7f32d2/0x5fb609b3016df4ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.612981:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074095.612983:0:17659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783074095.612986:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.612990:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613006:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.613010:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613018:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613027:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613035:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df4b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613049:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613051:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613053:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074095.613096:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.613102:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613104:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.613111:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613114:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.613118:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.613123:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613133:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613148:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613157:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613174:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.613191:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.613196:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613203:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.613207:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613215:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.613218:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.613224:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613227:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613232:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.613235:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de8bd34e/0x5fb609b3016df4bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613235:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.613240:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613250:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613250:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613253:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.613255:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613258:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613267:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613300:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074095.613356:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074095.613363:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.613372:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074095.613374:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39ce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074095.613381:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613382:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613401:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613403:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.613411:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.613421:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613427:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613432:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613449:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000047694f4/0x5fb609b3016df4c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613467:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.613469:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.613471:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613503:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613512:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613532:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074095.613560:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074095.613566:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613574:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074095.613578:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.613583:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074095.613591:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613593:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613612:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:2.0:1783074095.613615:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613627:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074095.613632:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072eebd04/0x5fb609b3016df4ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613635:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613655:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613657:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.613662:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613667:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613670:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613679:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613699:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074095.613716:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074095.613723:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613733:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c000 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:1.0:1783074095.613736:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074095.613737:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613749:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613761:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613770:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097d35621/0x5fb609b3016df4d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.613786:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.613789:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.613792:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613794:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613802:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.613804:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.613808:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613814:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613820:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613830:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783074095.613834:0:17659:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00010000:00010000:1.0:1783074095.613842:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.613864:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.613869:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613883:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.613886:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.613886:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.613891:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613895:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613898:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.613902:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.613906:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613907:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613915:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a242945/0x5fb609b3016df4d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613915:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613923:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613930:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.613932:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.613933:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.613936:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.613941:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783074095.613942:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:88956:x1869685723528320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14830us (15014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.613954:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899 00002000:00010000:1.0:1783074095.613974:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.613981:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.613995:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.613998:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.614002:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614011:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614020:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614027:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614047:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783074095.614078:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074095.614083:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.614084:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.614090:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614091:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.614095:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614097:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.614100:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.614103:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614104:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074095.614115:0:88956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88956:1869685723528320:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783074095.614115:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614120:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614130:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000151d5a66/0x5fb609b3016df4df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783074095.614136:0:88956:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x6a2:0x0] 00010000:00010000:1.0:1783074095.614137:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614143:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.614148:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614150:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614156:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39de00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.614159:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614166:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614174:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.614177:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614185:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a466694/0x5fb609b3016df4e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614199:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.614202:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.614213:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.614216:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39dc00 already unused, calling callback (ffffffffc0c63ce0) 00000100:00100000:2.0:1783074095.614219:0:88956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88956:1869685723528704:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783074095.614219:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614220:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614233:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614233:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.614236:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.614240:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614244:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614249:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614251:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086cf4fc9/0x5fb609b3016df4ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614257:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614263:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.614267:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074095.614268:0:88956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074095.614268:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614271:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074095.614285:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723528576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783074095.614294:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783074095.614296:0:88956:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074095.614353:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074095.614363:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074095.614369:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.614378:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074095.614381:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.614391:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.614395:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.614404:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.614407:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614416:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.614416:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:2.0:1783074095.614423:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007468560d/0x5fb609b3016df4f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614423:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.614433:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074095.614444:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.614447:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.614448:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.614457:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614465:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614473:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614492:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.614507:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.614512:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614520:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.614523:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.614529:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.614533:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614536:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614540:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.614546:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.614547:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614551:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614554:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b48a48df/0x5fb609b3016df4fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614560:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614566:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.614568:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.614568:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614569:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.614575:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614588:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074095.614625:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.614629:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614637:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.614640:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.614644:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614653:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614662:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614676:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614696:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1783074095.614719:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528704 00000100:00100000:0.0:1783074095.614726:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528704 00000100:00100000:0.0:1783074095.614767:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4901 00010000:00010000:3.0:1783074095.614768:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074095.614774:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074095.614779:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:88956:x1869685723528704:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1783074095.614790:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0030400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.614793:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614801:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614812:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783074095.614828:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00010000:00010000:3.0:1783074095.614830:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016df502 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614850:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783074095.614850:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074095.614854:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614856:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614862:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0031a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.614865:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.614866:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614869:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.614873:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614875:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614883:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614885:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614892:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614893:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016df509 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614901:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.614907:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.614909:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.614915:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074095.614968:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.614974:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.614990:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.614994:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.614998:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615009:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615010:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.615015:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615019:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615027:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615033:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0031e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.615036:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615038:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.615056:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615069:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615076:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016df510 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.615083:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.615087:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615089:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.615093:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615094:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.615099:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074095.615100:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0030000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.615103:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615104:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615114:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615114:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615125:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615132:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615135:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016df517 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615140:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615146:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.615147:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.615148:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.615151:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615157:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0030c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.615160:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615167:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615178:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615186:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016df51e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074095.615188:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.615193:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615197:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.615199:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.615200:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:3.0:1783074095.615201:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.615203:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.615207:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615208:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074095.615216:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615224:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615231:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615261:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074095.615341:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074095.615348:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615356:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=2934s v=(0 0) 00010000:00010000:1.0:1783074095.615359:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074095.615364:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615373:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074095.615381:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615386:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074095.615389:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615390:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615398:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0031400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074095.615402:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074095.615403:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615411:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615422:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615429:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016df525 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615443:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074095.615447:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615453:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074095.615456:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615463:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615487:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615495:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076d023e2/0x5fb609b3016df52c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074095.615513:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.615515:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.615517:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074095.615524:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074095.617408:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074095.617811:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:88956:x1869685723528704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3032us (3544us total) trans 4294968714 rc 0/0 00000100:00100000:0.0:1783074095.617825:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4901 00000100:00100000:0.0:1783074095.617867:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528576 00000100:00100000:0.0:1783074095.617872:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528576 00000100:00100000:2.0:1783074095.617904:0:88956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88956:1869685723528704:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783074095.617912:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000004:00080000:2.0:1783074095.617921:0:88956:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00000100:00100000:0.0:1783074095.617921:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723528576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783074095.617943:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074095.618039:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723528576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (3686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074095.618048:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00010000:00010000:0.0:1783074095.618079:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074095.618110:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723528576:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1783074095.619516:0:26175:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1200 00000100:00100000:1.0:1783074095.619580:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88958:x1869685723528448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19564us (20368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074095.619589:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4900 00000100:00100000:2.0:1783074095.619672:0:88958:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88958:1869685723528448:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783074095.619684:0:88958:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x4b0:0x0] 00000100:00100000:0.0:1783074095.619757:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723528832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074095.619795:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.619815:0:88958:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88958:1869685723528960:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783074095.619848:0:88958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074095.619878:0:88958:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074095.619921:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528960 00000100:00100000:0.0:1783074095.619926:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528960 00000100:00100000:1.0:1783074095.619938:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723528832 00000100:00100000:1.0:1783074095.619949:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723528832 00000100:00100000:0.0:1783074095.620017:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902 00000100:00100000:0.0:1783074095.620025:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:88958:x1869685723528960:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783074095.620047:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00002000:00080000:0.0:1783074095.620056:0:8444:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:1.0:1783074095.620058:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723528832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783074095.620073:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074095.620130:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723528832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074095.620140:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:1.0:1783074095.620197:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723528832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074095.621666:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:88958:x1869685723528960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1639us (1814us total) trans 4294968709 rc 0/0 00000100:00100000:0.0:1783074095.621674:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902 00000100:00100000:2.0:1783074095.621716:0:88958:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88958:1869685723528960:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783074095.621731:0:88958:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00010000:00010000:3.0:1783074095.726431:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074096.558496:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074096.558526:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723529088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074096.558614:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074096.558669:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529088 00000100:00100000:0.0:1783074096.558678:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529088 00000100:00100000:0.0:1783074096.558738:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1783074096.558748:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723529088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074096.558778:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074096.558828:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723529088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074096.558835:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:1.0:1783074096.558871:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723529088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074096.558976:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723529216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074096.559010:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074096.559099:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529216 00000100:00100000:2.0:1783074096.559104:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529216 00000100:00100000:2.0:1783074096.559134:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1783074096.559142:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723529216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074096.559158:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074096.559199:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723529216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074096.559206:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:1.0:1783074096.559230:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723529216:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783074096.751488:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074097.775350:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783074098.304131:0:89519:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1783074098.799000:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783074099.135921:0:89567:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783074099.823508:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074100.654695:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723529344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074100.654695:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723529472:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.654808:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723529600:0@lo:400:kworker.0 00000100:00100000:3.0:1783074100.655228:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074100.655366:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723529856:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.655534:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529344 00000100:00100000:2.0:1783074100.655542:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529344 00000100:00100000:2.0:1783074100.655591:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:2.0:1783074100.655601:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723529344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074100.655709:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074100.657912:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074100.657952:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723530112:0@lo:400:kworker.0 00000100:00100000:1.0:1783074100.658048:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074100.658092:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723529984:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658113:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723529344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2511us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.658129:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:1.0:1783074100.658130:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074100.658158:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723530496:0@lo:400:kworker.0 00000100:00080000:2.0:1783074100.658174:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074100.658184:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074100.658208:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d2328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723531008:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658235:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529600 00000100:00100000:2.0:1783074100.658243:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529600 00000100:00100000:0.0:1783074100.658306:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074100.658307:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529984 00000100:00100000:2.0:1783074100.658339:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529984 00000100:00100000:2.0:1783074100.658368:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530496 00000100:00100000:2.0:1783074100.658373:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530496 00000100:00100000:0.0:1783074100.658379:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723530624:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658393:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1783074100.658402:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869685723529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.658410:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074100.658441:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723531136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074100.658455:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869685723529600:12345-0@lo:400:kworker.0 Request processed in 54us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074100.658470:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074100.658479:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1783074100.658497:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1783074100.658504:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723529984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.658514:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723529600:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.658539:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1783074100.658540:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723529984:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.658551:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1783074100.658551:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723529728:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658569:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1783074100.658577:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723530496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.658585:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074100.658605:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723530240:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658613:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723530496:12345-0@lo:400:kworker.0 Request processed in 36us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.658620:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1783074100.658642:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529728 00000100:00100000:2.0:1783074100.658645:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529728 00000100:00100000:0.0:1783074100.658651:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074100.658664:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1783074100.658672:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723529728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.658677:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723530752:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658713:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723529728:12345-0@lo:400:kworker.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074100.658716:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074100.658725:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1783074100.658742:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723531264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783074100.658750:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074100.658760:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074100.658769:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074100.658779:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074100.658804:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723529728:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658806:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530112 00000100:00100000:2.0:1783074100.658813:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530112 00000100:00100000:0.0:1783074100.658841:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530240 00000100:00100000:2.0:1783074100.658843:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530624 00000100:00100000:3.0:1783074100.658846:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723530368:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658848:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530624 00000100:00100000:0.0:1783074100.658848:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530240 00000100:00100000:2.0:1783074100.658866:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723531136 00000100:00100000:2.0:1783074100.658868:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723531136 00000100:00100000:3.0:1783074100.658871:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074100.658901:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d2329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723530880:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.658902:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636 00000100:00100000:0.0:1783074100.658902:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530752 00000100:00100000:0.0:1783074100.658909:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530752 00000100:00100000:2.0:1783074100.658915:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723530112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074100.658928:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074100.658972:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723531392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074100.658995:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074100.659027:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723529344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074100.659063:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530368 00000100:00100000:3.0:1783074100.659066:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530368 00000100:00100000:1.0:1783074100.659075:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074100.659099:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723530880 00000100:00100000:3.0:1783074100.659103:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723530880 00000100:00100000:1.0:1783074100.659116:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723529984:0@lo:400:kworker.0 00000100:00100000:3.0:1783074100.659128:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1783074100.659134:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723530496:0@lo:400:kworker.0 00000100:00100000:3.0:1783074100.659138:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074100.659188:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723530240:12345-0@lo:400:kworker.0 Request processed in 52us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.659192:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529472 00000100:00100000:3.0:1783074100.659197:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1783074100.659199:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529472 00000100:00100000:2.0:1783074100.659362:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723530112:12345-0@lo:400:kworker.0 Request processed in 449us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.659369:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636 00000100:00100000:2.0:1783074100.659380:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723531392 00000100:00100000:2.0:1783074100.659383:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723531392 00000100:00100000:2.0:1783074100.659397:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637 00000100:00100000:2.0:1783074100.659403:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723530624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.659429:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723530624:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.659434:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637 00000100:00100000:2.0:1783074100.659445:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3638 00000100:00100000:2.0:1783074100.659450:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723531136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783074100.659530:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1444749312 avail 1298509824 00000100:00100000:1.0:1783074100.659550:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783074100.659562:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723529472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.659568:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723531136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.659576:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3638 00000100:00100000:2.0:1783074100.659590:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639 00000100:00100000:2.0:1783074100.659599:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723531392:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074100.659612:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723529472:12345-0@lo:400:kworker.0 Request processed in 51us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.659622:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783074100.659652:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723529856 00000100:00100000:1.0:1783074100.659656:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723529856 00000100:00100000:1.0:1783074100.659675:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723531008 00000100:00100000:1.0:1783074100.659678:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723531008 00000100:00100000:1.0:1783074100.659692:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1783074100.659699:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074100.659738:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723529856:12345-0@lo:400:kworker.0 Request processed in 38us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.659744:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1783074100.659756:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1783074100.659763:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723531008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074100.659790:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723531008:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.659796:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000004:00000024:2.0:1783074100.659813:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074100.659816:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723531264 00000100:00100000:1.0:1783074100.659821:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723531264 00000100:00100000:1.0:1783074100.659849:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:2.0:1783074100.659854:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723531392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.659860:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1869685723531264:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074100.659867:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639 00002000:00000024:1.0:1783074100.659885:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074100.659925:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1869685723531264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.659932:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:1.0:1783074100.659953:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1783074100.659960:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723530752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074100.659999:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723530752:12345-0@lo:400:kworker.0 Request processed in 39us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.660006:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1783074100.660022:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:1.0:1783074100.660029:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723530368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074100.660057:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723530368:12345-0@lo:400:kworker.0 Request processed in 29us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.660063:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:1.0:1783074100.660076:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:1.0:1783074100.660082:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723530880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074100.660111:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723530880:12345-0@lo:400:kworker.0 Request processed in 29us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.660118:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1783074100.660403:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723531392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074100.660417:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723529856:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.660428:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723530368:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.660438:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d2329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723530880:0@lo:400:kworker.0 00000100:00080000:0.0:1783074100.660506:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783074100.660511:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074100.660513:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074100.660537:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723530240:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.660553:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723530752:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.660569:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723531264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074100.660581:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723529472:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.660601:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723531136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074100.660607:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d2328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723531008:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.660618:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723530112:0@lo:400:kworker.0 00000100:00100000:0.0:1783074100.660631:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723530624:0@lo:400:kworker.0 00000100:00100000:2.0:1783074100.672519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074100.672929:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045824 00000100:00100000:1.0:1783074100.672950:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045824 00000100:00100000:1.0:1783074100.673037:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1152 00000100:00100000:1.0:1783074100.673047:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:68595:x1869685708045824:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074100.673080:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1444749312 avail 1298509824 00000100:00080000:0.0:1783074100.673113:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783074100.673156:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:68595:x1869685708045824:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 110us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.673164:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1152 00000100:00100000:3.0:1783074100.677966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074100.678185:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708045952 00000100:00100000:2.0:1783074100.678196:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708045952 00000100:00100000:2.0:1783074100.678294:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1153 00000100:00100000:2.0:1783074100.678305:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68595:x1869685708045952:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074100.678368:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074100.678439:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68595:x1869685708045952:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 136us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.678446:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1153 00000100:00080000:0.0:1783074100.678836:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074100.682293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074100.682446:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046080 00000100:00100000:2.0:1783074100.682456:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046080 00000100:00100000:2.0:1783074100.682533:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1683 00000100:00100000:2.0:1783074100.682543:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68595:x1869685708046080:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074100.682586:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074100.682656:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68595:x1869685708046080:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.682664:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1683 00000100:00080000:0.0:1783074100.682944:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074100.684489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074100.685047:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046208 00000100:00100000:2.0:1783074100.685056:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046208 00000100:00080000:0.0:1783074100.685174:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074100.687668:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1684 00000100:00100000:2.0:1783074100.687693:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68595:x1869685708046208:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074100.687726:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074100.687816:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:68595:x1869685708046208:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 134us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.687824:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1684 00000100:00100000:3.0:1783074100.718710:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074100.718874:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046464 00000100:00100000:2.0:1783074100.718884:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046464 00000100:00100000:2.0:1783074100.718943:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1154 00000100:00100000:2.0:1783074100.718953:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:68611:x1869685708046464:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1783074100.718973:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074100.718997:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b043 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719101:0:68632:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 11 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719120:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719134:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719160:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719276:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719284:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719290:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719296:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086cc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074100.719300:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719308:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074100.719361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074100.719468:0:88943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046592 00000100:00100000:3.0:1783074100.719473:0:88943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046592 00010000:00010000:2.0:1783074100.719794:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524f44ee000) 00010000:00010000:2.0:1783074100.719798:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074100.719803:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719811:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df53a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719869:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df533 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b043 expref: 12 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719879:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0ae5f00) 00010000:00010000:2.0:1783074100.719888:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074100.719893:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b043 expref: 12 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.719903:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086dc00, rc 0) 00000100:00100000:2.0:1783074100.719962:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:68611:x1869685708046464:12345-192.168.204.26@tcp:101:cat.0 Request processed in 1010us (1261us total) trans 111669149698 rc 301/301 00000100:00100000:2.0:1783074100.719970:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1154 00000100:00100000:3.0:1783074100.720920:0:88943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:3.0:1783074100.720936:0:88943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708046592:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074100.720990:0:88943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2403:x1869685708046592:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 55us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074100.720998:0:88943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000001:00080000:2.0:1783074100.727026:0:88938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149698 is committed 00000100:00100000:3.0:1783074100.729046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074100.729200:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046720 00000100:00100000:1.0:1783074100.729221:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046720 00000100:00100000:1.0:1783074100.729288:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1155 00000100:00100000:1.0:1783074100.729298:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:68611:x1869685708046720:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1783074100.729474:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074100.729494:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b04a expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.729563:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.729579:0:66201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 9 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.729588:0:66201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.729620:0:66201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 9 pid: 88970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.729634:0:66201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 9 pid: 88970 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074100.729648:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66201:1869685723531520:192.168.204.26@tcp:104: 00000100:00100000:1.0:1783074100.729731:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074100.735908:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66201:1869685723531520:192.168.204.26@tcp:104: 00010000:00010000:2.0:1783074100.735940:0:66201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074100.737735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074100.738441:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046848 00000100:00100000:0.0:1783074100.738452:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046848 00010000:00010000:0.0:1783074100.738490:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 10 pid: 88970 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074100.738568:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2577 00000100:00100000:0.0:1783074100.738578:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2405:x1869685708046848:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783074100.738594:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1783074100.738613:0:19654:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:0.0:1783074100.738617:0:19654:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1783074072 00000004:00010000:0.0:1783074100.738619:0:19654:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1783074068 00000004:00010000:0.0:1783074100.738622:0:19654:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1783074072 00010000:00010000:0.0:1783074100.738627:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 10 pid: 88970 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074100.738640:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 10 pid: 88970 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074100.738661:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016df350 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b012 expref: 10 pid: 88970 timeout: 3039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074100.738689:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524f44ee000) 00010000:00010000:0.0:1783074100.738694:0:19654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074100.738704:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074100.738712:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074100.738742:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074100.738812:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708046848:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 235us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074100.738820:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2577 00010000:00010000:2.0:1783074100.739081:0:66201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.739090:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074100.739138:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074100.739160:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.739190:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b04a expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.739208:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b04a expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.739237:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524f44ee000) 00010000:00010000:2.0:1783074100.739240:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074100.739243:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7200, rc 0) 00000100:00100000:2.0:1783074100.739281:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:68611:x1869685708046720:12345-192.168.204.26@tcp:101:cat.0 Request processed in 9985us (10244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.739288:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1155 00000100:00100000:2.0:1783074100.741347:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074100.743704:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708046976 00000100:00100000:1.0:1783074100.743717:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708046976 00000100:00100000:1.0:1783074100.743784:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1156 00000100:00100000:1.0:1783074100.743793:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:68611:x1869685708046976:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1783074100.743825:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074100.743845:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6800/0x5fb609b3016df556 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b051 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.743897:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6800/0x5fb609b3016df556 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b051 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.743910:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6800/0x5fb609b3016df556 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b051 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074100.743927:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524f44ee000) 00010000:00010000:1.0:1783074100.743930:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074100.743933:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6800, rc 0) 00000100:00100000:1.0:1783074100.744066:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:68611:x1869685708046976:12345-192.168.204.26@tcp:101:cat.0 Request processed in 273us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074100.744073:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1156 00000100:00100000:1.0:1783074100.748836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074100.748902:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708047104 00000100:00100000:2.0:1783074100.748920:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708047104 00000100:00100000:2.0:1783074100.748977:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1157 00000100:00100000:2.0:1783074100.748987:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2404:x1869685708047104:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1783074100.749007:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074100.749026:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df55d lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b058 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.749065:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df55d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b058 expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074100.749089:0:68632:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:2.0:1783074100.749092:0:68632:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783074072 -> 1783074072 00000004:00010000:2.0:1783074100.749095:0:68632:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783074068 -> 1783074068 00000004:00010000:2.0:1783074100.749097:0:68632:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783074072 -> 1783074072 00000004:00010000:2.0:1783074100.749100:0:68632:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:2.0:1783074100.749104:0:68632:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:2.0:1783074100.749112:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df55d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b058 expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074100.749139:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9524f44ee000) 00010000:00010000:2.0:1783074100.749142:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783074100.749145:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086dc00, rc 0) 00000100:00100000:2.0:1783074100.749200:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2404:x1869685708047104:12345-192.168.204.26@tcp:101:cat.0 Request processed in 215us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074100.749207:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1157 00000100:00100000:3.0:1783074100.755204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074100.758154:0:66213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708047232 00000100:00100000:0.0:1783074100.758169:0:66213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708047232 00002000:00100000:0.0:1783074100.758231:0:66213:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9524d2328000 x1869685708047232/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:426/0 lens 488/0 e 0 to 0 dl 1783074111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074100.758242:0:66213:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9524d2328000 with x1869685708047232 00000100:00100000:0.0:1783074100.758288:0:66213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1783074100.758297:0:66213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2403:x1869685708047232:12345-192.168.204.26@tcp:3:cat.0 00000100:00100000:0.0:1783074100.758569:0:66213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2403:x1869685708047232:12345-192.168.204.26@tcp:3:cat.0 Request processed in 273us (3376us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783074100.758577:0:66213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00002000:00100000:0.0:1783074100.758584:0:66213:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9524d2328000 x1869685708047232/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:426/0 lens 488/4536 e 0 to 0 dl 1783074111 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074100.758611:0:66213:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9524d2328000 with x1869685708047232 00000100:00100000:3.0:1783074100.763905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074100.764598:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708047488 00000100:00100000:0.0:1783074100.764608:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708047488 00000100:00100000:0.0:1783074100.764719:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00100000:0.0:1783074100.764730:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:68611:x1869685708047488:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:0.0:1783074100.764963:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:68611:x1869685708047488:12345-192.168.204.26@tcp:35:cat.0 Request processed in 234us (1067us total) trans 111669149699 rc 0/0 00000100:00100000:0.0:1783074100.764971:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 223 00010000:00010000:3.0:1783074100.846437:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074101.678555:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723531648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074101.678592:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723531776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074101.678628:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074101.678697:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723531648 00000100:00100000:2.0:1783074101.678704:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723531648 00000100:00100000:2.0:1783074101.678756:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:2.0:1783074101.678766:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723531648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074101.678787:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074101.678835:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723531648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074101.678844:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:2.0:1783074101.678879:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074101.678927:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723531776 00000100:00100000:2.0:1783074101.678931:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723531776 00000100:00100000:2.0:1783074101.679094:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:2.0:1783074101.679105:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723531776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783074101.679116:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074101.679160:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723531776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074101.679168:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:0.0:1783074101.679217:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723531776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074101.679240:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723531648:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1783074101.682068:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968714 is committed 00000001:00100000:3.0:1783074101.682116:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00080000:2.0:1783074101.683163:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968709 is committed 00000001:00100000:2.0:1783074101.683190:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00010000:00010000:2.0:1783074101.870465:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074102.894608:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074103.920065:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074104.088171:0:89762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:3.0:1783074104.943176:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074105.037923:0:89810:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 06:21:43 (1783074103) 00000100:00100000:3.0:1783074105.093308:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.095433:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708047616 00000100:00100000:2.0:1783074105.095445:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708047616 00000100:00100000:2.0:1783074105.095519:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1158 00000100:00100000:2.0:1783074105.095531:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:69343:x1869685708047616:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074105.095554:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074105.095573:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b05f expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095632:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095648:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095659:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095673:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095679:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095686:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095733:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095739:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095745:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095751:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086ca00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.095755:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095762:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095774:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0ae5f00) 00010000:00010000:2.0:1783074105.095776:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074105.095781:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095787:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086ca00/0x5fb609b3016df56b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095798:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095804:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095810:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095820:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.095823:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095828:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095835:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524fc3b7a00) 00010000:00010000:2.0:1783074105.095837:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074105.095840:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095846:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df572 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095876:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df564 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b05f expref: 12 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095885:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0ae5f00) 00010000:00010000:2.0:1783074105.095887:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074105.095891:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086cc00/0x5fb609b3016df564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b05f expref: 12 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.095900:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086cc00, rc 0) 00000100:00100000:2.0:1783074105.095953:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:69343:x1869685708047616:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 426us (2654us total) trans 0 rc 301/301 00000100:00100000:2.0:1783074105.095960:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1158 00000100:00080000:0.0:1783074105.096029:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783074105.100527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.100653:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708047872 00000100:00100000:2.0:1783074105.100674:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708047872 00000100:00100000:2.0:1783074105.100730:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1159 00000100:00100000:2.0:1783074105.100739:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:69343:x1869685708047872:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074105.100758:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074105.100762:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783074105.100788:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016df35e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b03c expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.100808:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0ae5f00) 00010000:00010000:2.0:1783074105.100819:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074105.100836:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016df579 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b066 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.100935:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.100961:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.100972:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.100986:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.100993:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101000:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101465:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101474:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101483:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074105.101492:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1783074105.101516:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101524:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101530:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101538:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101544:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.101548:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101555:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101564:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc3b7e00) 00010000:00010000:2.0:1783074105.101568:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074105.101578:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101585:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df580 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074105.101596:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000909c3c9e reply state 00000000b8db09f7 transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101606:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101612:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524fc3b7700) 00010000:00010000:2.0:1783074105.101614:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074105.101616:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783074105.101638:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016df579 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 13 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101654:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.101661:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524fc3b7600) 00010000:00010000:2.0:1783074105.101663:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074105.101665:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158e00, rc 0) 00000100:00100000:2.0:1783074105.101720:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69343:x1869685708047872:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 982us (1241us total) trans 111669149700 rc 0/0 00000100:00100000:2.0:1783074105.101727:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1159 00000100:00100000:3.0:1783074105.104618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074105.105037:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708048128 00000100:00100000:0.0:1783074105.105046:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708048128 00000100:00100000:0.0:1783074105.105105:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1160 00000100:00100000:0.0:1783074105.105116:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69343:x1869685708048128:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074105.105150:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074105.105171:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016df59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b06d expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.105268:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.105294:0:66202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 14 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.105303:0:66202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.105359:0:66202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 14 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.105374:0:66202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 14 pid: 67186 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074105.105389:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df293800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66202:1869685723531904:192.168.204.26@tcp:104: 00000100:00100000:0.0:1783074105.105469:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a86000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074105.110563:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.110580:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df293800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66202:1869685723531904:192.168.204.26@tcp:104: 00010000:00010000:2.0:1783074105.110611:0:66202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074105.110655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708048256 00000100:00100000:3.0:1783074105.110662:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708048256 00010000:00010000:3.0:1783074105.110693:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 15 pid: 67186 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074105.110729:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2578 00000100:00100000:3.0:1783074105.110739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:2404:x1869685708048256:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074105.110752:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074105.110759:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 15 pid: 67186 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.110771:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 15 pid: 67186 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.110793:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df58e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b066 expref: 15 pid: 67186 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.110806:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524fc3b7600) 00010000:00010000:3.0:1783074105.110810:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.110820:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.110827:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.111219:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074105.111220:0:66202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.111230:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074105.111249:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000100:00100000:3.0:1783074105.111422:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:2404:x1869685708048256:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 682us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074105.111433:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2578 00000004:00080000:2.0:1783074105.111636:0:66202:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6a3:0x0], count =127 00000004:00080000:2.0:1783074105.111645:0:66202:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6a3:0x0]+127 in llog 00000004:00080000:2.0:1783074105.111679:0:66202:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x722:0x0], index 0: 0 00010000:00010000:2.0:1783074105.111777:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.111786:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.111794:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.111800:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.111804:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.111811:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.111823:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524fc3b7600) 00010000:00010000:2.0:1783074105.111826:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783074105.111830:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.112179:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5a3 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.112231:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016df59c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b06d expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.112240:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4934900) 00010000:00010000:2.0:1783074105.112243:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074105.112247:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016df59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b06d expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.112257:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670000, rc 0) 00000100:00100000:2.0:1783074105.112378:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69343:x1869685708048128:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 7264us (7765us total) trans 111669149701 rc 301/301 00000100:00100000:2.0:1783074105.112388:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1160 00000100:00100000:0.0:1783074105.119231:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074105.119419:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708048512 00000100:00100000:1.0:1783074105.119429:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708048512 00000100:00100000:1.0:1783074105.119515:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 224 00000100:00100000:1.0:1783074105.119527:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69343:x1869685708048512:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1783074105.119792:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:69343:x1869685708048512:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 266us (567us total) trans 111669149702 rc 0/0 00000100:00100000:1.0:1783074105.119801:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 224 00000100:00100000:1.0:1783074105.123916:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074105.123954:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708048768 00000100:00100000:1.0:1783074105.123973:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708048768 00000100:00100000:1.0:1783074105.124033:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:1.0:1783074105.124045:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4206050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:69343:x1869685708048768:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1783074105.124264:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4206050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:69343:x1869685708048768:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 218us (354us total) trans 111669149703 rc 0/0 00000100:00100000:1.0:1783074105.124280:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 225 00000001:00080000:2.0:1783074105.582487:0:88938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:1.0:1783074105.583277:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074105.583373:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074105.583382:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074105.583388:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074105.583392:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074105.583400:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074105.583416:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524fc3b7700) 00010000:00010000:1.0:1783074105.583419:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074105.583424:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074105.583431:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df587 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074105.628876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074105.629027:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708048896 00000100:00100000:0.0:1783074105.629037:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708048896 00000100:00100000:0.0:1783074105.629098:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1161 00000100:00100000:0.0:1783074105.629107:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:69352:x1869685708048896:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074105.629143:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074105.629166:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016df5b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b074 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.629242:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.629268:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.629280:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074105.629345:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074105.629349:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074105.629370:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.629392:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016df5b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b074 expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.629408:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b074 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074105.629416:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4900) 00010000:00010000:0.0:1783074105.629426:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074105.629430:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670e00, rc 0) 00000100:00100000:0.0:1783074105.629487:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:69352:x1869685708048896:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 380us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074105.629495:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1161 00000100:00100000:0.0:1783074105.639638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.642196:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049024 00000100:00100000:2.0:1783074105.642209:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049024 00000100:00100000:2.0:1783074105.642282:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1162 00000100:00100000:2.0:1783074105.642293:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:69352:x1869685708049024:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074105.642348:0:68632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783074105.642431:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:69352:x1869685708049024:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 140us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074105.642439:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1162 00000100:00100000:1.0:1783074105.652236:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.652499:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049152 00000100:00100000:2.0:1783074105.652508:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049152 00000100:00080000:3.0:1783074105.652575:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074105.652581:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1163 00000100:00100000:2.0:1783074105.652592:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69352:x1869685708049152:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074105.652627:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074105.652692:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69352:x1869685708049152:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 103us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074105.652700:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1163 00000100:00100000:3.0:1783074105.655388:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.655556:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049280 00000100:00100000:2.0:1783074105.655564:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049280 00000100:00100000:2.0:1783074105.655640:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1687 00000100:00100000:2.0:1783074105.655650:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:69352:x1869685708049280:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074105.655679:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074105.655732:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:69352:x1869685708049280:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 84us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074105.655739:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1687 00000100:00080000:3.0:1783074105.655783:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074105.658137:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.658220:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049408 00000100:00100000:2.0:1783074105.658228:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049408 00000100:00100000:2.0:1783074105.658356:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1688 00000100:00100000:2.0:1783074105.658367:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:69352:x1869685708049408:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074105.658396:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074105.658461:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:69352:x1869685708049408:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074105.658471:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1688 00000100:00080000:3.0:1783074105.658690:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074105.689775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.689914:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049664 00000100:00100000:2.0:1783074105.689924:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049664 00000100:00100000:2.0:1783074105.690031:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1164 00000100:00100000:2.0:1783074105.690043:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:69359:x1869685708049664:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00010000:2.0:1783074105.690117:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074105.690157:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df5b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b074 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690176:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4900) 00010000:00010000:2.0:1783074105.690187:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074105.690249:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690263:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690273:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690285:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690292:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690299:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690673:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690682:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690688:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690700:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690707:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.690711:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690718:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690726:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:2.0:1783074105.690729:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074105.690733:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690739:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074105.690760:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d60ba6f reply state 000000009f6cfe45 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690770:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.690776:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0b7d000) 00010000:00010000:2.0:1783074105.690779:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074105.690781:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074105.690977:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:69359:x1869685708049664:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 936us (1212us total) trans 111669149704 rc 0/0 00000100:00100000:2.0:1783074105.690984:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1164 00000100:00100000:0.0:1783074105.704029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.704063:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049792 00000100:00100000:2.0:1783074105.704073:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049792 00000100:00100000:2.0:1783074105.704144:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1165 00000100:00100000:2.0:1783074105.704156:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:69362:x1869685708049792:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1783074105.704180:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074105.704201:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b07b expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.704262:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df5d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.704277:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.704289:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074105.704353:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074105.704357:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074105.704379:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.704404:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b07b expref: 13 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.704423:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b07b expref: 12 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.704433:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:2.0:1783074105.704436:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074105.704446:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158a00, rc 0) 00000100:00100000:2.0:1783074105.704507:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:69362:x1869685708049792:12345-192.168.204.26@tcp:101:rm.0 Request processed in 354us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074105.704514:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1165 00000100:00100000:0.0:1783074105.708897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074105.708989:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049920 00000100:00100000:3.0:1783074105.708999:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049920 00000100:00100000:3.0:1783074105.709215:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1166 00000100:00100000:3.0:1783074105.709227:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:69362:x1869685708049920:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074105.709248:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074105.709268:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298e00/0x5fb609b3016df5db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b082 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709354:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709368:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709379:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709390:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709408:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709417:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709496:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709506:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709513:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074105.709559:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:3.0:1783074105.709563:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074105.709582:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709592:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709602:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709608:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709614:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709643:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709650:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074105.709654:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709662:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709676:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:3.0:1783074105.709679:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074105.709684:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709690:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016df5e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709703:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709709:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709714:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709719:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074105.709722:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709737:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709748:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0b7d000) 00010000:00010000:3.0:1783074105.709751:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074105.709755:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709761:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016df5e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709790:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298e00/0x5fb609b3016df5db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b082 expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709806:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b082 expref: 13 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.709813:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9524c8cd5700) 00010000:00010000:3.0:1783074105.709816:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783074105.709819:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299c00, rc 0) 00000100:00100000:3.0:1783074105.709877:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69362:x1869685708049920:12345-192.168.204.26@tcp:101:rm.0 Request processed in 652us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074105.709884:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1166 00000100:00100000:3.0:1783074105.713227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074105.713418:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708050176 00000100:00100000:2.0:1783074105.713427:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708050176 00000100:00100000:2.0:1783074105.713520:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1167 00000100:00100000:2.0:1783074105.713530:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69362:x1869685708050176:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1783074105.713581:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783074105.713607:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016df5f0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b082 expref: 13 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713624:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9524c8cd5700) 00010000:00010000:2.0:1783074105.713646:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df5d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b07b expref: 12 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713656:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:2.0:1783074105.713663:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074105.713684:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713696:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713705:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713716:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713738:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713746:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713820:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713829:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.713836:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714007:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714017:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714024:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714031:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714037:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714043:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714081:0:67186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074105.714099:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714106:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714112:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714129:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.714133:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714142:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714150:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:2.0:1783074105.714153:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783074105.714156:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714163:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df605 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714177:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714183:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714188:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714199:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714205:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074105.714207:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714214:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714220:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d700) 00010000:00010000:2.0:1783074105.714223:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074105.714225:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714231:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159e00/0x5fb609b3016df5f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074105.714244:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069611c44 reply state 00000000dedf2e89 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714254:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074105.714260:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0b7d000) 00010000:00010000:2.0:1783074105.714262:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074105.714264:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074105.714357:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69362:x1869685708050176:12345-192.168.204.26@tcp:36:rm.0 Request processed in 827us (1135us total) trans 111669149705 rc 0/0 00000100:00100000:2.0:1783074105.714365:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1167 00010000:00010000:3.0:1783074105.714427:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074105.714435:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.714451:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074105.714455:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.714462:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.714471:0:46245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:3.0:1783074105.714474:0:46245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783074105.714477:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.714482:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158800/0x5fb609b3016df60c lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074105.714495:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074105.714497:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074105.714499:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074105.775227:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074105.775251:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723532032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074105.775338:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074105.776072:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074105.776097:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723532160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074105.776139:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.776584:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532032 00000100:00100000:1.0:1783074105.776592:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532032 00000100:00100000:1.0:1783074105.776702:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723532544:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.776734:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.776752:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723533056:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.776773:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.776787:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723533568:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.776805:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.776822:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783074105.776827:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723532416:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.776851:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.776872:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723532928:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.776890:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.777029:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723533440:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.777050:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.777075:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533056 00000100:00100000:1.0:1783074105.777079:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533056 00000100:00100000:0.0:1783074105.778154:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532160 00000100:00100000:0.0:1783074105.778159:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532160 00000100:00100000:0.0:1783074105.778178:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:0.0:1783074105.778186:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723532032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783074105.778209:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074105.778254:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723532032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074105.778261:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:0.0:1783074105.778275:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:0.0:1783074105.778281:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723532160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074105.778289:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074105.778324:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723532160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074105.778330:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00080000:0.0:1783074105.778343:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074105.778346:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074105.778363:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723532288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074105.778387:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.779259:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533568 00000100:00100000:1.0:1783074105.779266:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533568 00000100:00100000:0.0:1783074105.779277:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723532800:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.779291:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532288 00000100:00100000:1.0:1783074105.779296:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532288 00000100:00100000:0.0:1783074105.779328:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.779335:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3640 00000100:00100000:1.0:1783074105.779345:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723533056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.779348:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723533312:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.779375:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074105.779392:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723533824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074105.779408:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723533056:12345-0@lo:400:kworker.0 Request processed in 64us (2633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074105.779417:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.779419:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3640 00000100:00100000:1.0:1783074105.779450:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533824 00000100:00100000:1.0:1783074105.779453:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533824 00000100:00100000:0.0:1783074105.779458:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968709 gen 2 00000100:00100000:1.0:1783074105.779471:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3641 00000100:00100000:1.0:1783074105.779479:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723533568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.779484:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723532160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074105.779501:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783074105.779509:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723532672:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.779517:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723533568:12345-0@lo:400:kworker.0 Request processed in 38us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.779525:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3641 00000100:00100000:0.0:1783074105.779534:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.779542:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642 00000100:00100000:1.0:1783074105.779549:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723532288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074105.779565:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444749312 avail 1298509824 00000100:00100000:1.0:1783074105.779596:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723532288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.779602:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642 00000100:00100000:1.0:1783074105.779613:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643 00000100:00100000:1.0:1783074105.779618:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723533824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783074105.779628:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074105.779653:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723533824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.779659:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643 00000100:00100000:1.0:1783074105.779685:0:88944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532416 00000100:00100000:1.0:1783074105.779689:0:88944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532416 00000100:00100000:1.0:1783074105.779714:0:88944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783074105.779720:0:88944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723532416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.779748:0:88944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723532416:12345-0@lo:400:kworker.0 Request processed in 29us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.779754:0:88944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783074105.779805:0:3660:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968714 gen 2 00000100:00100000:1.0:1783074105.779819:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723532032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783074105.779844:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723532416:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.779855:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723533056:0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.779864:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723533568:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.785243:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723533184:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.785475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074105.785501:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723533696:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.785528:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074105.785804:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532544 00000100:00100000:1.0:1783074105.785812:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532544 00000100:00100000:1.0:1783074105.785866:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533440 00000100:00100000:1.0:1783074105.785869:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533440 00000100:00100000:3.0:1783074105.785873:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532928 00000100:00100000:3.0:1783074105.785880:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532928 00000100:00100000:1.0:1783074105.785882:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532800 00000100:00100000:1.0:1783074105.785887:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532800 00000100:00100000:1.0:1783074105.785907:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723532672 00000100:00100000:1.0:1783074105.785910:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723532672 00000100:00100000:3.0:1783074105.785919:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1783074105.785929:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723532544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074105.786059:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723532544:12345-0@lo:400:kworker.0 Request processed in 131us (9323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.786654:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1783074105.786663:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723533440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.786698:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723533440:12345-0@lo:400:kworker.0 Request processed in 37us (9647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.786705:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1783074105.786721:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1783074105.786727:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723532928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.786751:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723532928:12345-0@lo:400:kworker.0 Request processed in 24us (9860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.786757:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1783074105.786767:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1783074105.786772:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723532800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.786796:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723532800:12345-0@lo:400:kworker.0 Request processed in 23us (7486us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.786814:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1783074105.786827:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1783074105.786832:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723532672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.786859:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723532672:12345-0@lo:400:kworker.0 Request processed in 26us (7325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.786864:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1783074105.786909:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533312 00000100:00100000:1.0:1783074105.786913:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533312 00000100:00100000:1.0:1783074105.786942:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533184 00000100:00100000:1.0:1783074105.786945:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533184 00000100:00100000:3.0:1783074105.786956:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1783074105.786971:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:1.0:1783074105.786979:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723533312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074105.787000:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:1.0:1783074105.787012:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723533312:12345-0@lo:400:kworker.0 Request processed in 32us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074105.787018:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723533184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074105.787023:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:3.0:1783074105.787064:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723533184:12345-0@lo:400:kworker.0 Request processed in 49us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074105.787072:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00080000:1.0:1783074105.787073:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074105.787078:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074105.787082:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074105.787084:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783074105.787129:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723532928:0@lo:400:kworker.0 00000100:00100000:3.0:1783074105.787145:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723533440:0@lo:400:kworker.0 00000100:00100000:3.0:1783074105.787158:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723532544:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.788007:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723532288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074105.788023:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723532800:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.788035:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723533312:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.788048:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723533824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074105.788075:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723532672:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.788085:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723533184:0@lo:400:kworker.0 00000100:00100000:2.0:1783074105.788166:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533696 00000100:00100000:2.0:1783074105.788172:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533696 00000100:00100000:2.0:1783074105.788207:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1783074105.788216:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723533696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074105.788504:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723533696:12345-0@lo:400:kworker.0 Request processed in 289us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074105.788511:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1783074105.788578:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723533696:0@lo:400:kworker.0 00000100:00100000:0.0:1783074105.839730:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074105.839784:0:88947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708050304 00000100:00100000:1.0:1783074105.839793:0:88947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708050304 00000100:00100000:1.0:1783074105.839846:0:88947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:1.0:1783074105.839859:0:88947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524defe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708050304:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074105.840231:0:88947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524defe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708050304:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 374us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074105.840239:0:88947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00010000:00010000:3.0:1783074105.967084:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074106.799410:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074106.799431:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723533952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074106.799492:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074106.799527:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723533952 00000100:00100000:0.0:1783074106.799534:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723533952 00000100:00100000:0.0:1783074106.799572:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:0.0:1783074106.799586:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723533952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074106.799615:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074106.799659:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723533952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074106.799665:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00100000:0.0:1783074106.799706:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723533952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074106.800411:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723534080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074106.800439:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074106.800467:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534080 00000100:00100000:2.0:1783074106.800470:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534080 00000100:00100000:2.0:1783074106.800495:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1783074106.800501:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723534080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074106.800517:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074106.800546:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723534080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074106.800551:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1783074106.800580:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723534080:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783074106.992721:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074108.014409:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074109.038566:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783074109.145151:0:90205:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1783074109.189395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074109.189428:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708050432 00000100:00100000:0.0:1783074109.189436:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708050432 00000100:00100000:0.0:1783074109.189483:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1168 00000100:00100000:0.0:1783074109.189491:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:69429:x1869685708050432:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074109.189510:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074109.189527:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016df613 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b089 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.189581:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016df61a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.189591:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016df61a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.189598:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016df61a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074109.189634:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074109.189638:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074109.189657:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016df61a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.189692:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671c00/0x5fb609b3016df613 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b089 expref: 15 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.189703:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016df61a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b089 expref: 14 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.189710:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:0.0:1783074109.189712:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074109.189714:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00010000:00000080:0.0:1783074109.189719:0:66201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b4e00 x1869685708050432/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 576/688 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074109.189765:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:69429:x1869685708050432:12345-192.168.204.26@tcp:101:dd.0 Request processed in 277us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074109.189770:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1168 00000100:00080000:0.0:1783074109.189872:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074109.193343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074109.193391:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708050688 00000100:00100000:2.0:1783074109.193400:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708050688 00000100:00100000:2.0:1783074109.193455:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1169 00000100:00100000:2.0:1783074109.193466:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+14:69429:x1869685708050688:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074109.193485:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074109.193488:0:66200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783074109.193512:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016df61a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b089 expref: 14 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193539:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:2.0:1783074109.193550:0:66200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074109.193567:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016df621 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b090 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193682:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193696:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193706:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193720:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193726:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193733:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193792:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df636 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193801:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df636 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193808:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df636 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074109.193824:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1783074109.193899:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193907:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193914:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193920:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193926:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074109.193930:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193938:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193947:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:2.0:1783074109.193950:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074109.193954:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193961:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193972:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193979:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193993:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.193999:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074109.194002:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.194009:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.194019:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d0b7dc00) 00010000:00010000:2.0:1783074109.194021:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074109.194025:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.194031:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016df62f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.194091:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016df621 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b090 expref: 16 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.194109:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df636 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b090 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.194118:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:2.0:1783074109.194120:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074109.194123:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159000, rc 0) 00010000:00000080:2.0:1783074109.194130:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b6300 x1869685708050688/t111669149706(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 776/848 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074109.194212:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:69429:x1869685708050688:12345-192.168.204.26@tcp:101:dd.0 Request processed in 748us (879us total) trans 111669149706 rc 0/0 00000100:00100000:2.0:1783074109.194220:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1169 00000100:00100000:0.0:1783074109.197538:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074109.197628:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708050816 00000100:00100000:2.0:1783074109.197639:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708050816 00000100:00100000:2.0:1783074109.197691:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1170 00000100:00100000:2.0:1783074109.197702:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+15:69429:x1869685708050816:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074109.197725:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074109.197743:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159600/0x5fb609b3016df644 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b097 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.197774:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df64b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.197788:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df64b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.197799:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df64b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.197892:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159600/0x5fb609b3016df644 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b097 expref: 17 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.197909:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df64b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b097 expref: 16 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.197918:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:2.0:1783074109.197926:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783074109.197930:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158a00, rc 0) 00010000:00000080:2.0:1783074109.197937:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b6a00 x1869685708050816/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 568/1344 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074109.197993:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+16:69429:x1869685708050816:12345-192.168.204.26@tcp:101:dd.0 Request processed in 293us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074109.198001:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1170 00000100:00100000:0.0:1783074109.200477:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.200644:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051072 00000100:00100000:1.0:1783074109.200652:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051072 00000100:00100000:1.0:1783074109.200709:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1171 00000100:00100000:1.0:1783074109.200720:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+16:69429:x1869685708051072:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:1.0:1783074109.200764:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074109.200787:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016df636 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b090 expref: 16 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.200804:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.200814:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074109.200972:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.200985:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.200993:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783074109.201034:0:67186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:1.0:1783074109.201068:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e1c3e0d reply state 000000006567844c transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.201080:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.201086:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.201088:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074109.201091:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1783074109.201126:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b7b80 x1869685708051072/t111669149708(0) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 488/456 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074109.201199:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+18:69429:x1869685708051072:12345-192.168.204.26@tcp:36:dd.0 Request processed in 481us (730us total) trans 111669149708 rc 0/0 00000100:00100000:1.0:1783074109.201206:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1171 00000020:00080000:1.0:1783074109.201211:0:67186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783074109.202841:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.203087:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051200 00000100:00100000:1.0:1783074109.203095:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051200 00000100:00100000:1.0:1783074109.203151:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1172 00000100:00100000:1.0:1783074109.203160:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+18:69429:x1869685708051200:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074109.203177:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074109.203194:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df659 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b09e expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.203239:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df659 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b09e expref: 19 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.203252:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df659 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b09e expref: 19 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.203268:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.203271:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074109.203274:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6600, rc 0) 00010000:00000080:1.0:1783074109.203283:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b5c00 x1869685708051200/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 376/584 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.203370:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+19:69429:x1869685708051200:12345-192.168.204.26@tcp:101:dd.0 Request processed in 210us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074109.203376:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1172 00000100:00100000:0.0:1783074109.207612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.207769:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051456 00000100:00100000:1.0:1783074109.207778:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051456 00000100:00100000:1.0:1783074109.207981:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1173 00000100:00100000:1.0:1783074109.207991:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+19:69429:x1869685708051456:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074109.208009:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074109.208011:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783074109.208035:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df659 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b09e expref: 19 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208050:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.208067:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074109.208080:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016df660 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0a5 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208124:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016df667 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208137:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016df667 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208147:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016df667 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074109.208247:0:68632:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x4b1:0x0], count =625 00000004:00080000:1.0:1783074109.208254:0:68632:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x4b1:0x0]+625 in llog 00000004:00080000:1.0:1783074109.208276:0:68632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00000004:00080000:1.0:1783074109.208281:0:68632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x723:0x0], index 0: 0 00010000:00010000:1.0:1783074109.208375:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016df667 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 21 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208392:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.208395:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783074109.208404:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016df660 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 21 pid: 68632 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208418:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016df667 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 20 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.208444:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.208446:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783074109.208448:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6000, rc 0) 00010000:00000080:1.0:1783074109.208455:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c47b7800 x1869685708051456/t111669149709(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 376/608 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.208509:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+20:69429:x1869685708051456:12345-192.168.204.26@tcp:101:dd.0 Request processed in 520us (906us total) trans 111669149709 rc 0/0 00000100:00100000:1.0:1783074109.208515:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1173 00000100:00100000:1.0:1783074109.210999:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074109.211070:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051584 00000100:00100000:2.0:1783074109.211077:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051584 00000100:00100000:2.0:1783074109.211171:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4903 00000100:00100000:2.0:1783074109.211180:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:69429:x1869685708051584:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074109.211203:0:17659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074109.211223:0:17659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df66e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0ac expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074109.211246:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074109.211275:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=2948s v=(0 0) 00010000:00010000:2.0:1783074109.211279:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074109.211288:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df66e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0ac expref: 6 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.211304:0:17659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df66e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0ac expref: 6 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.211335:0:17659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159600, rc 0) 00000100:00100000:2.0:1783074109.211381:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69429:x1869685708051584:12345-192.168.204.26@tcp:101:dd.0 Request processed in 202us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074109.211394:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4903 00000100:00080000:1.0:1783074109.212140:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074109.213725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.213807:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051712 00000100:00100000:1.0:1783074109.213815:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051712 00000100:00100000:1.0:1783074109.213895:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4904 00000100:00100000:1.0:1783074109.213904:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:69429:x1869685708051712:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074109.213916:0:26170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074109.213935:0:26170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c0db4f3/0x5fb609b3016df675 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0b3 expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074109.213964:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074109.213981:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=2948s v=(0 0) 00010000:00010000:1.0:1783074109.213986:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074109.213994:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c0db4f3/0x5fb609b3016df675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0b3 expref: 6 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.214010:0:26170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c0db4f3/0x5fb609b3016df675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0b3 expref: 6 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.214022:0:26170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7a00, rc 0) 00000100:00100000:1.0:1783074109.214075:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69429:x1869685708051712:12345-192.168.204.26@tcp:101:dd.0 Request processed in 172us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074109.214081:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4904 00000100:00080000:0.0:1783074109.214228:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074109.216220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.216292:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051840 00000100:00100000:1.0:1783074109.216299:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051840 00000100:00100000:1.0:1783074109.216364:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4905 00000100:00100000:1.0:1783074109.216373:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69429:x1869685708051840:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074109.216386:0:26177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074109.216403:0:26177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002443102f/0x5fb609b3016df67c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0ba expref: -99 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074109.216423:0:26177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074109.216439:0:26177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=2948s v=(0 0) 00010000:00010000:1.0:1783074109.216443:0:26177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074109.216454:0:26177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002443102f/0x5fb609b3016df67c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0ba expref: 7 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.216469:0:26177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002443102f/0x5fb609b3016df67c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0ba expref: 7 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.216480:0:26177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7000, rc 0) 00000100:00100000:1.0:1783074109.216521:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:69429:x1869685708051840:12345-192.168.204.26@tcp:101:dd.0 Request processed in 149us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074109.216527:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4905 00000100:00100000:1.0:1783074109.218463:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.218495:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074109.218553:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051968 00000100:00100000:0.0:1783074109.218559:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051968 00002000:00010000:0.0:1783074109.218586:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1826 (1048576->18446744073709551615) 00002000:00100000:0.0:1783074109.218591:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c8ff6680 with x1869685708051968 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1783074109.218604:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9524c8ff6680. 00000100:00100000:0.0:1783074109.218628:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708052096 00000100:00100000:0.0:1783074109.218632:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708052096 00002000:00010000:0.0:1783074109.218644:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1827 (0->18446744073709551615) 00002000:00100000:0.0:1783074109.218646:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c8ff5f80 with x1869685708052096 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074109.218652:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524c8ff5f80. 00000100:00100000:0.0:1783074109.218682:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 518 00000100:00100000:0.0:1783074109.218690:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708051968:12345-192.168.204.26@tcp:10:dd.0 00000100:00100000:1.0:1783074109.218853:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 519 00000100:00100000:1.0:1783074109.218861:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708052096:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:0.0:1783074109.218892:0:24841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1783074109.218896:0:24841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb mtime from disk: 0 -> 1783074108 00002000:00010000:0.0:1783074109.218898:0:24841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783074109.218900:0:24841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb ctime from disk: 0 -> 1783074108 00002000:00010000:0.0:1783074109.218903:0:24841:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783074109.218940:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708051968:12345-192.168.204.26@tcp:10:dd.0 Request processed in 250us (481us total) trans 4294968710 rc 0/0 00000100:00100000:0.0:1783074109.218948:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 518 00002000:00010000:1.0:1783074109.218950:0:24854:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074109.218951:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1826 (1048576->18446744073709551615) 00002000:00010000:1.0:1783074109.218953:0:24854:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb mtime from disk: 0 -> 1783074108 00002000:00100000:0.0:1783074109.218953:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c8ff6680 with x1869685708051968 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1783074109.218955:0:24854:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783074109.218958:0:24854:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb ctime from disk: 0 -> 1783074108 00002000:00010000:0.0:1783074109.218958:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9524c8ff6680. 00002000:00010000:1.0:1783074109.218960:0:24854:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783074109.218979:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2405:x1869685708052096:12345-192.168.204.26@tcp:10:dd.0 Request processed in 119us (484us total) trans 4294968715 rc 0/0 00000100:00100000:1.0:1783074109.218986:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 519 00002000:00010000:1.0:1783074109.218989:0:24854:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1827 (0->18446744073709551615) 00002000:00100000:1.0:1783074109.218991:0:24854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c8ff5f80 with x1869685708052096 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074109.218995:0:24854:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524c8ff5f80. 00000100:00100000:0.0:1783074109.249819:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.249885:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708052352 00000100:00100000:1.0:1783074109.249902:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708052352 00000100:00100000:1.0:1783074109.249967:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:1.0:1783074109.249974:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+20:69429:x1869685708052352:12345-192.168.204.26@tcp:35:dd.0 00010000:00000080:1.0:1783074109.250182:0:66203:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f469bb80 x1869685708052352/t111669149710(0) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 392/456 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.250234:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+21:69429:x1869685708052352:12345-192.168.204.26@tcp:35:dd.0 Request processed in 261us (422us total) trans 111669149710 rc 0/0 00000100:00100000:1.0:1783074109.250238:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:0.0:1783074109.261251:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074109.261414:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708052480 00000100:00100000:2.0:1783074109.261425:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708052480 00000100:00100000:2.0:1783074109.261484:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1174 00000100:00100000:2.0:1783074109.261493:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+21:69430:x1869685708052480:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074109.261516:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074109.261537:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0c1 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.261588:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df68a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.261598:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.261606:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074109.261638:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074109.261641:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074109.261654:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.261670:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158e00/0x5fb609b3016df683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0c1 expref: 23 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.261682:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df68a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0c1 expref: 22 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074109.261703:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:2.0:1783074109.261705:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074109.261708:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158000, rc 0) 00010000:00000080:2.0:1783074109.261714:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f469aa00 x1869685708052480/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 576/688 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074109.261871:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+22:69430:x1869685708052480:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 378us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074109.261879:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1174 00000100:00100000:2.0:1783074109.264532:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.264586:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708052736 00000100:00100000:1.0:1783074109.264594:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708052736 00000100:00100000:1.0:1783074109.264643:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1175 00000100:00100000:1.0:1783074109.264650:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+22:69430:x1869685708052736:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074109.264662:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074109.264676:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0c8 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264737:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264750:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264760:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264774:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264781:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264801:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264881:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264889:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264895:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264901:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264908:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.264911:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264919:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264930:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:1.0:1783074109.264933:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.264937:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264943:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016df698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264954:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264965:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264970:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264975:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.264978:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.264995:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.265003:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d0c84f00) 00010000:00010000:1.0:1783074109.265006:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.265009:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.265014:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016df69f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.265045:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df691 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0c8 expref: 23 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.265066:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:1.0:1783074109.265069:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783074109.265073:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0c8 expref: 23 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.265107:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7600, rc 0) 00010000:00000080:1.0:1783074109.265115:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c557c380 x1869685708052736/t0(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 800/608 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.265194:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+22:69430:x1869685708052736:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 542us (667us total) trans 0 rc 301/301 00000100:00100000:1.0:1783074109.265205:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1175 00000100:00100000:0.0:1783074109.267585:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.267672:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708052864 00000100:00100000:1.0:1783074109.267680:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708052864 00000100:00100000:1.0:1783074109.267754:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1176 00000100:00100000:1.0:1783074109.267762:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+22:69430:x1869685708052864:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1783074109.267814:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267825:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267843:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267852:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267857:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267860:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267928:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267934:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267938:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074109.267969:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:1.0:1783074109.267972:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074109.267980:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267991:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.267998:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268004:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268010:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268015:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.268020:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268027:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268045:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:1.0:1783074109.268048:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.268065:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268072:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268086:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268092:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268098:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268103:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.268106:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268112:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268119:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d0c84400) 00010000:00010000:1.0:1783074109.268121:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.268123:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268129:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268157:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268164:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268169:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268175:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.268178:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268183:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268191:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.268194:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.268197:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.268203:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6b4 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1783074109.268222:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c8ffca80 x1869685708052864/t0(0) o34->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 472/728 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.268283:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+22:69430:x1869685708052864:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 521us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074109.268291:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1176 00000100:00100000:2.0:1783074109.281670:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.282902:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708053120 00000100:00100000:1.0:1783074109.282926:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708053120 00000100:00100000:1.0:1783074109.283015:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1177 00000100:00100000:1.0:1783074109.283026:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+22:69432:x1869685708053120:12345-192.168.204.26@tcp:101:md5sum.0 00010000:00010000:1.0:1783074109.283063:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074109.283083:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0cf expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283153:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283167:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283178:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283192:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283200:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283208:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283324:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df6d0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283335:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df6d0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283343:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df6d0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074109.283359:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:1.0:1783074109.283432:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283440:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283446:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283453:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283458:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.283462:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283469:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283481:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:1.0:1783074109.283484:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.283488:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283494:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016df6c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283510:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283526:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283532:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283536:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074109.283540:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283546:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283554:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d0c84400) 00010000:00010000:1.0:1783074109.283557:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074109.283559:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283565:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016df6c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283617:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016df6bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0cf expref: 25 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283632:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df6d0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0cf expref: 24 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074109.283640:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:1.0:1783074109.283642:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074109.283649:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7600, rc 0) 00010000:00000080:1.0:1783074109.283656:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c557f100 x1869685708053120/t111669149711(0) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 800/872 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.283720:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+24:69432:x1869685708053120:12345-192.168.204.26@tcp:101:md5sum.0 Request processed in 697us (2057us total) trans 111669149711 rc 0/0 00000100:00100000:1.0:1783074109.283728:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1177 00000100:00100000:2.0:1783074109.290178:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074109.290236:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708053248 00000100:00100000:3.0:1783074109.290245:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708053248 00002000:00100000:3.0:1783074109.290289:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff9523c557ed80 x1869685708053248/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 488/0 e 0 to 0 dl 1783074120 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074109.290299:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c557ed80 with x1869685708053248 ext(0->32767) 00002000:00010000:3.0:1783074109.290305:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c557ed80 00000100:00100000:3.0:1783074109.290354:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 520 00000100:00100000:3.0:1783074109.290363:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2405:x1869685708053248:12345-192.168.204.26@tcp:3:md5sum.0 00000100:00100000:3.0:1783074109.292000:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2405:x1869685708053248:12345-192.168.204.26@tcp:3:md5sum.0 Request processed in 1624us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074109.292011:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 520 00002000:00100000:3.0:1783074109.292021:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff9523c557ed80 x1869685708053248/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 488/440 e 0 to 0 dl 1783074120 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074109.292047:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c557ed80 with x1869685708053248 ext(0->32767) 00002000:00010000:3.0:1783074109.292063:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c557ed80 00000100:00100000:2.0:1783074109.296529:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074109.296630:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708053376 00000100:00100000:3.0:1783074109.296641:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708053376 00002000:00100000:3.0:1783074109.296680:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff9523c557c000 x1869685708053376/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 488/0 e 0 to 0 dl 1783074120 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074109.296692:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c557c000 with x1869685708053376 ext(32768->1048575) 00002000:00010000:3.0:1783074109.296697:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c557c000 00000100:00100000:3.0:1783074109.296736:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 521 00000100:00100000:3.0:1783074109.296745:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2404:x1869685708053376:12345-192.168.204.26@tcp:3:md5sum.0 00000100:00100000:3.0:1783074109.300157:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2404:x1869685708053376:12345-192.168.204.26@tcp:3:md5sum.0 Request processed in 3404us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074109.300171:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 521 00002000:00100000:3.0:1783074109.300183:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff9523c557c000 x1869685708053376/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 488/440 e 0 to 0 dl 1783074120 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074109.300193:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c557c000 with x1869685708053376 ext(32768->1048575) 00002000:00010000:3.0:1783074109.300199:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c557c000 00000100:00100000:0.0:1783074109.311542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074109.311670:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708053632 00000100:00100000:1.0:1783074109.311680:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708053632 00000100:00100000:1.0:1783074109.311766:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:1.0:1783074109.311777:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+24:69432:x1869685708053632:12345-192.168.204.26@tcp:35:md5sum.0 00010000:00000080:1.0:1783074109.312013:0:66204:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c8fff800 x1869685708053632/t111669149712(0) o35->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 392/456 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074109.312094:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+25:69432:x1869685708053632:12345-192.168.204.26@tcp:35:md5sum.0 Request processed in 319us (560us total) trans 111669149712 rc 0/0 00000100:00100000:1.0:1783074109.312101:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:2.0:1783074109.326948:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074109.327812:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708053760 00000100:00100000:0.0:1783074109.327822:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708053760 00000100:00100000:0.0:1783074109.327893:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1178 00000100:00100000:0.0:1783074109.327905:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+25:69434:x1869685708053760:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:0.0:1783074109.327988:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328004:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328016:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328030:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328038:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328046:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328136:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328146:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328154:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074109.328194:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1783074109.328198:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074109.328209:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328234:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328247:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328253:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328259:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328264:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074109.328268:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328276:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328288:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:0.0:1783074109.328292:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074109.328296:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328302:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016df6de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328354:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328362:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328368:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328380:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074109.328383:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328390:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328610:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d2de4300) 00010000:00010000:0.0:1783074109.328613:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074109.328617:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328623:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016df6e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328638:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328645:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328650:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328655:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074109.328657:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328664:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328690:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074109.328692:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074109.328695:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074109.328701:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016df6ec lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1783074109.328724:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f0918a80 x1869685708053760/t0(0) o34->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:435/0 lens 472/728 e 0 to 0 dl 1783074120 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074109.328794:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+25:69434:x1869685708053760:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 892us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074109.328802:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1178 00010000:00010000:3.0:1783074110.062418:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783074110.337609:0:90302:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783074110.337661:0:90302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.337675:0:90302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.337681:0:90302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.337688:0:90302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.337752:0:90302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783074110.337771:0:90302:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783074110.337794:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074110.337799:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783074110.337804:0:90302:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783074110.337828:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783074110.338072:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723534208:0@lo:39:umount.0 00000100:00100000:3.0:1783074110.338142:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074110.338201:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783074110.338276:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534208 00000100:00100000:2.0:1783074110.338284:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534208 00000100:00100000:2.0:1783074110.338355:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1783074110.338365:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723534208:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783074110.338437:0:68632:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df31f 00000100:00080000:2.0:1783074110.338451:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b5000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1783074110.338479:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c1500 x1869685723534208/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:436/0 lens 224/224 e 0 to 0 dl 1783074121 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074110.338485:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074110.338526:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869685723534208:12345-0@lo:39:umount.0 Request processed in 162us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074110.338534:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000020:00000080:2.0:1783074110.338544:0:68632:0:(genops.c:906:class_export_put()) final put ffff9524fb6b3800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1783074110.338562:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783074110.338576:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723534208:0@lo:39:umount.0 00000100:00080000:2.0:1783074110.338595:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074110.338599:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783074110.338603:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783074110.338803:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb6b3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074110.338865:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb6b5000 for lustre-MDT0000 00010000:00010000:1.0:1783074110.339599:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.339608:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074110.339612:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.339939:0:90302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.339948:0:90302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.339955:0:90302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.339975:0:90302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.339987:0:90302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074110.339993:0:90302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340000:0:90302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340006:0:90302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340012:0:90302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340022:0:90302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783074110.340028:0:90302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340150:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074110.340161:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340168:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074110.340171:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340179:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074110.340186:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074110.340191:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783074110.340194:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783074110.340217:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340223:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074110.340243:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340250:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52600/0x5fb609b3016df120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df127 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340261:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074110.340427:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074110.340433:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074110.340445:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074110.340447:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783074110.340449:0:8460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783074110.340466:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340471:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074110.340478:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340484:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52800/0x5fb609b3016df200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df207 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340495:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074110.340497:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074110.340499:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.340506:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340515:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074110.340518:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340531:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074110.340537:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074110.340543:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074110.340556:0:90302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340563:0:90302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340569:0:90302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340674:0:90302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074110.340682:0:90302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340689:0:90302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340695:0:90302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074110.340701:0:90302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340727:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074110.340731:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340737:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074110.340740:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340748:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074110.340755:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074110.340770:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783074110.340773:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783074110.340775:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783074110.340788:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340793:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074110.340819:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340826:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086c600/0x5fb609b3016df1f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df1f9 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340836:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074110.340840:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340845:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074110.340848:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340854:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074110.340861:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:00010000:1.0:1783074110.340861:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074110.340867:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:1.0:1783074110.340871:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074110.340874:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1783074110.340888:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340891:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340896:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074110.340906:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340906:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074110.340915:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.340917:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868a00/0x5fb609b3016df22a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df231 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.340932:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074110.340936:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074110.340938:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.340940:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.340943:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.340946:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.340954:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074110.340955:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723534720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074110.340966:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723534336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074110.341007:0:90302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074110.341012:0:90302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52c00/0x5fb609b3016df112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df119 expref: -99 pid: 88937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074110.341017:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723534592:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1783074110.341023:0:90302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1783074110.341028:0:90302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1783074110.341040:0:90302:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1783074110.341073:0:90302:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783074110.341078:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1783074110.341082:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1783074110.341087:0:90302:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:1.0:1783074110.342923:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074110.342957:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074110.342991:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074110.343019:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534720 00000100:00100000:0.0:1783074110.343037:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534720 00000100:00100000:0.0:1783074110.343085:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534592 00000100:00100000:0.0:1783074110.343088:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534592 00000100:00100000:0.0:1783074110.343112:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1783074110.343119:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3661:x1869685723534720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074110.343133:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074110.343150:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53a00/0x5fb609b3016df231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df22a expref: 25 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.343174:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074110.343209:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723534720:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074110.343215:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1783074110.343230:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1783074110.343236:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e03d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3660:x1869685723534592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074110.343242:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074110.343251:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53e00/0x5fb609b3016df1f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df1f2 expref: 23 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.343259:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074110.343416:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e03d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3660:x1869685723534592:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074110.343423:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1783074110.343493:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723534592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074110.343517:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723534720:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1783074110.343744:0:90302:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1783074110.344168:0:88938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00000020:00000080:2.0:1783074110.344287:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783074110.344293:0:90302:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9523c6946800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074110.344298:0:90302:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524fb6b4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783074110.344361:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344370:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344378:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344384:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074110.344395:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344405:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074110.344415:0:90302:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524f7811800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074110.344421:0:90302:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c6e2c800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783074110.344423:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0b7d000) 00010000:00010000:0.0:1783074110.344428:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1783074110.344429:0:90302:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c6e2d000 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 192.168.204.26@tcp 15 (0 0 7) 0 0 0 2: ffff9524e40e7000 111669149712 stale:0 00010000:00010000:0.0:1783074110.344434:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074110.344437:0:90302:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9524f3da4d40) has exports, disconnecting them 00010000:00010000:0.0:1783074110.344445:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016df5c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074110.344446:0:90302:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9523c6946800), last request at 1783074095 00000020:00000080:2.0:1783074110.344455:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df318 00000100:00080000:2.0:1783074110.344464:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9523c6946000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783074110.344466:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344474:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344479:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074110.344483:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c6946800): rc 0 00010000:00010000:0.0:1783074110.344487:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc186d4f0) 00000020:00000080:2.0:1783074110.344488:0:90302:0:(genops.c:906:class_export_put()) final put ffff9523c6946800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1783074110.344493:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344500:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074110.344501:0:90302:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524fb6b4000), last request at 1783074105 00000020:00000080:2.0:1783074110.344507:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df311 00000100:00080000:2.0:1783074110.344514:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b6000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783074110.344515:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0b7d000) 00010000:00010000:0.0:1783074110.344520:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1783074110.344527:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524fb6b4000): rc 0 00010000:00010000:0.0:1783074110.344530:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074110.344532:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524fb6b4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783074110.344540:0:90302:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524f7811800), last request at 1783074105 00010000:00010000:0.0:1783074110.344541:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016df5fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074110.344545:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df30a 00000100:00080000:2.0:1783074110.344552:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524fc200800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074110.344564:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524f7811800): rc 0 00000020:00000080:2.0:1783074110.344567:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f7811800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1783074110.344567:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074110.344575:0:90302:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c6e2c800), last request at 1783074090 00010000:00010000:0.0:1783074110.344580:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074110.344584:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df174 00010000:00010000:0.0:1783074110.344591:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783074110.344594:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9523c6943000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783074110.344600:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074110.344604:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344610:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344617:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074110.344619:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074110.344622:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344628:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7e00/0x5fb609b3016df652 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783074110.344653:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6946800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1783074110.344656:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c6e2c800): rc 0 00000020:00000080:2.0:1783074110.344660:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c6e2c800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1783074110.344673:0:90302:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.26@tcp (ffff9524c6e2d000), last request at 1783074109 00000020:00000080:2.0:1783074110.344678:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df16d 00000020:00010000:2.0:1783074110.344691:0:90302:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524c6e2d000: total 4 00000100:00080000:2.0:1783074110.344695:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524fb73f800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783074110.344701:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb6b4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1783074110.344703:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524c6e2d000): rc 0 00000004:00000080:2.0:1783074110.344712:0:90302:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd3bc21ffae0 00000100:00080000:2.0:1783074110.344729:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:0.0:1783074110.344730:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7811800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1783074110.344732:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:0.0:1783074110.344778:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6946000 for lustre-MDT0000 00000020:00000080:0.0:1783074110.344784:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6e2c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783074110.344806:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb6b6000 for lustre-MDT0000 00000020:00000080:0.0:1783074110.344811:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fc200800 for lustre-MDT0000 00000020:00000080:0.0:1783074110.344815:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6943000 for lustre-MDT0000 00000020:00010000:0.0:1783074110.344838:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524c6e2d000: total 0 00010000:00010000:0.0:1783074110.344841:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074110.344877:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524c6e2d000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1783074110.344903:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016df55d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b058 expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344920:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7200/0x5fb609b3016df54f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b04a expref: 7 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344936:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158a00/0x5fb609b3016df64b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b097 expref: 6 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344950:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016df667 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 5 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.344971:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158000/0x5fb609b3016df68a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0c1 expref: 4 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.345056:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6800/0x5fb609b3016df556 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b051 expref: 3 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.345079:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016df6d0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0cf expref: 2 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074110.345108:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524c6e2d000, canceled 7 locks, left on hash table 0. 00000100:00100000:3.0:1783074110.345469:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074110.345527:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723534848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074110.345554:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074110.345574:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074110.345580:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723534464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074110.345604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074110.345771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534336 00000100:00100000:3.0:1783074110.345777:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534336 00000100:00100000:3.0:1783074110.345808:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534848 00000100:00100000:3.0:1783074110.345810:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534848 00000100:00100000:3.0:1783074110.345824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534464 00000100:00100000:3.0:1783074110.345826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534464 00000100:00100000:3.0:1783074110.345842:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1783074110.345848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723534336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074110.345859:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074110.345870:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53800/0x5fb609b3016df127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df120 expref: 24 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.345883:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074110.345919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723534336:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074110.345925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1783074110.345939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1783074110.345945:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3658:x1869685723534848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074110.345952:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074110.345959:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0868e00/0x5fb609b3016df119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df112 expref: 22 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.345969:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074110.345990:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3658:x1869685723534848:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (435us total) trans 0 rc 0/0 00000100:00080000:2.0:1783074110.346349:0:90302:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783074110.346369:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783074110.346476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1783074110.346491:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1783074110.346504:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3658:x1869685723534464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074110.346511:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074110.346520:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0869400/0x5fb609b3016df207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df200 expref: 20 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074110.346530:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074110.346562:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3658:x1869685723534464:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074110.346569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00010000:00010000:3.0:1783074110.346594:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.346601:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074110.346622:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723534464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074110.346631:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723534336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074110.346638:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723534848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074110.346874:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074110.346894:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723534976:0@lo:39:umount.0 00000100:00100000:1.0:1783074110.346930:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074110.346960:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723534976 00000100:00100000:1.0:1783074110.346964:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723534976 00000100:00100000:1.0:1783074110.346993:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3644 00000100:00100000:1.0:1783074110.347000:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723534976:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783074110.347023:0:8453:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1a5 00000100:00080000:1.0:1783074110.347042:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9524c4406800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1783074110.347122:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783074110.347126:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968714 gen 3 00000004:00080000:2.0:1783074110.347137:0:90302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783074110.347194:0:90302:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783074110.347268:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783074110.347279:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783074110.347282:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968709 gen 3 00000004:00080000:2.0:1783074110.347289:0:90302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:1.0:1783074110.347703:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411440 00000100:00100000:1.0:1783074110.347832:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3657:x1869685723534976:12345-0@lo:39:umount.0 Request processed in 831us (901us total) trans 77309411441 rc 0/0 00000100:00100000:1.0:1783074110.347840:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3644 00000100:00100000:1.0:1783074110.347867:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723535104:0@lo:9:umount.0 00000100:00100000:1.0:1783074110.347892:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074110.347931:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783074110.347938:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723534976:0@lo:39:umount.0 00000100:00100000:1.0:1783074110.347956:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535104 00000100:00100000:1.0:1783074110.347960:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535104 00000100:00100000:1.0:1783074110.347995:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:1.0:1783074110.348003:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723535104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783074110.348019:0:26174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1c8 00000100:00080000:1.0:1783074110.348025:0:26174:0:(import.c:65:import_set_state_nolock()) ffff9524debeb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783074110.348073:0:26174:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968715 00000100:00100000:1.0:1783074110.348151:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723535104:12345-0@lo:9:umount.0 Request processed in 149us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074110.348158:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00000100:00080000:1.0:1783074110.348181:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783074110.348185:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783074110.348186:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074110.348189:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723535104:0@lo:9:umount.0 00000100:00080000:2.0:1783074110.348467:0:90302:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783074110.348479:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9523c4b62000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783074110.348524:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f3da4d40) has no exports 00000100:00100000:1.0:1783074110.348605:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723535232:0@lo:9:umount.0 00000100:00100000:1.0:1783074110.348691:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074110.348728:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074110.348827:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535232 00000100:00100000:2.0:1783074110.348832:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535232 00010000:00010000:3.0:1783074110.348842:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074110.348849:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074110.348871:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907 00000100:00100000:2.0:1783074110.348879:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723535232:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783074110.348893:0:26166:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1dd 00000100:00080000:2.0:1783074110.348900:0:26166:0:(import.c:65:import_set_state_nolock()) ffff9523c6945000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783074110.348929:0:26166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968710 00000100:00100000:2.0:1783074110.349023:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723535232:12345-0@lo:9:umount.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000020:00080000:3.0:1783074110.349147:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f3da4d40) has no exports 00000100:00080000:1.0:1783074110.349384:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783074110.349390:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783074110.349408:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4b62000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783074110.349417:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783074110.349418:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074110.349421:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723535232:0@lo:9:umount.0 00000100:00100000:2.0:1783074110.349892:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907 00000020:00000080:0.0:1783074110.408614:0:6518:0:(genops.c:906:class_export_put()) final put ffff9524c6e2d000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00010000:00010000:0.0:1783074110.408722:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074110.408725:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074110.408728:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074110.408752:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6e2d000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-MDT0000 00000020:00000080:1.0:1783074110.408862:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb73f800 for lustre-MDT0000 00000020:00000080:3.0:1783074110.427093:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df189 00000020:00000080:3.0:1783074110.427107:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c783a800/lustre-QMT0000_UUID 00000020:01000000:3.0:1783074110.427124:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783074110.427238:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c783a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783074110.427253:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074110.427268:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783074110.427273:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9523c2c33380) has no exports 00000020:00000080:2.0:1783074110.427923:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df182 00000020:00000080:2.0:1783074110.427930:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c86b3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074110.427990:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074110.427999:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783074110.428002:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c5fdc800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783074110.428005:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c5fdc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783074110.428012:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1783074110.428201:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c86b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783074110.428475:0:90302:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c33efb40 - data ffff9524fbdc5948/ffff9523c8733400 00000020:01000000:2.0:1783074110.428734:0:90302:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524fb756480 - data ffff9524df91c870/ffff9524f41a1c00 00000100:00080000:3.0:1783074110.467976:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783074110.467985:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783074110.467999:0:90302:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9523c53fb800 x1869685723534976/t77309411441(77309411441) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074120 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074110.468025:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783074110.469115:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783074110.469119:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968714 gen 4 00000004:00080000:3.0:1783074110.469138:0:90302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074110.469140:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783074110.469583:0:88955:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783074110.469588:0:88955:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:0.0:1783074110.469597:0:88955:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:3.0:1783074110.470185:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783074110.470189:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968709 gen 4 00000004:00080000:3.0:1783074110.470207:0:90302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074110.470209:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783074110.470754:0:88957:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783074110.470758:0:88957:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:0.0:1783074110.470765:0:88957:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:3.0:1783074110.471747:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df13c 00000020:00000080:3.0:1783074110.471783:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f7817800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074110.471834:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7817800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074110.472797:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df151 00000020:00000080:3.0:1783074110.472804:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524d2eae000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783074110.472855:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783074110.472861:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074110.472870:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783074110.472879:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9524f3da0000) has no exports 00000004:01000000:3.0:1783074110.473074:0:90302:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783074110.473082:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1d6 00000020:00000080:3.0:1783074110.473086:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c7838000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074110.473328:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2eae000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783074110.473407:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783074110.473413:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074110.473421:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783074110.473424:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9523c2c34d40) has no exports 00000020:00000080:3.0:1783074110.473430:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1cf 00000020:00000080:3.0:1783074110.473434:0:90302:0:(genops.c:906:class_export_put()) final put ffff9523c4b65800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074110.473456:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c7838000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783074110.473843:0:90302:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783074110.473848:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783074110.473852:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968709 gen 5 00000004:00080000:3.0:1783074110.473857:0:90302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074110.473859:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074110.473955:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4b65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783074110.474068:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074110.474077:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074110.474082:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1ba 00000020:00000080:3.0:1783074110.474087:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f7814800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783074110.474090:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783074110.474103:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074110.474108:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783074110.474111:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9523c2c319c0) has no exports 00000020:00000080:3.0:1783074110.474115:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df1b3 00000020:00000080:3.0:1783074110.474118:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c4b3b000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783074110.474465:0:90302:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783074110.474468:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783074110.474471:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968714 gen 5 00000004:00080000:3.0:1783074110.474474:0:90302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074110.474475:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783074110.474503:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074110.474509:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783074110.474519:0:90302:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783074110.474524:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df19e 00000020:00000080:3.0:1783074110.474528:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f7813800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783074110.474533:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783074110.474536:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074110.474541:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783074110.474543:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9524fa864d40) has no exports 00000020:00000080:3.0:1783074110.474552:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df197 00000020:00000080:3.0:1783074110.474555:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524ee2c0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074110.474687:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c4b62000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783074110.474694:0:53092:0:(genops.c:906:class_export_put()) final put ffff9524f49fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074110.474697:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f49fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783074110.474702:0:53092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074110.474782:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7814800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783074110.474787:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4b3b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074110.474790:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c4b3a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783074110.474794:0:53092:0:(genops.c:906:class_export_put()) final put ffff9524f7812000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074110.474796:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7812000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783074110.474800:0:53092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074110.474843:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7813800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783074110.474859:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783074110.479394:0:90302:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783074110.479408:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074110.479412:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074110.479420:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074110.479628:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074110.479642:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074110.479697:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074110.479702:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074110.479707:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f7816800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074110.479710:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7816800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783074110.479717:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074110.479819:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df15f 00000020:00000080:0.0:1783074110.479826:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524d2ead800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783074110.480143:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c5000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783074110.480150:0:53092:0:(genops.c:906:class_export_put()) final put ffff9524f7812800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074110.480152:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7812800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783074110.480161:0:53092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783074110.480399:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783074110.480452:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ead800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783074110.480464:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074110.480471:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783074110.480475:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9524e69d0000) has no exports 00000020:00000080:1.0:1783074110.480502:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074110.480507:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783074110.480510:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f088e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783074110.480513:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f088e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783074110.480520:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783074110.480601:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df166 00000020:00000080:1.0:1783074110.480609:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524d2eaa000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783074110.480624:0:90302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524f49fa800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783074110.480628:0:90302:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49fa800 3 00000020:01000004:1.0:1783074110.480631:0:90302:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524f49fa800 from lustre-MDT0000 00000020:00000080:0.0:1783074110.480660:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2eaa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783074110.480723:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074110.480728:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783074110.480731:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524f7810000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783074110.480734:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7810000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783074110.480740:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783074110.480774:0:90302:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783074110.480777:0:90302:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783074110.480780:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783074110.480783:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074110.480785:0:90302:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783074110.480793:0:90302:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524c3569800 da924155-7591-4a6a-a2d2-c0d2908d0bfb 192.168.204.26@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074110.480799:0:90302:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524fc207800 522b6a34-04f4-4017-ab45-61a21d19bfef 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074110.480812:0:90302:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9524fb4d99c0) has exports, disconnecting them 00000020:00080000:1.0:1783074110.480816:0:90302:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.26@tcp (ffff9524c3569800), last request at 1783074090 00000020:00000080:1.0:1783074110.480835:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df223 00000020:00010000:1.0:1783074110.480840:0:90302:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524c3569800: total 0 00000100:00080000:1.0:1783074110.480844:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524c356e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074110.480864:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524c3569800): rc 0 00000020:00080000:1.0:1783074110.480868:0:90302:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9524fc207800), last request at 1783074090 00000020:00000080:1.0:1783074110.481008:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df104 00000020:00010000:1.0:1783074110.481013:0:90302:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524fc207800: total 0 00000100:00080000:1.0:1783074110.481017:0:90302:0:(import.c:65:import_set_state_nolock()) ffff9524fc200000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074110.481038:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524fc207800): rc 0 00000020:00080000:1.0:1783074110.481047:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9524fb4d99c0) has no exports 00000100:00100000:1.0:1783074110.481117:0:88944:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9523c1d5c600:88944] 1 exiting: rc = 0 00000100:00100000:1.0:1783074110.481199:0:88945:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9523c2de9600:88945] 2 exiting: rc = 0 00000100:00100000:1.0:1783074110.481255:0:88947:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9523c46a5e00:88947] 3 exiting: rc = 0 00000020:00010000:0.0:1783074110.481372:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524c3569800: total 0 00000100:00100000:2.0:1783074110.481375:0:88943:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9523c2de8400:88943] 0 exiting: rc = 1 00010000:00010000:1.0:1783074110.481447:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524c3569800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783074110.481495:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d800/0x5fb609b3016df2f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b027 expref: 5 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481517:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086da00/0x5fb609b3016df303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b035 expref: 4 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481531:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c000/0x5fb609b3016df2fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b02e expref: 3 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481544:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa52e00/0x5fb609b3016df2ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b020 expref: 2 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481553:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524c3569800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783074110.481586:0:6517:0:(genops.c:906:class_export_put()) final put ffff9524c3569800/da924155-7591-4a6a-a2d2-c0d2908d0bfb 00000020:00010000:1.0:1783074110.481656:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524fc207800: total 1 00010000:00010000:1.0:1783074110.481681:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524fc207800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783074110.481698:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0868200/0x5fb609b3016df285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df27e expref: 14 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481711:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc400/0x5fb609b3016df293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df28c expref: 13 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481721:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa53000/0x5fb609b3016df2a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df29a expref: 12 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481732:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0869200/0x5fb609b3016df2af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df2a8 expref: 11 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481742:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d400/0x5fb609b3016df23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df238 expref: 10 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481751:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f0868800/0x5fb609b3016df24d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df246 expref: 9 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481763:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd800/0x5fb609b3016df2cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df2c4 expref: 8 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481774:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa52400/0x5fb609b3016df25b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df254 expref: 7 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481783:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bce00/0x5fb609b3016df2bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df2b6 expref: 6 pid: 88947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481791:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd400/0x5fb609b3016df277 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df270 expref: 5 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481811:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d600/0x5fb609b3016df2d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df2d2 expref: 4 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481829:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc000/0x5fb609b3016df269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df262 expref: 3 pid: 88945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481846:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524faa52a00/0x5fb609b3016df2e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df2e0 expref: 2 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074110.481859:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524fc207800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783074110.481873:0:6517:0:(genops.c:906:class_export_put()) final put ffff9524fc207800/522b6a34-04f4-4017-ab45-61a21d19bfef 00010000:00010000:1.0:1783074110.481879:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074110.481880:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074110.481882:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074110.481909:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.481916:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.481922:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.481929:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.481935:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.481941:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482010:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482023:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482036:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482042:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482047:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482052:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482057:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482063:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482069:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482075:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482085:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482098:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482103:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482109:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482114:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482120:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482125:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482130:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482135:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482141:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482146:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482152:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482157:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482162:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482168:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482173:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482178:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482184:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482195:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482200:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482206:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482211:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482216:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482221:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482226:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482231:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482237:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482242:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482247:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482252:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482257:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482262:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482267:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482273:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482278:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482283:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482296:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482301:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482306:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482333:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482340:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482346:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482352:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482357:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482362:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482367:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482372:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074110.482377:0:90302:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783074110.482524:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c3569800/da924155-7591-4a6a-a2d2-c0d2908d0bfb for MGS 00000020:00000080:0.0:1783074110.482553:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc207800/522b6a34-04f4-4017-ab45-61a21d19bfef for MGS 00000020:00000080:0.0:1783074110.482569:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c356e000 for MGS 00000020:00000080:0.0:1783074110.482574:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fc200000 for MGS 00010000:00010000:0.0:1783074110.483449:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783074110.483699:0:90302:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c45a1de0 - data ffff9524d37a1510/ffff9524c8bce800 00000020:01000000:1.0:1783074110.483899:0:90302:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524f4775180 - data ffff9524dfb7ee58/ffff9524fc3b2c00 00000020:00000080:1.0:1783074110.484525:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df0fd 00000020:00000080:1.0:1783074110.484533:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c4403800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783074110.484541:0:90302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524f49fa800 from MGS, refs=2 00000020:01000004:1.0:1783074110.484544:0:90302:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49fa800 2 00000020:01000004:1.0:1783074110.484546:0:90302:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524f49fa800 from MGS 00000020:00000080:1.0:1783074110.484563:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074110.484569:0:90302:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783074110.484572:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c4405800/MGS 00000020:00000080:1.0:1783074110.484574:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4405800/MGS for MGS 00000020:01000000:1.0:1783074110.484589:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783074110.484670:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783074110.484674:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074110.484683:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783074110.484689:0:90302:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9523c4e79800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074110.484694:0:90302:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9523c2284d40) has exports, disconnecting them 00000020:00080000:1.0:1783074110.484698:0:90302:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9523c4e79800), last request at 1783074090 00000020:00000080:1.0:1783074110.484702:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df215 00000020:00080000:1.0:1783074110.484711:0:90302:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c4e79800): rc 0 00000020:00000080:1.0:1783074110.484723:0:90302:0:(genops.c:906:class_export_put()) final put ffff9523c4e79800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783074110.484834:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4403800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074110.484850:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e79800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783074110.487092:0:90302:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783074110.487101:0:90302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074110.487105:0:90302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074110.487111:0:90302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074110.487133:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c4e7a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783074110.487262:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074110.487273:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783074110.487277:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524debee000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783074110.487280:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524debee000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783074110.487285:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783074110.487368:0:90302:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f49fa800 1 00000020:00000080:0.0:1783074110.487374:0:90302:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df0ef 00000020:00000080:0.0:1783074110.487380:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524c4404000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783074110.487389:0:90302:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783074110.487397:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4404000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074110.487419:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074110.487422:0:90302:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783074110.487426:0:90302:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9524f3da3380) has no exports 00000020:00000080:2.0:1783074110.528267:0:90302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074110.528279:0:90302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783074110.528285:0:90302:0:(genops.c:906:class_export_put()) final put ffff9524fc3c4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074110.528290:0:90302:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783074110.528301:0:90302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783074110.528439:0:90302:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524fc3c2000 00000020:02000400:2.0:1783074110.528495:0:90302:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1783074110.895112:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723535488:0@lo:400:kworker.0 00000400:00000100:2.0:1783074110.895170:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723535488 offset 0 length 224: 4 00000100:00100000:2.0:1783074110.895216:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723536000:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895251:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895291:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723536512:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895336:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895355:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783074110.895361:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723535616:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895397:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895412:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723536128:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895433:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895460:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536000 00000100:00100000:2.0:1783074110.895466:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536000 00000100:00100000:2.0:1783074110.895509:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536512 00000100:00100000:2.0:1783074110.895512:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536512 00000100:00100000:2.0:1783074110.895530:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535616 00000100:00100000:2.0:1783074110.895532:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535616 00000100:00100000:2.0:1783074110.895544:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1783074110.895552:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723536000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895598:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723536000:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074110.895604:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1783074110.895618:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1783074110.895623:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1869685723536512:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783074110.895628:0:66201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783074110.895651:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1869685723536512:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074110.895656:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1783074110.895667:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1783074110.895728:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723535360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074110.895749:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1869685723535616:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783074110.895755:0:66201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074110.895757:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895777:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1869685723535616:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074110.895777:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723535872:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895783:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1783074110.895797:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895803:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536128 00000100:00100000:0.0:1783074110.895811:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723536384:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895812:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536128 00000100:00100000:0.0:1783074110.895832:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895834:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535360 00000100:00100000:2.0:1783074110.895836:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535360 00000100:00100000:2.0:1783074110.895850:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3645 00000100:00100000:0.0:1783074110.895850:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783074110.895854:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1869685723536128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074110.895855:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723535744:0@lo:400:kworker.0 00000020:00080000:2.0:1783074110.895859:0:23954:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074110.895875:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895879:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1869685723536128:12345-0@lo:400:kworker.0 Request processed in 24us (445us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074110.895884:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3645 00000100:00100000:0.0:1783074110.895888:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723536256:0@lo:400:kworker.0 00000100:00100000:2.0:1783074110.895895:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3646 00000100:00100000:2.0:1783074110.895899:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1869685723535360:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783074110.895903:0:23954:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074110.895905:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074110.895919:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1869685723535360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 19us (160us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074110.895924:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3646 00000100:02020000:0.0:1783074110.895930:0:3659:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1783074110.895935:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783074110.895938:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074110.895939:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1783074110.895947:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535872 00000100:00100000:2.0:1783074110.895950:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535872 00000100:02000400:0.0:1783074110.895950:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074110.895955:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074110.895958:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2934 00000100:00100000:2.0:1783074110.895959:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535744 00000100:00100000:2.0:1783074110.895961:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535744 00000100:00080000:0.0:1783074110.895964:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074110.895977:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1783074110.895982:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723535744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074110.895986:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c2141500 x1869685723536640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074110.896010:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723535744:12345-0@lo:400:kworker.0 Request processed in 29us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074110.896016:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1783074110.896033:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723535744:0@lo:400:kworker.0 00000100:00100000:3.0:1783074110.896037:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1783074110.896047:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1869685723535872:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783074110.896054:0:66202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1783074110.896064:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074110.896067:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536384 00000100:00100000:0.0:1783074110.896070:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536384 00000100:00080000:2.0:1783074110.896085:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783074110.896089:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783074110.896097:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783074110.896101:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074110.896103:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2934 00000100:00100000:0.0:1783074110.896105:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536256 00000100:00080000:2.0:1783074110.896108:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074110.896108:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536256 00000100:00100000:2.0:1783074110.896122:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6ce9880 x1869685723536768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074110.896129:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1869685723535872:12345-0@lo:400:kworker.0 Request processed in 80us (328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074110.896130:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1783074110.896140:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723535616:0@lo:400:kworker.0 00000100:00100000:0.0:1783074110.896141:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723536384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074110.896144:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:2.0:1783074110.896157:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783074110.896161:0:3660:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9524f0d24800 already not connected (conn 41, was 40): CONNECTING 00000100:00100000:2.0:1783074110.896166:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723536128:0@lo:400:kworker.0 00000100:00100000:3.0:1783074110.896179:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1783074110.896180:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723536000:0@lo:400:kworker.0 00000100:00100000:0.0:1783074110.896180:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723536384:12345-0@lo:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074110.896189:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00080000:2.0:1783074110.896193:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1783074110.896194:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723536256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074110.896197:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783074110.896202:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783074110.896206:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074110.896208:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2934 00000100:00080000:2.0:1783074110.896212:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074110.896228:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6ce8e00 x1869685723536896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074110.896239:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723536512:0@lo:400:kworker.0 00000100:00100000:3.0:1783074110.896244:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723536256:12345-0@lo:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074110.896259:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00080000:2.0:1783074110.896266:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074110.896271:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074110.896291:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723536256:0@lo:400:kworker.0 00000100:00080000:3.0:1783074110.896303:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783074110.896306:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783074110.896341:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783074110.896345:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074110.896348:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2934 00000100:00080000:3.0:1783074110.896352:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074110.896367:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c458b480 x1869685723537024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074110.896377:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723535872:0@lo:400:kworker.0 00000100:00100000:3.0:1783074110.896389:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723536384:0@lo:400:kworker.0 00000100:00100000:1.0:1783074110.896675:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723536640:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783074110.896703:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074110.896731:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723536768:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783074110.896753:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074110.896780:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723536896:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783074110.896798:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074110.896813:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723537024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783074110.896832:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074110.896857:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536768 00000100:00100000:1.0:1783074110.896862:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536768 00000100:00100000:1.0:1783074110.896879:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536896 00000100:00100000:1.0:1783074110.896882:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536896 00000100:00100000:1.0:1783074110.896893:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537024 00000100:00100000:1.0:1783074110.896895:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537024 00000100:00100000:1.0:1783074110.896907:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1783074110.896912:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723536768:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1783074110.896928:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074110.896957:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723536768:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074110.896963:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1783074110.896974:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1783074110.896978:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723536896:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1783074110.896987:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074110.897011:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723536896:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074110.897029:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723536640 00000100:00100000:3.0:1783074110.897035:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723536640 00000100:00100000:1.0:1783074110.897040:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1783074110.897064:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3647 00000100:00100000:3.0:1783074110.897070:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723536640:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783074110.897082:0:23954:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074110.897120:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723536640:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 47us (414us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074110.897126:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3647 00000100:00100000:0.0:1783074110.898086:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00080000:1.0:1783074110.898143:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074110.898149:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074110.898152:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723536640:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1783074110.898161:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074110.898164:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074110.898167:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723536768:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783074110.898174:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074110.898176:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074110.898179:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723536896:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783074110.898231:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723537024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1783074110.898243:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074110.898434:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723537024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 203us (1599us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074110.898441:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00080000:1.0:1783074110.898540:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074110.898545:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074110.898548:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723537024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783074110.961620:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000400:00000100:2.0:1783074110.961662:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708053888 offset 0 length 224: 4 00000100:00100000:2.0:1783074110.961686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074110.961763:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074110.961789:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074110.961810:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074110.961833:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074110.961864:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054528 00000100:00100000:2.0:1783074110.961872:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054528 00002000:00100000:2.0:1783074110.961923:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff9524c6ce8e00 x1869685708054528/t0(0) o4->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:436/0 lens 488/0 e 0 to 0 dl 1783074121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074110.961936:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c6ce8e00 with x1869685708054528 ext(1048576->2097151) 00002000:00010000:2.0:1783074110.961942:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9524c6ce8e00 00000100:00100000:2.0:1783074110.961975:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 522 00000100:00100000:1.0:1783074110.961982:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054272 00000100:00100000:2.0:1783074110.961987:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708054528:12345-192.168.204.26@tcp:4:md5sum.0 00000100:00100000:1.0:1783074110.961989:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054272 00000100:00100000:1.0:1783074110.962033:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054400 00000100:00100000:1.0:1783074110.962036:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054400 00000100:00100000:1.0:1783074110.962057:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054656 00000100:00100000:1.0:1783074110.962060:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054656 00000100:00100000:1.0:1783074110.962079:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2115 00000100:00100000:1.0:1783074110.962086:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2404:x1869685708054272:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074110.962161:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2404:x1869685708054272:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 75us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074110.962169:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2115 00000100:00100000:1.0:1783074110.962196:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2116 00000100:00100000:1.0:1783074110.962204:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708054400:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074110.962232:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708054400:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074110.962238:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2116 00000100:00100000:1.0:1783074110.962259:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4908 00000100:00100000:1.0:1783074110.962266:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2402:x1869685708054656:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:3.0:1783074110.962293:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054144 00000100:00100000:0.0:1783074110.962293:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054016 00000100:00100000:0.0:1783074110.962299:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054016 00000100:00100000:3.0:1783074110.962337:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054144 00000100:00100000:0.0:1783074110.962358:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1186 00000100:00100000:0.0:1783074110.962365:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1869685708054016:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:0.0:1783074110.962379:0:67186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:3.0:1783074110.962389:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 801 00000100:00100000:0.0:1783074110.962409:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1869685708054016:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 43us (797us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074110.962442:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1186 00000100:00100000:3.0:1783074110.962448:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708054144:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074110.962491:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708054144:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 47us (804us total) trans 0 rc 0/0 00000100:00080000:0.0:1783074110.962491:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074110.962501:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 801 00000001:00100000:1.0:1783074110.964832:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074110.964840:0:9524:0:(genops.c:906:class_export_put()) final put ffff9523c6940800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783074110.964872:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968710 is committed 00000020:00000080:0.0:1783074110.964939:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6940800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783074110.964990:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6945000 for lustre-OST0001 00000100:00100000:2.0:1783074110.965017:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2402:x1869685708054656:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 2746us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074110.965043:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4908 00000100:00100000:2.0:1783074110.968181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074110.968397:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708054784 00000100:00100000:3.0:1783074110.968408:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708054784 00000100:00100000:3.0:1783074110.968454:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1187 00000100:00100000:3.0:1783074110.968462:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708054784:12345-192.168.204.26@tcp:38:ptlrpcd_01_00.0 00010000:00020000:3.0:1783074110.968484:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074110.971456:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708054784:12345-192.168.204.26@tcp:38:ptlrpcd_01_00.0 Request processed in 2985us (3275us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074110.971466:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1187 00000100:00100000:0.0:1783074110.983610:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2403:x1869685708054528:12345-192.168.204.26@tcp:4:md5sum.0 Request processed in 21615us (21787us total) trans 4294968711 rc 0/0 00000100:00100000:0.0:1783074110.983625:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 522 00002000:00100000:0.0:1783074110.983639:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff9524c6ce8e00 x1869685708054528/t4294968711(0) o4->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:436/0 lens 488/448 e 0 to 0 dl 1783074121 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074110.983650:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c6ce8e00 with x1869685708054528 ext(1048576->2097151) 00002000:00010000:0.0:1783074110.983656:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9524c6ce8e00 00010000:00010000:0.0:1783074111.087460:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074111.918586:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723537152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074111.918680:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074111.918750:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537152 00000100:00100000:0.0:1783074111.918758:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537152 00000100:00100000:0.0:1783074111.918811:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:0.0:1783074111.918819:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723537152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074111.918847:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074111.918893:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723537152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074111.918898:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1783074111.919036:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723537152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074111.919690:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723537280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074111.919732:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074111.919811:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537280 00000100:00100000:2.0:1783074111.919816:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537280 00000100:00100000:2.0:1783074111.919851:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:2.0:1783074111.919857:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723537280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074111.919875:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074111.919922:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723537280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074111.919941:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1783074111.920134:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723537280:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783074112.111259:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074113.135735:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074114.158503:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783074114.992865:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074114.992873:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524debea000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783074114.992894:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968715 is committed 00000020:00000080:1.0:1783074114.992974:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524debea000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783074114.993017:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524debeb800 for lustre-OST0000 00010000:00010000:0.0:1783074115.183083:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783074115.504995:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783074115.505006:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411441 is committed 00000020:00000080:3.0:1783074115.505012:0:75594:0:(genops.c:906:class_export_put()) final put ffff9524c4405000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074115.505096:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4405000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783074115.505173:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c4406800 for lustre-MDT0001 00000100:00100000:2.0:1783074116.014623:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723537408:0@lo:400:kworker.0 00000400:00000100:2.0:1783074116.014680:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723537408 offset 0 length 224: 4 00000100:00080000:1.0:1783074116.014754:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074116.014759:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074116.014762:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074116.014767:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2950 00000100:00080000:1.0:1783074116.014772:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074116.014778:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074116.014827:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c48e4380 x1869685723537536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074116.014876:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074116.014880:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074116.014882:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074116.014886:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2950 00000100:00100000:3.0:1783074116.014891:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723537536:0@lo:38:kworker.0 00000100:00080000:1.0:1783074116.014891:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074116.014898:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074116.014916:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c48e5c00 x1869685723537792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074116.014937:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723537664:0@lo:400:kworker.0 00000100:00100000:3.0:1783074116.014951:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074116.014952:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074116.014958:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074116.014960:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074116.014965:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2950 00000100:00080000:1.0:1783074116.014968:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074116.014971:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074116.014983:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c48e4700 x1869685723538048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074116.015061:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074116.015084:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074116.015091:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723537920:0@lo:400:kworker.0 00000100:00100000:0.0:1783074116.015123:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074116.015137:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074116.015148:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723538176:0@lo:400:kworker.0 00000100:00100000:0.0:1783074116.015157:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537536 00000100:00100000:0.0:1783074116.015166:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537536 00000100:00100000:3.0:1783074116.015178:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723537792:0@lo:38:kworker.0 00000100:00100000:2.0:1783074116.015183:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074116.015197:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537664 00000100:00100000:0.0:1783074116.015201:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537664 00000100:00100000:3.0:1783074116.015220:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074116.015250:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c48e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723538048:0@lo:38:kworker.0 00000100:00100000:2.0:1783074116.015268:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537920 00000100:00100000:3.0:1783074116.015274:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074116.015274:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537920 00000100:00100000:2.0:1783074116.015330:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723537792 00000100:00100000:2.0:1783074116.015333:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723537792 00000100:00100000:3.0:1783074116.015337:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1783074116.015350:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723537664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074116.015352:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1783074116.015364:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074116.015418:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723537664:12345-0@lo:400:kworker.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074116.015431:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1783074116.015452:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1783074116.015457:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723537920:12345-0@lo:400:kworker.0 Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074116.015461:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723537536:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074116.015469:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00010000:00020000:3.0:1783074116.015483:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074116.015490:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1783074116.015524:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723537536:12345-0@lo:38:kworker.0 Request processed in 63us (575us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074116.015655:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723537792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074116.015667:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074116.015693:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723537792:12345-0@lo:38:kworker.0 Request processed in 40us (474us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783074116.015780:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074116.015784:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074116.015786:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074116.015790:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2950 00000100:00080000:1.0:1783074116.015793:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074116.015796:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074116.015813:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4687800 x1869685723538432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074116.015837:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538176 00000100:00100000:1.0:1783074116.015840:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538176 00000100:00100000:1.0:1783074116.015869:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1783074116.015875:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723538176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074116.015913:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723538176:12345-0@lo:400:kworker.0 Request processed in 38us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074116.015919:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00080000:1.0:1783074116.015979:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074116.015984:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074116.015999:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074116.016008:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723538304:0@lo:400:kworker.0 00000100:00100000:1.0:1783074116.016032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074116.016083:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723537920:0@lo:400:kworker.0 00000100:00100000:1.0:1783074116.016097:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723537664:0@lo:400:kworker.0 00000100:00100000:1.0:1783074116.016127:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538304 00000100:00100000:1.0:1783074116.016130:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538304 00000100:00100000:1.0:1783074116.016156:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1783074116.016161:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074116.016188:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1783074116.016199:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723538304:12345-0@lo:400:kworker.0 Request processed in 35us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074116.016206:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00080000:0.0:1783074116.016217:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074116.016236:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538048 00000100:00100000:0.0:1783074116.016238:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723538432:0@lo:38:kworker.0 00000100:00100000:3.0:1783074116.016241:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538048 00000100:00100000:1.0:1783074116.016246:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723538304:0@lo:400:kworker.0 00000100:00100000:3.0:1783074116.016271:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3648 00000100:00100000:3.0:1783074116.016277:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723538048:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074116.016298:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723538176:0@lo:400:kworker.0 00010000:00020000:3.0:1783074116.016300:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074116.016363:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723538048:12345-0@lo:38:kworker.0 Request processed in 84us (1088us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074116.016372:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648 00000100:00100000:0.0:1783074116.016438:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074116.016563:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538432 00000100:00100000:1.0:1783074116.016567:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538432 00000100:00100000:1.0:1783074116.016591:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1783074116.016596:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723538432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074116.016608:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074116.016641:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723538432:12345-0@lo:38:kworker.0 Request processed in 43us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074116.016647:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:0.0:1783074116.016667:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074116.016673:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074116.016683:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723537792:0@lo:38:kworker.0 00000100:00100000:2.0:1783074116.016702:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:0.0:1783074116.016702:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074116.016710:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074116.016714:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723538048:0@lo:38:kworker.0 00000100:00080000:0.0:1783074116.016725:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074116.016728:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074116.016736:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c48e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723537536:0@lo:38:kworker.0 00000100:00080000:0.0:1783074116.016756:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074116.016759:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074116.016768:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723538432:0@lo:38:kworker.0 00000100:00100000:2.0:1783074116.081656:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074116.081710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074116.082108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074116.082167:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055040 00000100:00100000:3.0:1783074116.082177:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055040 00000400:00000100:2.0:1783074116.082189:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708054912 offset 0 length 224: 4 00000100:00100000:2.0:1783074116.082222:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074116.082230:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055168 00000100:00100000:3.0:1783074116.082235:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055168 00000100:00100000:3.0:1783074116.082288:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 804 00000100:00100000:3.0:1783074116.082300:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708055168:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074116.082376:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055424 00000100:00100000:1.0:1783074116.082381:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055424 00000100:00100000:3.0:1783074116.082407:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708055168:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 109us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074116.082414:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055296 00000100:00100000:1.0:1783074116.082418:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055296 00000100:00100000:1.0:1783074116.082438:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2119 00000100:00100000:1.0:1783074116.082445:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2402:x1869685708055424:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074116.082479:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2402:x1869685708055424:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074116.082486:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2119 00000100:00100000:1.0:1783074116.082500:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2120 00000100:00100000:1.0:1783074116.082506:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708055296:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074116.082524:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708055296:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 19us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074116.082530:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2120 00000100:00100000:0.0:1783074116.082727:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1191 00000100:00100000:3.0:1783074116.082738:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 804 00000100:00100000:0.0:1783074116.082739:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708055040:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:0.0:1783074116.082760:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1783074116.082785:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074116.082798:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074116.082801:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074116.082822:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708055040:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 86us (1182us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074116.082829:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1191 00010000:00010000:2.0:1783074116.206968:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783074116.528722:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968711 is committed 00000100:00100000:1.0:1783074117.038548:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783074117.038571:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723538560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074117.038652:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074117.038691:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723538688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074117.038716:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074117.038755:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538560 00000100:00100000:1.0:1783074117.038761:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538560 00000100:00100000:0.0:1783074117.038774:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538688 00000100:00100000:0.0:1783074117.038779:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538688 00000100:00100000:1.0:1783074117.038812:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:1.0:1783074117.038821:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723538560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074117.038851:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074117.038851:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1783074117.038862:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723538688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074117.038884:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074117.038899:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723538560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074117.038918:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1783074117.038941:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723538688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074117.038955:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:1.0:1783074117.039876:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723538688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074117.039887:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723538560:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074117.230489:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074118.254448:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074119.278448:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074120.302661:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074121.134535:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074121.134541:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074121.134545:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074121.134556:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2955 00000100:00080000:3.0:1783074121.134562:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1783074121.134566:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723538816:0@lo:400:kworker.0 00000100:00080000:3.0:1783074121.134571:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074121.134596:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4588e00 x1869685723538944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074121.134630:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074121.134634:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074121.134635:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074121.134639:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2955 00000100:00080000:3.0:1783074121.134642:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074121.134646:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000400:00000100:1.0:1783074121.134651:0:3658:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723538816 offset 0 length 224: 4 00000100:00100000:3.0:1783074121.134658:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c458b100 x1869685723539200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074121.134705:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074121.134714:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723539072:0@lo:400:kworker.0 00000100:00100000:0.0:1783074121.134730:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723538944:0@lo:38:kworker.0 00000100:00100000:1.0:1783074121.134763:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074121.134862:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074121.134901:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723539200:0@lo:38:kworker.0 00000100:00100000:1.0:1783074121.134903:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539072 00000100:00100000:1.0:1783074121.134911:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539072 00000100:00100000:0.0:1783074121.134928:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074121.135008:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074121.135012:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074121.135015:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074121.135019:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2955 00000100:00080000:3.0:1783074121.135021:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074121.135025:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074121.135044:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4588380 x1869685723539456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074121.135089:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074121.135093:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074121.135095:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074121.135099:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2955 00000100:00080000:3.0:1783074121.135101:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783074121.135104:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074121.135145:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723539456:0@lo:38:kworker.0 00000100:00100000:0.0:1783074121.135173:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074121.135219:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4589500 x1869685723539840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074121.135250:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723539328:0@lo:400:kworker.0 00000100:00100000:3.0:1783074121.135300:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074121.135806:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539456 00000100:00100000:0.0:1783074121.135811:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539456 00000100:00100000:0.0:1783074121.135848:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3649 00000100:00100000:0.0:1783074121.135863:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723539456:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074121.135882:0:26189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074121.135924:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723539456:12345-0@lo:38:kworker.0 Request processed in 55us (743us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074121.135931:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3649 00000100:00100000:0.0:1783074121.135956:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723539840:0@lo:38:kworker.0 00000100:00100000:0.0:1783074121.135992:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723539584:0@lo:400:kworker.0 00000100:00100000:0.0:1783074121.136030:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074121.136070:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539584 00000100:00100000:0.0:1783074121.136074:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539584 00000100:00100000:0.0:1783074121.136100:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1783074121.136107:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074121.136145:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723539584:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074121.136151:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1783074121.136185:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723539584:0@lo:400:kworker.0 00000100:00080000:0.0:1783074121.136214:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074121.136218:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074121.136227:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723539712:0@lo:400:kworker.0 00000100:00100000:0.0:1783074121.136262:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074121.136289:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539712 00000100:00100000:0.0:1783074121.136292:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539712 00000100:00100000:0.0:1783074121.136332:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1783074121.136339:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723539712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074121.136371:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723539712:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074121.136383:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00080000:0.0:1783074121.136399:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074121.136415:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723539712:0@lo:400:kworker.0 00000100:00100000:3.0:1783074121.136882:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074121.137133:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723538944 00000100:00100000:2.0:1783074121.137138:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723538944 00000100:00100000:2.0:1783074121.137157:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539200 00000100:00100000:2.0:1783074121.137159:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539200 00000100:00100000:2.0:1783074121.137166:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539328 00000100:00100000:2.0:1783074121.137167:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539328 00000100:00100000:2.0:1783074121.137189:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1783074121.137197:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723539072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074121.137236:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1783074121.137242:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723539072:12345-0@lo:400:kworker.0 Request processed in 45us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074121.137250:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074121.137253:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1783074121.137273:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1783074121.137278:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723538944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074121.137292:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074121.137305:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723539328:12345-0@lo:400:kworker.0 Request processed in 59us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074121.137338:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1783074121.137344:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723538944:12345-0@lo:38:kworker.0 Request processed in 63us (2481us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074121.137351:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1783074121.137366:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1783074121.137372:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723539200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074121.137382:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783074121.137395:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074121.137410:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723539200:12345-0@lo:38:kworker.0 Request processed in 36us (2481us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074121.137424:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723539072:0@lo:400:kworker.0 00000100:00100000:2.0:1783074121.137440:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1783074121.137485:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723539328:0@lo:400:kworker.0 00000100:00080000:3.0:1783074121.138020:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074121.138026:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074121.138030:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723539456:0@lo:38:kworker.0 00000100:00080000:3.0:1783074121.138038:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074121.138041:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074121.138044:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723538944:0@lo:38:kworker.0 00000100:00080000:3.0:1783074121.138051:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074121.138054:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074121.138057:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723539200:0@lo:38:kworker.0 00000100:00100000:1.0:1783074121.138519:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539840 00000100:00100000:1.0:1783074121.138525:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539840 00000100:00100000:1.0:1783074121.138595:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1783074121.138600:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723539840:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074121.138612:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074121.138657:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723539840:12345-0@lo:38:kworker.0 Request processed in 55us (1774us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074121.138663:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00080000:3.0:1783074121.138712:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074121.138716:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074121.138719:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723539840:0@lo:38:kworker.0 00000400:00000100:2.0:1783074121.199839:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708055552 offset 0 length 224: 4 00000100:00100000:2.0:1783074121.200617:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074121.200650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074121.200661:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055808 00000100:00100000:1.0:1783074121.200671:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055808 00000100:00100000:2.0:1783074121.200685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074121.200710:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056064 00000100:00100000:2.0:1783074121.200715:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056064 00000100:00100000:1.0:1783074121.200734:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 807 00000100:00100000:1.0:1783074121.200744:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708055808:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074121.200748:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055936 00000100:00100000:2.0:1783074121.200752:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055936 00000100:00100000:2.0:1783074121.200778:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2123 00000100:00100000:2.0:1783074121.200787:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708056064:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074121.200807:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708055808:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074121.200812:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 807 00000100:00100000:2.0:1783074121.200823:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708056064:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 36us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074121.200845:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2123 00000100:00100000:1.0:1783074121.200860:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2124 00000100:00100000:1.0:1783074121.200868:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708055936:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074121.200889:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708055936:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074121.200894:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2124 00000100:00080000:0.0:1783074121.201217:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074121.201222:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074121.201225:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074121.203742:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074121.203892:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708055680 00000100:00100000:0.0:1783074121.203902:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708055680 00000100:00100000:0.0:1783074121.203946:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1195 00000100:00100000:0.0:1783074121.203955:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708055680:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:0.0:1783074121.203978:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074121.204035:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708055680:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 80us (301us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074121.204043:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1195 00010000:00010000:1.0:1783074121.328452:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074122.158711:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723539968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074122.158713:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783074122.158726:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723540096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074122.158933:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074122.159030:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540096 00000100:00100000:1.0:1783074122.159039:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540096 00000100:00100000:1.0:1783074122.159136:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:1.0:1783074122.159147:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723540096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074122.159177:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074122.159226:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723540096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074122.159234:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:1.0:1783074122.159417:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723540096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074122.162277:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074122.162333:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723539968 00000100:00100000:0.0:1783074122.162342:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723539968 00000100:00100000:0.0:1783074122.162396:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:0.0:1783074122.162405:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723539968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074122.162446:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074122.162528:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723539968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074122.162536:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:3.0:1783074122.162556:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723539968:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783074122.350593:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074123.374496:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074124.398497:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074125.422432:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074126.254493:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074126.254500:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074126.254509:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783074126.254512:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723540224:0@lo:400:kworker.0 00000100:00080000:0.0:1783074126.254517:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2960 00000100:00080000:0.0:1783074126.254524:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783074126.254530:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074126.254554:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c458aa00 x1869685723540352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1783074126.254571:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723540224 offset 0 length 224: 4 00000100:00080000:0.0:1783074126.254585:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074126.254589:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074126.254591:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074126.254595:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2960 00000100:00080000:0.0:1783074126.254598:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783074126.254602:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074126.254611:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c458b100 x1869685723540608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074126.254630:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074126.254634:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074126.254635:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074126.254639:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2960 00000100:00080000:0.0:1783074126.254641:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783074126.254645:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074126.254655:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723540352:0@lo:38:kworker.0 00000100:00100000:0.0:1783074126.254657:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4588380 x1869685723540864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074126.254689:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074126.254692:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074126.254699:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783074126.254703:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074126.254706:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2960 00000100:00080000:0.0:1783074126.254710:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783074126.254714:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074126.254728:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efdc00 x1869685723541248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074126.254748:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723540608:0@lo:38:kworker.0 00000100:00100000:2.0:1783074126.254772:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723540736:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.254778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074126.254809:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723540864:0@lo:38:kworker.0 00000100:00100000:2.0:1783074126.254816:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000400:0.0:1783074126.254881:0:3660:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783074110/real 1783074110] req@ffff9523c20c0700 x1869685723535488/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783074126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074126.254884:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074126.254905:0:3660:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9523c20c0700 x1869685723535488/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783074126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074126.254914:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783074126.254918:0:3660:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1783074126.254922:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723541248:0@lo:38:kworker.0 00000100:00080000:0.0:1783074126.254924:0:3660:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783074126.254928:0:3660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783074126.254934:0:3660:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c20c0700 x1869685723535488/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783074126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074126.254943:0:3660:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524c8ff6300 x1869685723537408/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074126.254951:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074126.254954:0:3660:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c458bb80 x1869685723538816/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074137 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074126.254964:0:3660:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c4588a80 x1869685723540224/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783074126.254974:0:3660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783074126.254977:0:3660:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783074126.254978:0:3660:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783074126.254980:0:3660:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1783074126.254990:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723541120:0@lo:400:kworker.0 00000100:00100000:0.0:1783074126.255010:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723540992:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.255022:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074126.255053:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723540224:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.255082:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540352 00000100:00100000:3.0:1783074126.255089:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540352 00000100:00100000:3.0:1783074126.255117:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540608 00000100:00100000:3.0:1783074126.255120:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540608 00000100:00100000:3.0:1783074126.255127:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540736 00000100:00100000:3.0:1783074126.255130:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540736 00000100:00100000:3.0:1783074126.255176:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723541248 00000100:00100000:3.0:1783074126.255185:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723541248 00000100:00100000:2.0:1783074126.255202:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723537408:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.255204:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1783074126.255218:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723540736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074126.255225:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074126.255232:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723540480:0@lo:400:kworker.0 00000100:00100000:2.0:1783074126.255265:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074126.255282:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723540736:12345-0@lo:400:kworker.0 Request processed in 65us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074126.255291:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1783074126.255305:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540480 00000100:00100000:3.0:1783074126.255308:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540480 00000100:00100000:3.0:1783074126.255344:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1783074126.255350:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.255388:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723540480:12345-0@lo:400:kworker.0 Request processed in 39us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074126.255394:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723540736:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.255400:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1783074126.255417:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1783074126.255422:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723540352:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074126.255427:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723540480:0@lo:400:kworker.0 00010000:00020000:3.0:1783074126.255440:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074126.255454:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1783074126.255460:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723540608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074126.255473:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074126.255481:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723540352:12345-0@lo:38:kworker.0 Request processed in 56us (779us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074126.255488:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1783074126.255504:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1783074126.255509:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723540608:12345-0@lo:38:kworker.0 Request processed in 47us (733us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074126.255511:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723541248:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074126.255524:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00010000:00020000:3.0:1783074126.255529:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074126.255568:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723541248:12345-0@lo:38:kworker.0 Request processed in 57us (617us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074126.255574:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1783074126.255595:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540864 00000100:00100000:3.0:1783074126.255604:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540864 00000100:00100000:3.0:1783074126.255632:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3650 00000100:00100000:3.0:1783074126.255637:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723540864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783074126.255648:0:8453:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074126.255681:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723540864:12345-0@lo:38:kworker.0 Request processed in 42us (806us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074126.255688:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3650 00000100:00100000:3.0:1783074126.255719:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723541120 00000100:00100000:3.0:1783074126.255723:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723541120 00000100:00100000:3.0:1783074126.255773:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1783074126.255782:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723541120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074126.255831:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074126.255832:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723541120:12345-0@lo:400:kworker.0 Request processed in 49us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074126.255840:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1783074126.255853:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723540992 00000100:00100000:3.0:1783074126.255856:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723540992 00000100:00100000:0.0:1783074126.255861:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723535488:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.255882:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:3.0:1783074126.255892:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723540992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074126.255900:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723538816:0@lo:400:kworker.0 00000100:00080000:0.0:1783074126.255925:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074126.255929:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783074126.255931:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074126.255936:0:44310:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 2929 00000100:00080000:0.0:1783074126.255941:0:44310:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074126.255945:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723540992:12345-0@lo:400:kworker.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074126.255952:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:0.0:1783074126.255961:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4efca80 x1869685723541376/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074126.255976:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074126.255982:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074126.255984:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074126.256009:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723541120:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.256034:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723540992:0@lo:400:kworker.0 00000100:00100000:3.0:1783074126.256048:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723541376:0@lo:250:kworker.0 00000400:00000100:3.0:1783074126.256072:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723541376 offset 0 length 520: 4 00000100:00080000:3.0:1783074126.256110:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074126.256115:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074126.256118:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723541248:0@lo:38:kworker.0 00000100:00080000:3.0:1783074126.256127:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074126.256130:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074126.256133:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723540864:0@lo:38:kworker.0 00000100:00080000:3.0:1783074126.256140:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074126.256143:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074126.256146:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723540352:0@lo:38:kworker.0 00000100:00080000:3.0:1783074126.256153:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074126.256156:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074126.256158:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723540608:0@lo:38:kworker.0 00000400:00000100:3.0:1783074126.318769:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708056192 offset 0 length 224: 4 00000100:00100000:3.0:1783074126.318827:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074126.318858:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056320 00000100:00100000:0.0:1783074126.318868:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056320 00000100:00100000:3.0:1783074126.318886:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074126.319239:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056448 00000100:00100000:0.0:1783074126.319243:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056448 00000100:00100000:0.0:1783074126.319289:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 810 00000100:00100000:3.0:1783074126.319304:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1199 00000100:00100000:0.0:1783074126.319305:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708056448:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074126.319399:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708056448:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 101us (527us total) trans 0 rc 0/0 00000100:00080000:2.0:1783074126.319483:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074126.319575:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708056320:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:0.0:1783074126.319576:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 810 00010000:00020000:3.0:1783074126.319595:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074126.319623:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708056320:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 50us (797us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074126.319630:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1199 00000100:00100000:0.0:1783074126.319634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074126.319663:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056576 00000100:00100000:0.0:1783074126.319667:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056576 00000100:00100000:0.0:1783074126.319705:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2127 00000100:00100000:0.0:1783074126.319714:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2404:x1869685708056576:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074126.319748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074126.319764:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2404:x1869685708056576:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074126.319779:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2127 00000100:00100000:3.0:1783074126.319786:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056704 00000100:00100000:3.0:1783074126.319790:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056704 00000100:00080000:0.0:1783074126.319802:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074126.319806:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074126.319821:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2128 00000100:00100000:3.0:1783074126.319827:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708056704:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074126.319851:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708056704:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074126.319855:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2128 00000020:01000004:1.0:1783074126.407347:0:90918:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783074126.407354:0:90918:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783074126.407355:0:90918:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783074126.407686:0:90918:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9524debee000 00000020:01000004:1.0:1783074126.407701:0:90918:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783074126.407713:0:90918:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783074126.407740:0:90918:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9524fb4d99c0) 00000020:00000080:1.0:1783074126.407757:0:90918:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1783074126.446767:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1783074126.466582:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783074126.468591:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.469958:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.470163:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783074126.470698:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.470948:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.471161:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.471408:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783074126.471631:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783074126.471872:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783074126.472035:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783074126.472287:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.472572:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.472815:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783074126.473703:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.482148:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.482404:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.482690:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.482924:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.483117:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.483347:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.483600:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.483797:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.484016:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.484249:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.484500:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.485154:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.485570:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.486095:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.486350:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.486558:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.486828:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.487541:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.487984:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.488361:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.488592:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.488903:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.489202:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.489657:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.490006:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.490533:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.490772:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.491029:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.491177:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.491345:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.491572:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783074126.491857:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783074126.492572:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.493115:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.493330:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.493706:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.493959:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783074126.494382:0:90918:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783074126.495480:0:90918:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783074126.495691:0:90918:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783074126.495698:0:90918:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783074126.495709:0:90918:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df6fa 00000020:01000004:3.0:1783074126.495716:0:90918:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783074126.495741:0:90918:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783074126.495747:0:90918:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524debee000 from MGS 00000020:01000004:3.0:1783074126.495750:0:90918:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783074126.495760:0:90918:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9524fa8619c0) 00000020:00000080:3.0:1783074126.495772:0:90918:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1783074126.495834:0:90918:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524debee000 from MGS, refs=2 00080000:01000000:3.0:1783074126.495840:0:90918:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783074126.495845:0:90918:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df708 00010000:00010000:3.0:1783074126.495965:0:90918:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783074126.498873:0:90918:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783074126.500963:0:90923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783074126.501008:0:90918:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783074126.501048:0:90918:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783074126.501621:0:90918:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783074126.501877:0:90918:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783074126.502011:0:90918:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783074126.502018:0:90918:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783074126.504845:0:90918:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783074126.504988:0:90918:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783074126.505290:0:90918:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783074126.505296:0:90918:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783074126.505852:0:90918:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783074126.505873:0:90918:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783074126.505874:0:90918:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783074126.505877:0:90918:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1783074126.505888:0:90918:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 54, was 0): CONNECTING 00000100:00100000:3.0:1783074126.505893:0:90918:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1783074127.278493:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723541504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074127.278514:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723541632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074127.278575:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074127.278642:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723541632 00000100:00100000:3.0:1783074127.278650:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723541632 00000100:00100000:3.0:1783074127.278699:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:3.0:1783074127.278709:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723541632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074127.278752:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074127.280412:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074127.280476:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723541504 00000100:00100000:2.0:1783074127.280482:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723541504 00000100:00100000:2.0:1783074127.280517:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:2.0:1783074127.280524:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723541504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074127.280556:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074127.280605:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723541504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074127.280612:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1783074127.280646:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723541504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074127.281118:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723541632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2410us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074127.281124:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:0.0:1783074127.282619:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723541632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074127.343834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074127.343925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074127.343940:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057216 00000100:00100000:2.0:1783074127.343950:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057216 00000100:00100000:3.0:1783074127.343955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074127.343991:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057088 00000100:00100000:3.0:1783074127.343999:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074127.343999:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057088 00000100:00100000:2.0:1783074127.344000:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057344 00000100:00100000:2.0:1783074127.344006:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057344 00000100:00100000:3.0:1783074127.344026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074127.344035:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2129 00000100:00100000:2.0:1783074127.344044:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708057216:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074127.344083:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2130 00000100:00100000:1.0:1783074127.344092:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708057344:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074127.344111:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708057216:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074127.344119:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2129 00000100:00100000:1.0:1783074127.344130:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708057344:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074127.344135:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2130 00000100:00100000:0.0:1783074127.344145:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056960 00000100:00100000:0.0:1783074127.344151:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056960 00000100:00100000:1.0:1783074127.344179:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708056832 00000100:00100000:0.0:1783074127.344191:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 811 00000100:00100000:0.0:1783074127.344200:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708057088:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074127.344233:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708057088:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074127.344240:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 811 00000100:00100000:1.0:1783074127.344247:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708056832 00000100:00100000:0.0:1783074127.344256:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1200 00000100:00100000:0.0:1783074127.344262:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708056960:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:1.0:1783074127.344275:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1783074127.344281:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1869685708056832:12345-192.168.204.26@tcp:250:kworker.0 00010000:00020000:0.0:1783074127.344284:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1783074127.344300:0:90924:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from da924155-7591-4a6a-a2d2-c0d2908d0bfb@192.168.204.26@tcp t0 exp 0000000000000000 cur 2966 last 0 00000100:00100000:0.0:1783074127.344355:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708056960:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 78us (315us total) trans 0 rc -19/-19 00000020:00000080:1.0:1783074127.344357:0:90924:0:(genops.c:1406:class_connect()) connect: client da924155-7591-4a6a-a2d2-c0d2908d0bfb, cookie 0x5fb609b3016df70f 00000100:00100000:0.0:1783074127.344367:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1200 00000100:00080000:1.0:1783074127.344512:0:90924:0:(import.c:65:import_set_state_nolock()) ffff9524c3569800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074127.344538:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:2401:x1869685708056832:12345-192.168.204.26@tcp:250:kworker.0 Request processed in 256us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074127.344545:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00010000:00010000:3.0:1783074127.472459:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074128.494457:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074128.559672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074128.559745:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057472 00000100:00100000:0.0:1783074128.559767:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057472 00000100:00100000:0.0:1783074128.559834:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:0.0:1783074128.559844:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+5:42363:x1869685708057472:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074128.559861:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074128.559881:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0d6 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074128.559909:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 6 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074128.559920:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 6 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074128.559929:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:0.0:1783074128.559988:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708057472:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074128.559995:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1783074128.561790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074128.562265:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057600 00000100:00100000:1.0:1783074128.562274:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057600 00000100:00100000:1.0:1783074128.562366:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1783074128.562378:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708057600:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783074128.562462:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708057600:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 86us (680us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074128.562470:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1783074128.570905:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074128.571283:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057728 00000100:00100000:2.0:1783074128.571293:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057728 00000100:00100000:2.0:1783074128.571383:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1783074128.571394:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+6:42363:x1869685708057728:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074128.571411:0:90925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074128.571431:0:90925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3158a00/0x5fb609b3016df71d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0dd expref: -99 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074128.571590:0:90925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3158a00/0x5fb609b3016df71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0dd expref: 7 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074128.571603:0:90925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3158a00/0x5fb609b3016df71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0dd expref: 7 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074128.571613:0:90925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158a00, rc 0) 00000100:00100000:2.0:1783074128.571678:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708057728:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 285us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074128.571686:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:3.0:1783074128.574828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074128.574893:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057856 00000100:00100000:0.0:1783074128.574903:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057856 00000100:00100000:0.0:1783074128.574963:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1783074128.574973:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:42363:x1869685708057856:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783074128.575599:0:90927:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783074128.575716:0:90926:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 115 20000000:01000000:0.0:1783074128.577753:0:90928:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783074128.577760:0:90928:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783074128.577764:0:90928:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783074128.577766:0:90928:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783074128.577981:0:90928:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783074128.578252:0:90926:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783074128.578626:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708057856:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 3647us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074128.578638:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1783074128.586911:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074128.587131:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708057984 00000100:00100000:2.0:1783074128.587141:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708057984 00000100:00100000:2.0:1783074128.587231:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1783074128.587242:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708057984:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074128.587423:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708057984:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 182us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074128.587443:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1783074128.591564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074128.591785:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058112 00000100:00100000:2.0:1783074128.591796:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058112 00000100:00100000:2.0:1783074128.591853:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:2.0:1783074128.591863:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:42363:x1869685708058112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074128.591880:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074128.591898:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3158600/0x5fb609b3016df724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0e4 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074128.591924:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3158600/0x5fb609b3016df724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0e4 expref: 9 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074128.591934:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3158600/0x5fb609b3016df724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0e4 expref: 9 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074128.591943:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158600, rc 0) 00000100:00100000:2.0:1783074128.592009:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708058112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 146us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074128.592016:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:3.0:1783074128.593669:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074128.593767:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058240 00000100:00100000:2.0:1783074128.593775:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058240 00000100:00100000:2.0:1783074128.593822:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1783074128.593831:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708058240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074128.593981:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708058240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074128.593989:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1783074128.596629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074128.596789:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058368 00000100:00100000:1.0:1783074128.596798:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058368 00000100:00100000:1.0:1783074128.596853:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1783074128.596863:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708058368:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074128.597003:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708058368:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 140us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074128.597011:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:3.0:1783074128.601168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074128.601492:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058496 00000100:00100000:0.0:1783074128.601502:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058496 00000100:00100000:0.0:1783074128.601568:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1783074128.601576:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708058496:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074128.601592:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074128.601608:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671c00/0x5fb609b3016df72b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0eb expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074128.601634:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671c00/0x5fb609b3016df72b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0eb expref: 10 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074128.601645:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016df72b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0eb expref: 10 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074128.601654:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671c00, rc 0) 00000100:00100000:0.0:1783074128.601715:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708058496:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 139us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074128.601721:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1783074128.603616:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074128.603721:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058624 00000100:00100000:2.0:1783074128.603730:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058624 00000100:00100000:2.0:1783074128.603954:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1783074128.603966:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708058624:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074128.604068:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708058624:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 105us (457us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074128.604076:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00010000:00010000:1.0:1783074129.518500:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074130.542534:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783074131.374774:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074131.374784:0:44310:0:(pinger.c:249:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783074131.374786:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074131.374790:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074131.374794:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074131.374801:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2965 00000100:00080000:1.0:1783074131.374806:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074131.374814:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074131.374856:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4685f80 x1869685723541760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074131.374909:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074131.374912:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074131.374914:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074131.374918:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2965 00000100:00080000:1.0:1783074131.374921:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074131.374926:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074131.374939:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4684380 x1869685723542016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074131.374958:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783074131.374968:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723542144:0@lo:400:kworker.0 00000100:00080000:1.0:1783074131.374977:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074131.374980:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783074131.374983:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723541888:0@lo:400:kworker.0 00000100:00080000:1.0:1783074131.374996:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2965 00000100:00080000:1.0:1783074131.374999:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074131.375004:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074131.375023:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4687800 x1869685723542272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074131.375054:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074131.375068:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074131.375073:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074131.375075:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074131.375079:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2965 00000100:00080000:1.0:1783074131.375082:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074131.375086:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074131.375101:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df76a680 x1869685723542656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074131.375119:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723542528:0@lo:400:kworker.0 00000100:00100000:1.0:1783074131.375131:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723541888 00000100:00100000:1.0:1783074131.375139:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723541888 00000100:00100000:2.0:1783074131.375144:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723542400:0@lo:400:kworker.0 00000100:00100000:0.0:1783074131.375154:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074131.375188:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074131.375203:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1783074131.375216:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723541888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074131.375237:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542528 00000100:00100000:0.0:1783074131.375241:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542528 00000100:00100000:0.0:1783074131.375266:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542400 00000100:00100000:0.0:1783074131.375268:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542400 00000100:00100000:1.0:1783074131.375280:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723541888:12345-0@lo:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074131.375286:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1783074131.375293:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1783074131.375298:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723542528:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783074131.375340:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074131.375346:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074131.375350:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074131.375352:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074131.375375:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542144 00000100:00100000:0.0:1783074131.375375:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723542528:12345-0@lo:400:kworker.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074131.375389:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542144 00000100:00100000:0.0:1783074131.375394:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1783074131.375428:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:1.0:1783074131.375433:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1783074131.375437:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723542400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074131.375446:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723542144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074131.375467:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723541760:0@lo:38:kworker.0 00000100:00100000:0.0:1783074131.375492:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723542400:12345-0@lo:400:kworker.0 Request processed in 56us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074131.375501:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:1.0:1783074131.375506:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723542144:12345-0@lo:400:kworker.0 Request processed in 61us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074131.375507:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074131.375512:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723542400:0@lo:400:kworker.0 00000100:00100000:1.0:1783074131.375522:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1783074131.375532:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723541760 00000100:00100000:0.0:1783074131.375537:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723541760 00000100:00100000:3.0:1783074131.375541:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723542016:0@lo:38:kworker.0 00000100:00080000:1.0:1783074131.375553:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074131.375565:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1783074131.375571:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074131.375576:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723541760:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074131.375582:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723542144:0@lo:400:kworker.0 00000100:00100000:3.0:1783074131.375596:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723542272:0@lo:38:kworker.0 00010000:00020000:0.0:1783074131.375605:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074131.375623:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723541888:0@lo:400:kworker.0 00000100:00100000:3.0:1783074131.375625:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074131.375677:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723542528:0@lo:400:kworker.0 00000100:00100000:2.0:1783074131.375689:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542016 00000100:00100000:2.0:1783074131.375695:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542016 00000100:00100000:1.0:1783074131.375715:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542272 00000100:00100000:2.0:1783074131.375721:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1783074131.375721:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542272 00000100:00100000:2.0:1783074131.375729:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723542016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074131.375742:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074131.375751:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3651 00000100:00100000:1.0:1783074131.375758:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723542272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074131.375769:0:26189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074131.375911:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723541760:12345-0@lo:38:kworker.0 Request processed in 334us (406us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074131.375918:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1783074131.377705:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723542656:0@lo:38:kworker.0 00000100:00100000:2.0:1783074131.377737:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723542016:12345-0@lo:38:kworker.0 Request processed in 2004us (2166us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074131.377749:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1783074131.377751:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074131.377776:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542656 00000100:00100000:2.0:1783074131.377783:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542656 00000100:00080000:3.0:1783074131.377805:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074131.377814:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074131.377814:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1783074131.377821:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723541760:0@lo:38:kworker.0 00000100:00100000:2.0:1783074131.377826:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723542656:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1783074131.377836:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074131.377841:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00020000:2.0:1783074131.377846:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074131.377847:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723542016:0@lo:38:kworker.0 00000100:00100000:2.0:1783074131.378029:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723542656:12345-0@lo:38:kworker.0 Request processed in 204us (280us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074131.378051:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:0.0:1783074131.378163:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074131.378169:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074131.378172:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723542656:0@lo:38:kworker.0 00000100:00100000:1.0:1783074131.379492:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723542272:12345-0@lo:38:kworker.0 Request processed in 3727us (3863us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074131.379504:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3651 00000100:00080000:0.0:1783074131.379717:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074131.379722:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074131.379725:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723542272:0@lo:38:kworker.0 00010000:00010000:3.0:1783074131.567217:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074132.398627:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074132.398645:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723542784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074132.398726:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074132.398778:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542784 00000100:00100000:2.0:1783074132.398787:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542784 00000100:00100000:2.0:1783074132.398841:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:2.0:1783074132.398852:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723542784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074132.398882:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074132.400166:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723542784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1313us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074132.400174:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783074132.400177:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:0.0:1783074132.401105:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723542784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074132.402445:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723542912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074132.402513:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074132.403040:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723542912 00000100:00100000:2.0:1783074132.403048:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723542912 00000100:00100000:2.0:1783074132.403148:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1783074132.403159:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723542912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783074132.403188:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074132.403240:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723542912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074132.403247:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:1.0:1783074132.403343:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723542912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074132.463570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074132.463646:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074132.463678:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058752 00000100:00100000:1.0:1783074132.463689:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058752 00000100:00100000:3.0:1783074132.463694:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074132.463744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074132.463758:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059008 00000100:00100000:1.0:1783074132.463759:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1783074132.463763:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059008 00000100:00100000:3.0:1783074132.463785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074132.463791:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708058752:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074132.463827:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059264 00000100:00100000:3.0:1783074132.463833:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059264 00000100:00100000:2.0:1783074132.463849:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059136 00000100:00100000:2.0:1783074132.463855:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059136 00000100:00100000:0.0:1783074132.463867:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708058880 00000100:00100000:0.0:1783074132.463872:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708058880 00000100:00100000:3.0:1783074132.463878:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2133 00000100:00100000:3.0:1783074132.463890:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708059264:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074132.463901:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 814 00000100:00100000:2.0:1783074132.463913:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2134 00000100:00100000:0.0:1783074132.463915:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708059008:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074132.463928:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2404:x1869685708059136:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074132.463968:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708059264:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074132.463972:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708059008:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 62us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074132.463986:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 814 00000100:00100000:1.0:1783074132.464003:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708058752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 215us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074132.464010:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2133 00000100:00100000:0.0:1783074132.464011:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1204 00000100:00100000:1.0:1783074132.464021:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1783074132.464023:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708058880:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:0.0:1783074132.464044:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074132.464073:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708058880:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 52us (290us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074132.464079:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1204 00000100:00080000:0.0:1783074132.464130:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074132.464134:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074132.464137:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074132.464374:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2404:x1869685708059136:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 450us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074132.464382:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2134 00010000:00010000:0.0:1783074132.590849:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074133.614521:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074134.639197:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074135.662426:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074136.494444:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783074126/real 1783074126] req@ffff9523c4efca80 x1869685723541376/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783074136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074136.494454:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074136.494464:0:44310:0:(pinger.c:249:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783074136.494467:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074136.494471:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074136.494475:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783074136.494481:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9523c4efca80 x1869685723541376/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783074136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074136.494482:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2970 00000100:00080000:3.0:1783074136.494497:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074136.494506:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783074136.494509:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00080000:0.0:1783074136.494514:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.494604:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df768700 x1869685723543040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074136.494641:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074136.494645:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074136.494647:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074136.494651:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2970 00000100:00080000:1.0:1783074136.494654:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074136.494658:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.494672:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4687800 x1869685723543296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074136.494689:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074136.494692:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074136.494694:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074136.494697:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2970 00000100:00080000:1.0:1783074136.494699:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074136.494702:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.494712:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4685f80 x1869685723543552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074136.494742:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074136.494751:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074136.494753:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074136.494756:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2970 00000100:00080000:1.0:1783074136.494759:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783074136.494762:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.494775:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ffea00 x1869685723543936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074136.494787:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074136.494791:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783074136.494792:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074136.494795:0:44310:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 2965 00000100:00080000:1.0:1783074136.494798:0:44310:0:(import.c:591:import_select_connection()) MGC192.168.204.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074136.494801:0:44310:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.494811:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8fff480 x1869685723544064/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074136.494832:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723543680:0@lo:400:kworker.0 00000100:00100000:1.0:1783074136.494889:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.494922:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783074136.494930:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723543808:0@lo:400:kworker.0 00000100:00100000:2.0:1783074136.494939:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723543168:0@lo:400:kworker.0 00000100:00100000:1.0:1783074136.494953:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.494991:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543680 00000100:00100000:2.0:1783074136.494998:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.495007:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543680 00000100:00100000:2.0:1783074136.495023:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783074136.495031:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723543424:0@lo:400:kworker.0 00000100:00100000:1.0:1783074136.495059:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543808 00000100:00100000:2.0:1783074136.495060:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.495065:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543808 00000100:00100000:2.0:1783074136.495100:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543168 00000100:00100000:2.0:1783074136.495105:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543168 00000100:00100000:1.0:1783074136.495106:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:1.0:1783074136.495118:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723543680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074136.495144:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543424 00000100:00100000:2.0:1783074136.495149:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543424 00000100:00100000:2.0:1783074136.495179:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:2.0:1783074136.495187:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723543168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074136.495194:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723543680:12345-0@lo:400:kworker.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.495202:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:1.0:1783074136.495222:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:1.0:1783074136.495231:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723543808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074136.495237:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723543168:12345-0@lo:400:kworker.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.495246:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1783074136.495259:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723543808:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.495265:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1783074136.495278:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00080000:1.0:1783074136.495294:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074136.495299:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723543424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783074136.495329:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074136.495335:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074136.495353:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723543424:12345-0@lo:400:kworker.0 Request processed in 57us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.495361:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1783074136.495375:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723543808:0@lo:400:kworker.0 00000100:00100000:1.0:1783074136.495391:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723543680:0@lo:400:kworker.0 00000100:00100000:3.0:1783074136.496259:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723541376:0@lo:250:kworker.0 10000000:01000000:1.0:1783074136.496280:0:90918:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1783074136.496295:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496332:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496338:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1783074136.496351:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496360:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868000/0x5fb609b3016df2d2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df2d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496379:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496399:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496404:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496408:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496413:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868400/0x5fb609b3016df238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df23f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496423:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496430:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496435:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496439:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496443:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086de00/0x5fb609b3016df254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df25b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496452:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496459:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496464:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496467:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496470:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016df27e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df285 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496489:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496496:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496501:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496504:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496508:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016df28c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df293 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496517:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496524:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496529:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496532:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496653:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa52200/0x5fb609b3016df2a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df2af expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496663:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496669:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496673:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496683:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496687:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0869a00/0x5fb609b3016df2b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df2bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496696:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496702:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496707:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496711:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496714:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0869800/0x5fb609b3016df2e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df2e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496726:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496732:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496736:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496739:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496743:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086c200/0x5fb609b3016df246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df24d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496754:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496759:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496773:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.496776:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496780:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0869600/0x5fb609b3016df262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df269 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496792:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496804:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496808:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074136.496811:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496815:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f0868600/0x5fb609b3016df270 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df277 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496824:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496830:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496835:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074136.496838:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496842:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df29a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df2a1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.496850:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.496865:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.496871:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074136.496874:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.496878:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524faa53c00/0x5fb609b3016df2c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df2cb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074136.497000:0:90918:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 55, was 0): CONNECTING 00000100:00080000:1.0:1783074136.497005:0:90918:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1783074136.497084:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723543040:0@lo:38:kworker.0 00000100:00100000:3.0:1783074136.497128:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.498419:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723543296:0@lo:38:kworker.0 00000100:00100000:3.0:1783074136.498452:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.500408:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543040 00000100:00100000:0.0:1783074136.500421:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543040 00000100:00100000:0.0:1783074136.500456:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1783074136.500466:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723543040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074136.500487:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074136.500490:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723543552:0@lo:38:kworker.0 00000100:00100000:2.0:1783074136.500526:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543296 00000100:00100000:2.0:1783074136.500531:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543296 00000100:00100000:3.0:1783074136.500551:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.500564:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1783074136.500564:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723543040:12345-0@lo:38:kworker.0 Request processed in 96us (3432us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074136.500573:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723543296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074136.500579:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1783074136.500584:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723543936:0@lo:38:kworker.0 00010000:00020000:2.0:1783074136.500586:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074136.500610:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.500614:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723543296:12345-0@lo:38:kworker.0 Request processed in 43us (2162us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074136.500621:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1783074136.500631:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723544064:0@lo:250:kworker.0 00000100:00100000:2.0:1783074136.500649:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543936 00000100:00100000:2.0:1783074136.500653:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543936 00000100:00100000:3.0:1783074136.500658:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.500664:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1783074136.500668:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723543936:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074136.500678:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723543552 00010000:00020000:2.0:1783074136.500679:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074136.500685:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723543552 00000100:00100000:2.0:1783074136.500706:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723543936:12345-0@lo:38:kworker.0 Request processed in 37us (96us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783074136.500711:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783074136.500712:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1783074136.500716:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3652 00000100:00080000:3.0:1783074136.500719:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074136.500725:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723543552:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074136.500726:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723543040:0@lo:38:kworker.0 00000100:00080000:3.0:1783074136.500740:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:0.0:1783074136.500743:0:23954:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1783074136.500746:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074136.500750:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723543424:0@lo:400:kworker.0 00000100:00100000:3.0:1783074136.500756:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723543296:0@lo:38:kworker.0 00000100:00100000:2.0:1783074136.500764:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723543168:0@lo:400:kworker.0 00000100:00080000:3.0:1783074136.500766:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074136.500770:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074136.500774:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723543936:0@lo:38:kworker.0 00000100:00100000:0.0:1783074136.500787:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723543552:12345-0@lo:38:kworker.0 Request processed in 61us (246us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783074136.500796:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783074136.500797:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3652 00000100:00080000:3.0:1783074136.500804:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074136.500808:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723543552:0@lo:38:kworker.0 00000100:00100000:2.0:1783074136.500820:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723544064 00000100:00100000:2.0:1783074136.500823:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723544064 00000100:00100000:2.0:1783074136.500843:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783074136.500848:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3657:x1869685723544064:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1783074136.500864:0:90925:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo t0 exp 0000000000000000 cur 2975 last 0 00000020:00000080:2.0:1783074136.500904:0:90925:0:(genops.c:1406:class_connect()) connect: client 522b6a34-04f4-4017-ab45-61a21d19bfef, cookie 0x5fb609b3016df732 00000100:00080000:2.0:1783074136.501036:0:90925:0:(import.c:65:import_set_state_nolock()) ffff9524c4405000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074136.501081:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3657:x1869685723544064:12345-0@lo:250:kworker.0 Request processed in 232us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.501088:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1783074136.501120:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 10000000:01000000:3.0:1783074136.501129:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:3.0:1783074136.501133:0:3657:0:(import.c:1286:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x5fb609b3016df732 00000100:00080000:3.0:1783074136.507712:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:3.0:1783074136.507726:0:3657:0:(import.c:1675:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:0.0:1783074136.508821:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723544064:0@lo:250:kworker.0 00000100:00080000:1.0:1783074136.508890:0:90918:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:1.0:1783074136.508903:0:90918:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783074136.508940:0:90918:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783074136.508945:0:90918:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783074136.509041:0:90918:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783074136.509079:0:90918:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783074136.509083:0:90918:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783074136.509085:0:90918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074136.509086:0:90918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074136.509087:0:90918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074136.509088:0:90918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074136.509089:0:90918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074136.509091:0:90918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074136.509092:0:90918:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074136.509094:0:90918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074136.509096:0:90918:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074136.509098:0:90918:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783074136.509100:0:90918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783074136.509102:0:90918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074136.509103:0:90918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074136.509104:0:90918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074136.509105:0:90918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074136.509111:0:90918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074136.509112:0:90918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074136.509112:0:90918:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074136.509113:0:90918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074136.509114:0:90918:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074136.509137:0:90918:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783074136.509152:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757480 going to sleep for 0 seconds 00000100:00100000:1.0:1783074136.509158:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723544192:0@lo:253:mount.lustre.0 00000020:00080000:1.0:1783074136.509168:0:90918:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:1.0:1783074136.509178:0:90918:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524debee000 from lustre-MDT0000 10000000:01000000:1.0:1783074136.509196:0:90918:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783074136.509198:0:90918:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074136.509207:0:90918:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9524debee000 10000000:01000000:1.0:1783074136.509211:0:90918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783074136.509215:0:90918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9524debee000 10000000:01000000:1.0:1783074136.509218:0:90918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783074136.509222:0:90918:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524debee000 from 1 10000000:01000000:1.0:1783074136.509224:0:90918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074136.509419:0:90918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509430:0:90918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509439:0:90918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.509448:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757b40 going to sleep for 0 seconds 00000100:00100000:1.0:1783074136.509452:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723544320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074136.509461:0:90918:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509480:0:90918:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509487:0:90918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509495:0:90918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509502:0:90918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509508:0:90918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074136.509512:0:90918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509520:0:90918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074136.509527:0:90918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.509533:0:90918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074136.509536:0:90918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074136.509553:0:90918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.509561:0:90918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.509588:0:90918:0:(mgc_request.c:1818:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:1.0:1783074136.509591:0:90918:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:3.0:1783074136.509998:0:90931:0:(import.c:1599:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.126@tcp to MGS@0@lo 00000100:00100000:3.0:1783074136.510003:0:90931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783074136.510005:0:90931:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:3.0:1783074136.510024:0:90931:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1783074136.510028:0:90931:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from RECOVER to FULL 10000000:01000000:3.0:1783074136.510030:0:90931:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 10000000:01000000:1.0:1783074136.510076:0:90918:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524debee000 from 1 10000000:01000000:1.0:1783074136.510080:0:90918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074136.510097:0:90918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.510104:0:90918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.510110:0:90918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.510124:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723544448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074136.510187:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.510219:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723544448 00000100:00100000:1.0:1783074136.510226:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723544448 00000100:00100000:1.0:1783074136.510290:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783074136.510308:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:90918:x1869685723544448:12345-0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783074136.510342:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757b40 going to sleep for 11 seconds 00010000:00010000:1.0:1783074136.510344:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074136.510362:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7600/0x5fb609b3016df747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df740 expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074136.510366:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074136.510379:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723544576:0@lo:400:kworker.0 00010000:00010000:1.0:1783074136.510387:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7600/0x5fb609b3016df747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df740 expref: 6 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.510399:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7600/0x5fb609b3016df747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df740 expref: 6 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.510414:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7600, rc 0) 00000100:00100000:0.0:1783074136.510419:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.510452:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:90918:x1869685723544448:12345-0@lo:101:mount.lustre.0 Request processed in 154us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.510457:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783074136.510478:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723544576 00000100:00100000:0.0:1783074136.510480:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723544448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074136.510481:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723544576 00000100:00100000:1.0:1783074136.510498:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1783074136.510501:0:90918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.510504:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:3659:x1869685723544576:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1783074136.510520:0:90918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.510526:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:3659:x1869685723544576:12345-0@lo:400:kworker.0 Request processed in 22us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.510534:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:01000000:0.0:1783074136.510552:0:90918:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783074136.510558:0:90918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.510566:0:90918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074136.510577:0:90918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 00000100:00100000:1.0:1783074136.510580:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723544576:0@lo:400:kworker.0 10000000:01000000:0.0:1783074136.510582:0:90918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783074136.510658:0:90918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9524debee000 10000000:01000000:1.0:1783074136.510767:0:90918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783074136.510773:0:90918:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783074136.510775:0:90918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074136.510791:0:90918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.510799:0:90918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.510806:0:90918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.510818:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723544704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074136.510843:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.510877:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.510923:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723544704 00000100:00100000:0.0:1783074136.510927:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723544704 00000100:00080000:3.0:1783074136.510946:0:90931:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:3.0:1783074136.510950:0:90931:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) MGC192.168.204.126@tcp: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074136.510985:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783074136.510993:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:90918:x1869685723544704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074136.511000:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074136.511009:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670c00/0x5fb609b3016df755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df74e expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.511023:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670c00/0x5fb609b3016df755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df74e expref: 7 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.511031:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670c00/0x5fb609b3016df755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df74e expref: 7 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.511038:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00000020:01000000:2.0:1783074136.511062:0:53092:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.126@tcp 10000000:01000000:2.0:1783074136.511075:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1783074136.511077:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783074136.511081:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783074136.511082:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074136.511083:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074136.511083:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074136.511084:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074136.511089:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783074136.511090:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074136.511092:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783074136.511113:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783074136.511119:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1783074136.511122:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00100000:0.0:1783074136.511122:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+7:90918:x1869685723544704:12345-0@lo:101:mount.lustre.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000020:01000004:2.0:1783074136.511125:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783074136.511127:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074136.511130:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074136.511132:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074136.511134:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074136.511135:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783074136.511137:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074136.511138:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783074136.511138:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:2.0:1783074136.511154:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783074136.511158:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1783074136.511159:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783074136.511160:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783074136.511160:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074136.511161:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074136.511162:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074136.511162:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074136.511163:0:53092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074136.511164:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074136.511165:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783074136.511183:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783074136.511206:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723545088:0@lo:253:kworker.0 00000100:00100000:1.0:1783074136.511211:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723544832:0@lo:253:kworker.0 00000100:00100000:2.0:1783074136.511231:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.511248:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783074136.511252:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723544960:0@lo:253:kworker.0 00000100:00100000:1.0:1783074136.511262:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.511280:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.511303:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545088 00000100:00100000:2.0:1783074136.511307:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545088 00000100:00100000:1.0:1783074136.511326:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723544832 00000100:00100000:1.0:1783074136.511331:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723544832 00000100:00100000:1.0:1783074136.511348:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723544960 00000100:00100000:1.0:1783074136.511350:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723544960 00000100:00100000:1.0:1783074136.511360:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783074136.511365:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3659:x1869685723544832:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783074136.511412:0:90926:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783074136.511424:0:90926:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783074136.511606:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783074136.511612:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:3661:x1869685723544960:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783074136.511637:0:90925:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1783074136.511752:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723544704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074136.511765:0:90918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074136.511773:0:90918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.511837:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723545216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783074136.511861:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.511894:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.511937:0:90924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1783074136.511985:0:90924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1783074136.512221:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545216 00000100:00100000:1.0:1783074136.512225:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545216 00000100:00100000:3.0:1783074136.512291:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783074136.512302:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3661:x1869685723545088:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783074136.512335:0:90932:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783074136.514047:0:90926:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783074136.514068:0:90926:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783074136.514107:0:90927:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783074136.514112:0:90927:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783074136.514132:0:90927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074136.514140:0:90925:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1783074136.514149:0:90927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 9 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074136.514159:0:90927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074136.514191:0:90927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 9 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074136.514205:0:90927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 9 pid: 90926 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.514218:0:90927:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90927:1869685723545344:192.168.204.26@tcp:104: 00000100:00100000:3.0:1783074136.514520:0:90927:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.514568:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3659:x1869685723544832:12345-0@lo:253:kworker.0 Request processed in 3199us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.514577:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783074136.514611:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783074136.514619:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:90918:x1869685723545216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074136.514731:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723545216:12345-0@lo:501:mount.lustre.0 Request processed in 113us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.514738:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783074136.514865:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723545216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783074136.514910:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723545472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074136.514958:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.514993:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654780 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.515041:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545472 00000100:00100000:1.0:1783074136.515047:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545472 00000100:00100000:1.0:1783074136.515085:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783074136.515092:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723545472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074136.516417:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723545472:12345-0@lo:503:mount.lustre.0 Request processed in 1322us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.516428:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783074136.516472:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723545472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074136.516793:0:90933:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90933:1869685723545600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074136.516833:0:90933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.517078:0:90933:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074136.517408:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545600 00000100:00100000:2.0:1783074136.517414:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545600 00000100:00100000:2.0:1783074136.517470:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783074136.517481:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d24a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90933:x1869685723545600:12345-0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783074136.517902:0:3659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783074136.517905:0:3659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783074136.517906:0:3659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074136.517907:0:3659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074136.517909:0:3659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074136.517910:0:3659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074136.517912:0:3659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783074136.517914:0:3659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074136.517915:0:3659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783074136.517918:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723544832:0@lo:253:kworker.0 00000100:00100000:1.0:1783074136.518402:0:90927:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90927:1869685723545344:192.168.204.26@tcp:104: 00010000:00010000:1.0:1783074136.518423:0:90927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.519096:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 20000000:01000000:2.0:1783074136.519129:0:90925:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783074136.519135:0:90925:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783074136.519138:0:90932:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783074136.519172:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d24a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90933:x1869685723545600:12345-0@lo:502:llog_process_th.0 Request processed in 1692us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.519182:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783074136.519248:0:90933:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90933:1869685723545600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074136.519262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059392 00000100:00100000:0.0:1783074136.519269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059392 00010000:00010000:0.0:1783074136.519294:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 10 pid: 90926 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1783074136.519298:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074136.519329:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074136.519333:0:90933:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783074136.519338:0:90933:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783074136.519342:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1783074136.519355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2579 00000020:00000080:3.0:1783074136.519357:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9524fa863380) 00000100:00100000:0.0:1783074136.519366:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2405:x1869685708059392:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000020:00000080:3.0:1783074136.519379:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00010000:00010000:0.0:1783074136.519379:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1783074136.519388:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00010000:0.0:1783074136.519389:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 10 pid: 90926 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519404:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 10 pid: 90926 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074136.519412:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:3661:x1869685723544960:12345-0@lo:253:kworker.0 Request processed in 7797us (8129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.519421:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1783074136.519425:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670200/0x5fb609b3016df716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0d6 expref: 10 pid: 90926 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519453:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519461:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:01000000:3.0:1783074136.519465:0:90933:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:01000004:2.0:1783074136.519472:0:3661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:00000080:3.0:1783074136.519473:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df76a 00000020:01000004:2.0:1783074136.519474:0:3661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783074136.519476:0:3661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074136.519477:0:3661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 20000000:01000000:0.0:1783074136.519478:0:6516:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005367184s 00000020:01000004:2.0:1783074136.519479:0:3661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074136.519483:0:3661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074136.519485:0:3661:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:0.0:1783074136.519485:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783074136.519487:0:3661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074136.519490:0:3661:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074136.519494:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723544960:0@lo:253:kworker.0 00010000:00010000:0.0:1783074136.519499:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519507:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519515:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519521:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074136.519525:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519532:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519563:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.519574:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074136.519623:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:2405:x1869685708059392:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 259us (527us total) trans 0 rc 0/0 00010000:00010000:2.0:1783074136.519632:0:90927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074136.519632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2579 00010000:00010000:2.0:1783074136.519642:0:90927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.519649:0:90927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298e00/0x5fb609b3016df75c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783074136.519759:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783074136.519807:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074136.519812:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074136.519813:0:90933:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783074136.519816:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074136.519820:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074136.519821:0:90933:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783074136.519825:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783074136.519833:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9524fa860000) 00000020:00000080:3.0:1783074136.519848:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1783074136.519858:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783074136.519860:0:90933:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783074136.519862:0:90933:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783074136.519866:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783074136.519907:0:90933:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524debee000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783074136.519924:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9524fa864d40) 00000020:00000080:3.0:1783074136.519934:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1783074136.519978:0:90933:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783074136.519987:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df77f 00000020:00000080:3.0:1783074136.520068:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783074136.520074:0:90933:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783074136.520079:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb609b3016df786 00080000:01000000:3.0:1783074136.520084:0:90933:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783074136.520087:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df78d 20000000:01000000:3.0:1783074136.522025:0:90932:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783074136.522040:0:90932:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1783074136.522132:0:90927:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783074136.522142:0:90927:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783074136.522161:0:90927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522176:0:90927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074136.522189:0:90927:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005367184s 00010000:00010000:2.0:1783074136.522194:0:90927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522201:0:90927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522207:0:90927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522214:0:90927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522220:0:90927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074136.522225:0:90927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522231:0:90927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522242:0:90927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522249:0:90927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.522262:0:90927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df794 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.522554:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3661:x1869685723545088:12345-0@lo:253:kworker.0 Request processed in 10241us (11307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074136.522563:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000004:2.0:1783074136.522646:0:3661:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783074136.522648:0:3661:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783074136.522649:0:3661:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074136.522650:0:3661:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074136.522652:0:3661:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074136.522653:0:3661:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074136.522655:0:3661:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074136.522657:0:3661:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074136.522658:0:3661:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074136.522660:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723545088:0@lo:253:kworker.0 00010000:00010000:1.0:1783074136.562781:0:90933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783074136.562903:0:90933:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0510a7c0-d9c1-4de9-a6c3-ede973deaaff idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:1.0:1783074136.562938:0:90933:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:1.0:1783074136.562959:0:90933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:1.0:1783074136.563049:0:90933:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783074136.563100:0:90933:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524d8632e40: xid 1869685708048768, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:1.0:1783074136.563110:0:90933:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9525020493c0: xid 1869685708048512, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:1.0:1783074136.563522:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9524fb4db380) 00000020:00000080:1.0:1783074136.565256:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783074136.565365:0:90933:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783074136.565374:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df7b0 00000020:00000080:2.0:1783074136.565771:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783074136.568479:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb609b3016df7b7 00000020:00000080:1.0:1783074136.568763:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783074136.568772:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074136.568777:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.568778:0:90933:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783074136.568781:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783074136.568788:0:90933:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783074136.568789:0:90933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074136.568790:0:90933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074136.568791:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783074136.568793:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.568795:0:90933:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783074136.568797:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074136.568802:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.568803:0:90933:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783074136.568807:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783074136.568850:0:90933:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783074136.568866:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074136.568868:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.568869:0:90933:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783074136.568871:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074136.568873:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.568874:0:90933:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783074136.568875:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783074136.568879:0:90933:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:1.0:1783074136.568896:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074136.568907:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9524fb4d8000) 00000020:00000080:1.0:1783074136.568918:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783074136.568921:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783074136.568962:0:90933:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783074136.568966:0:90933:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783074136.568969:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df7c5 00010000:00080000:1.0:1783074136.569006:0:90933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c809e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1783074136.570530:0:90933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783074136.571485:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074136.571495:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783074136.571526:0:90933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783074136.571559:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df7cc 00000100:00080000:1.0:1783074136.571568:0:90933:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783074136.571579:0:90933:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9524c809e800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.571612:0:90933:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ffd500 x1869685723545728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074136.571634:0:90933:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1783074136.571693:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074136.571698:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.571700:0:90933:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783074136.571703:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783074136.571705:0:90933:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1783074136.571707:0:90933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074136.571708:0:90933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074136.571709:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783074136.571711:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.571712:0:90933:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783074136.571715:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783074136.571719:0:90933:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783074136.571723:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074136.571724:0:90933:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783074136.571726:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783074136.571729:0:90933:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1783074136.571748:0:90933:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783074136.571751:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074136.571763:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9524fb4dcd40) 00000020:00000080:1.0:1783074136.571780:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783074136.571786:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1783074136.571820:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723545728:0@lo:38:llog_process_th.0 00000004:00080000:1.0:1783074136.571845:0:90933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783074136.571852:0:90933:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783074136.571858:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df7da 00010000:00080000:1.0:1783074136.571886:0:90933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c4e78000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:0.0:1783074136.571898:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.571999:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545728 00000100:00100000:2.0:1783074136.572007:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545728 00010000:00010000:1.0:1783074136.572068:0:90933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1783074136.572115:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3653 00000100:00100000:2.0:1783074136.572124:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723545728:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783074136.572147:0:8454:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2975 last 0 00000020:00000080:2.0:1783074136.572181:0:8454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df7e1 00000004:00100000:2.0:1783074136.572195:0:8454:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783074136.572292:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9524c4403800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783074136.572367:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723545728:12345-0@lo:38:llog_process_th.0 Request processed in 243us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.572375:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3653 00000100:00100000:3.0:1783074136.572449:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783074136.572458:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1783074136.572464:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783074136.572468:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783074136.572471:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c809e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783074136.572485:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723545728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074136.572579:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723545856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074136.572612:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.572653:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545856 00000100:00100000:2.0:1783074136.572658:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545856 00000100:00100000:2.0:1783074136.572705:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654 00000100:00100000:2.0:1783074136.572719:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723545856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783074136.572744:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:2.0:1783074136.572791:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723545856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.572810:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654 00000100:00100000:0.0:1783074136.572824:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723545856:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1783074136.572845:0:90933:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783074136.572873:0:90933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783074136.573123:0:90933:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1783074136.573700:0:90933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783074136.573727:0:90933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:1.0:1783074136.573858:0:90933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:3.0:1783074136.574149:0:90939:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:3.0:1783074136.574154:0:90939:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783074136.574279:0:90939:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1783074136.574297:0:90939:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783074136.574432:0:90939:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1783074136.574441:0:90939:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783074136.574632:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074136.574639:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074136.574665:0:90933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783074136.574679:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df7e8 00000100:00080000:2.0:1783074136.574685:0:90933:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074136.574689:0:90933:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9523c4e78000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074136.574709:0:90933:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c49c1f80 x1869685723545984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074136.574726:0:90933:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1783074136.574749:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723545984:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1783074136.574796:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074136.574802:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.574804:0:90933:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783074136.574807:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074136.574810:0:90933:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783074136.574811:0:90933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074136.574814:0:90933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074136.574817:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:3.0:1783074136.574818:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783074136.574821:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.574823:0:90933:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074136.574826:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783074136.574831:0:90933:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783074136.574834:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.574835:0:90933:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783074136.574839:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074136.574843:0:90933:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000100:00100000:1.0:1783074136.574863:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723545984 00000100:00100000:1.0:1783074136.574870:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723545984 00000020:01000000:2.0:1783074136.574876:0:90933:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783074136.574882:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074136.574893:0:90933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9523c2284d40) 00000020:00000080:2.0:1783074136.574910:0:90933:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000100:00100000:1.0:1783074136.574911:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:1.0:1783074136.574921:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3657:x1869685723545984:12345-0@lo:8:llog_process_th.0 00000020:00000080:2.0:1783074136.574922:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1783074136.574945:0:26174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2975 last 0 00000020:00000080:1.0:1783074136.574974:0:26174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df7f6 00002000:00100000:1.0:1783074136.574986:0:26174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9524d2470000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000004:00080000:2.0:1783074136.574990:0:90933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00002000:00080000:1.0:1783074136.574991:0:26174:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783074136.574997:0:26174:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00080000:01000000:2.0:1783074136.574999:0:90933:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783074136.575008:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016df7fd 00010000:00080000:2.0:1783074136.575037:0:90933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524fc204000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00002000:00080000:1.0:1783074136.575048:0:26174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783074136.575067:0:26174:0:(import.c:65:import_set_state_nolock()) ffff9524c5fdc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074136.575112:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723545984:12345-0@lo:8:llog_process_th.0 Request processed in 191us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.575120:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000100:00100000:3.0:1783074136.575146:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783074136.575154:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783074136.575159:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783074136.575164:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783074136.575167:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4e78000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783074136.575187:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783074136.575193:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723545984:0@lo:8:llog_process_th.0 00010000:00010000:2.0:1783074136.575245:0:90933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000004:00080000:0.0:1783074136.575254:0:90939:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783074136.575285:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074136.575298:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723546112:0@lo:13:osp-pre-0-0.0 00000040:01000000:2.0:1783074136.575355:0:90933:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783074136.575368:0:90933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000004:00080000:1.0:1783074136.575371:0:90939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2975793058602ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783074136.575378:0:90939:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783074136.575420:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.575635:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546112 00000100:00100000:1.0:1783074136.575640:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546112 00000040:00080000:2.0:1783074136.575694:0:90933:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000100:00080000:3.0:1783074136.575696:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074136.575705:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:1.0:1783074136.575715:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723546112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783074136.575732:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074136.575768:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723546112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.575784:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1783074136.575819:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723546112:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783074136.576505:0:90933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074136.576529:0:90933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:2.0:1783074136.576679:0:90933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000004:00080000:3.0:1783074136.576700:0:90919:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1783074136.577178:0:90941:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:3.0:1783074136.577183:0:90941:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074136.577307:0:90941:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1783074136.577361:0:90941:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074136.577490:0:90941:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1783074136.577494:0:90941:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783074136.577681:0:90933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074136.577690:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074136.577723:0:90933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074136.577748:0:90933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df804 00000100:00080000:2.0:1783074136.577757:0:90933:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074136.577761:0:90933:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9524fc204000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074136.577788:0:90933:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c49c3800 x1869685723546240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074136.577821:0:90933:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783074136.577877:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074136.577881:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.577883:0:90933:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783074136.577886:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074136.577890:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.577896:0:90933:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783074136.577900:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783074136.577902:0:90933:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783074136.577904:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074136.577907:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.577908:0:90933:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783074136.577911:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074136.577913:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074136.577914:0:90933:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783074136.577918:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783074136.577948:0:90933:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90933:1869685723546368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074136.577968:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723546240:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783074136.578105:0:90933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.578107:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.578174:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546240 00000100:00100000:0.0:1783074136.578181:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546240 00000100:00100000:2.0:1783074136.578206:0:90933:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d1ce8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.578211:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910 00000100:00100000:0.0:1783074136.578219:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3657:x1869685723546240:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783074136.578242:0:26166:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2975 last 0 00000020:00000080:0.0:1783074136.578264:0:26166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016df80b 00002000:00100000:0.0:1783074136.578275:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9523c6940800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783074136.578279:0:26166:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783074136.578282:0:26166:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783074136.578371:0:26166:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074136.578388:0:26166:0:(import.c:65:import_set_state_nolock()) ffff9523c6942800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074136.578424:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723546240:12345-0@lo:8:llog_process_th.0 Request processed in 206us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.578434:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910 00000100:00100000:3.0:1783074136.578440:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783074136.578447:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783074136.578453:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783074136.578457:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783074136.578459:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524fc204000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783074136.578474:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783074136.578478:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723546240:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783074136.578492:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546368 00000100:00100000:1.0:1783074136.578496:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546368 00000100:00100000:1.0:1783074136.578521:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783074136.578529:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:90933:x1869685723546368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074136.578629:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:90933:x1869685723546368:12345-0@lo:502:llog_process_th.0 Request processed in 100us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074136.578637:0:90933:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90933:1869685723546368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074136.578638:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000000:3.0:1783074136.578669:0:90933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074136.578675:0:90933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074136.578677:0:90933:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783074136.578682:0:90933:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:2.0:1783074136.578727:0:90941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783074136.578761:0:90941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2975796448734ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783074136.578769:0:90941:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1783074136.578833:0:90918:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783074136.578857:0:90918:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:0.0:1783074136.578958:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723546496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074136.578992:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074136.579062:0:90918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.579074:0:90918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.579078:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546496 00000100:00100000:3.0:1783074136.579083:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546496 10000000:01000000:1.0:1783074136.579083:0:90918:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524debee000 from 1 10000000:01000000:1.0:1783074136.579089:0:90918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783074136.579115:0:90918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.579124:0:90918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.579131:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:3.0:1783074136.579137:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723546496:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783074136.579142:0:90918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1783074136.579151:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074136.579159:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723546624:0@lo:101:mount.lustre.0 00000100:00080000:0.0:1783074136.579212:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074136.579248:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.579270:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074136.579345:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546624 00000100:00100000:2.0:1783074136.579349:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546624 00000100:00100000:2.0:1783074136.579377:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783074136.579387:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:90918:x1869685723546624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074136.579396:0:90925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074136.579409:0:90925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df812 expref: -99 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.579428:0:90925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df812 expref: 9 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074136.579429:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723546496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074136.579443:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00010000:00010000:2.0:1783074136.579447:0:90925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df812 expref: 9 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.579458:0:90925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159a00, rc 0) 00000100:00100000:3.0:1783074136.579478:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723546496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074136.579506:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:90918:x1869685723546624:12345-0@lo:101:mount.lustre.0 Request processed in 121us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.579513:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783074136.579635:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723546624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074136.579650:0:90918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.579661:0:90918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074136.580034:0:90919:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783074136.580347:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723546752:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783074136.580384:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.580406:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074136.580446:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546752 00000100:00100000:3.0:1783074136.580452:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546752 00000100:00100000:3.0:1783074136.580491:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783074136.580499:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:90918:x1869685723546752:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783074136.580513:0:90926:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783074136.580529:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783074136.580533:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783074136.580549:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783074136.580551:0:90926:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 118 00000100:00100000:3.0:1783074136.580655:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:90918:x1869685723546752:12345-0@lo:256:mount.lustre.0 Request processed in 155us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074136.580663:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783074136.580668:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723546752:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783074136.581286:0:90918:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783074136.581303:0:90918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.581328:0:90918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.581336:0:90918:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524debee000 from 1 10000000:01000000:1.0:1783074136.581338:0:90918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783074136.581360:0:90918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.581368:0:90918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.581401:0:90918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.581415:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723546880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074136.581445:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.581483:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.581497:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723546880 00000100:00100000:0.0:1783074136.581503:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723546880 00000100:00100000:0.0:1783074136.581583:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783074136.581592:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+9:90918:x1869685723546880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074136.581601:0:90932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074136.581611:0:90932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670200/0x5fb609b3016df827 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df820 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.581629:0:90932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670200/0x5fb609b3016df827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df820 expref: 10 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.581638:0:90932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670200/0x5fb609b3016df827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df820 expref: 10 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.581646:0:90932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:0.0:1783074136.581679:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723546880:12345-0@lo:101:mount.lustre.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.581686:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783074136.581709:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723546880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074136.581718:0:90918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.581723:0:90918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.581759:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074136.581778:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.581796:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.581802:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547008 00000100:00100000:0.0:1783074136.581807:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547008 00000100:00100000:0.0:1783074136.581840:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783074136.581848:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723547008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074136.581954:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723547008:12345-0@lo:501:mount.lustre.0 Request processed in 107us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.581960:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783074136.582061:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074136.582089:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074136.582127:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.582149:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074136.582173:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547136 00000100:00100000:2.0:1783074136.582177:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547136 00000100:00100000:2.0:1783074136.582205:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783074136.582223:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723547136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074136.582342:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723547136:12345-0@lo:503:mount.lustre.0 Request processed in 130us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.582348:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783074136.582406:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074136.582829:0:90943:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90943:1869685723547264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074136.582868:0:90943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.582939:0:90943:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c57d6300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074136.582973:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547264 00000100:00100000:3.0:1783074136.582984:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547264 00000100:00100000:3.0:1783074136.583048:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783074136.583056:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90943:x1869685723547264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074136.583929:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90943:x1869685723547264:12345-0@lo:502:llog_process_th.0 Request processed in 873us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074136.583941:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783074136.583951:0:90943:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90943:1869685723547264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074136.583974:0:90943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074136.583982:0:90943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074136.583985:0:90943:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783074136.583991:0:90943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524debee000 00000020:00000080:0.0:1783074136.583993:0:90943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783074136.584001:0:90943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074136.584003:0:90943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074136.584004:0:90943:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783074136.584007:0:90943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074136.584009:0:90943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074136.584011:0:90943:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783074136.584014:0:90943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524debee000 00000020:00000080:0.0:1783074136.584015:0:90943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783074136.584085:0:90943:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90943:1869685723547392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074136.584121:0:90943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.584161:0:90943:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c57d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.584190:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547392 00000100:00100000:1.0:1783074136.584196:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547392 00000100:00100000:1.0:1783074136.584234:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783074136.584242:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90943:x1869685723547392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074136.584363:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90943:x1869685723547392:12345-0@lo:502:llog_process_th.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.584374:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783074136.585476:0:90943:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90943:1869685723547392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074136.585500:0:90943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074136.585505:0:90943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074136.585506:0:90943:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783074136.585508:0:90943:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783074136.585596:0:90918:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783074136.585622:0:90918:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074136.585642:0:90918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.585653:0:90918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074136.585703:0:90918:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783074136.585707:0:90918:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9524debee000 10000000:01000000:1.0:1783074136.585710:0:90918:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9524debee000 10000000:01000000:1.0:1783074136.585714:0:90918:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783074136.585720:0:90918:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524debee000 from 1 10000000:01000000:1.0:1783074136.585722:0:90918:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074136.585746:0:90918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.585754:0:90918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.585763:0:90918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.585776:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074136.585812:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.585842:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.585849:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547520 00000100:00100000:0.0:1783074136.585855:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547520 00000100:00100000:0.0:1783074136.585902:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783074136.585912:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:90918:x1869685723547520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074136.585922:0:90932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074136.585934:0:90932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671000/0x5fb609b3016df835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df82e expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.585955:0:90932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671000/0x5fb609b3016df835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df82e expref: 11 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.585966:0:90932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671000/0x5fb609b3016df835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df82e expref: 11 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.586059:0:90932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671000, rc 0) 00000100:00100000:0.0:1783074136.586104:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723547520:12345-0@lo:101:mount.lustre.0 Request processed in 193us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.586173:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783074136.586235:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074136.586247:0:90918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.586257:0:90918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074136.586303:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074136.586353:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.586374:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.588438:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547648 00000100:00100000:1.0:1783074136.588449:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547648 00000100:00100000:1.0:1783074136.588501:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783074136.588511:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e016a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723547648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074136.588681:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e016a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723547648:12345-0@lo:501:mount.lustre.0 Request processed in 160us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.588690:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783074136.588740:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074136.588785:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074136.588828:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.588856:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547776 00000100:00100000:1.0:1783074136.588862:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.588862:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547776 00000100:00100000:0.0:1783074136.588891:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783074136.588899:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723547776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074136.588981:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723547776:12345-0@lo:503:mount.lustre.0 Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.588988:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783074136.589062:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723547776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074136.589224:0:90946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90946:1869685723547904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074136.589261:0:90946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.589280:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723547904 00000100:00100000:1.0:1783074136.589290:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723547904 00000100:00100000:1.0:1783074136.589340:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783074136.589348:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e431b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90946:x1869685723547904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074136.589421:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e431b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90946:x1869685723547904:12345-0@lo:502:llog_process_th.0 Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.589428:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783074136.589458:0:90946:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.589472:0:90946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90946:1869685723547904:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783074136.589523:0:90946:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783074136.589549:0:90946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9523c338b380) 00000020:00000080:1.0:1783074136.589574:0:90946:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783074136.589792:0:90946:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524debee000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783074136.589796:0:90946:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524debee000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783074136.589799:0:90946:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524debee000 4 00010000:00080000:1.0:1783074136.589833:0:90946:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c32ce800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1783074136.592039:0:90946:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783074136.592139:0:90946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783074136.592178:0:90946:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783074136.592186:0:90946:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb609b3016df843 00000100:00080000:1.0:1783074136.592193:0:90946:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783074136.592197:0:90946:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9523c32ce800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074136.592220:0:90946:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8fff480 x1869685723548032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074136.592245:0:90946:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783074136.592355:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723548032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074136.592415:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074136.592462:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548032 00000100:00100000:2.0:1783074136.592467:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548032 00000100:00100000:2.0:1783074136.592491:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1783074136.592497:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723548032:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783074136.592550:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723548032:12345-0@lo:38:llog_process_th.0 Request processed in 40us (123us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074136.592556:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1783074136.592589:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783074136.592594:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c32ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074136.592598:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783074136.592601:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723548032:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783074136.594613:0:90946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90946:1869685723548160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074136.594680:0:90946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.594737:0:90946:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.594811:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548160 00000100:00100000:0.0:1783074136.594818:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548160 00000100:00100000:0.0:1783074136.594867:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783074136.594877:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e431bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90946:x1869685723548160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074136.595044:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e431bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90946:x1869685723548160:12345-0@lo:502:llog_process_th.0 Request processed in 168us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.595052:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783074136.595154:0:90946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90946:1869685723548160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074136.595203:0:90946:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90946:1869685723548288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074136.595240:0:90946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074136.595308:0:90946:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.595397:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548288 00000100:00100000:1.0:1783074136.595402:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548288 00000100:00100000:1.0:1783074136.595428:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783074136.595435:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e431a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90946:x1869685723548288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074136.595572:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e431a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90946:x1869685723548288:12345-0@lo:502:llog_process_th.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.595579:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783074136.595638:0:90946:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:90946:1869685723548288:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783074136.595657:0:90946:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783074136.595814:0:90918:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783074136.595837:0:90918:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074136.595852:0:90918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074136.595862:0:90918:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783074136.595929:0:90918:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783074136.595932:0:90918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074136.595933:0:90918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074136.595934:0:90918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074136.595935:0:90918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074136.595937:0:90918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074136.595938:0:90918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074136.595939:0:90918:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074136.595941:0:90918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074136.595942:0:90918:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783074136.595945:0:90918:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783074136.595947:0:90918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783074136.595949:0:90918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074136.595950:0:90918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074136.595951:0:90918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074136.595952:0:90918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074136.595953:0:90918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074136.595954:0:90918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074136.595955:0:90918:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074136.595956:0:90918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074136.595957:0:90918:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783074136.595969:0:90918:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783074136.595979:0:90918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723548416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783074136.596021:0:90918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.596200:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548416 00000100:00100000:1.0:1783074136.596204:0:90918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c55e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074136.596206:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548416 00000100:00100000:0.0:1783074136.596235:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783074136.596241:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723548416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783074136.596260:0:90932:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783074136.596274:0:90932:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783074136.597224:0:90932:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783074136.597237:0:90932:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783074136.597262:0:90927:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783074136.597268:0:90927:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783074136.597288:0:90927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.597331:0:90927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.597341:0:90927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.597383:0:90927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.597398:0:90927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074136.597411:0:90927:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90927:1869685723548544:0@lo:104: 00000100:00100000:2.0:1783074136.597465:0:90927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.597484:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:90918:x1869685723548416:12345-0@lo:253:mount.lustre.0 Request processed in 1239us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.597495:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783074136.597497:0:90927:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d1ce8180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074136.597516:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548544 00000100:00100000:2.0:1783074136.597520:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548544 00000100:00100000:0.0:1783074136.597554:0:90918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:90918:1869685723548416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783074136.597565:0:90918:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783074136.597567:0:90918:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783074136.597569:0:90918:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783074136.597570:0:90918:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074136.597572:0:90918:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074136.597574:0:90918:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074136.597575:0:90918:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074136.597577:0:90918:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074136.597579:0:90918:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:2.0:1783074136.597582:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000020:01000004:0.0:1783074136.597582:0:90918:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074136.597585:0:90918:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074136.597596:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:90927:x1869685723548544:12345-0@lo:104: 00000020:02000000:0.0:1783074136.597601:0:90918:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783074136.597620:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074136.597658:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783074136.597662:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:90927:x1869685723548544:12345-0@lo:104: Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074136.597669:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783074136.597717:0:90927:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90927:1869685723548544:0@lo:104: 00010000:00010000:2.0:1783074136.597745:0:90927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598107:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074136.598115:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598136:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074136.598140:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598150:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074136.598158:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074136.598165:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074136.598200:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598208:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074136.598243:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074136.598252:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723548672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074136.598253:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6000/0x5fb609b3016df812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016df819 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598277:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074136.598280:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074136.598283:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074136.598293:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.598823:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548672 00000100:00100000:0.0:1783074136.598829:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548672 00010000:00010000:0.0:1783074136.598848:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074136.598884:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1783074136.598899:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3661:x1869685723548672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074136.598911:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074136.598917:0:19655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598929:0:19655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598941:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159a00/0x5fb609b3016df819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016df812 expref: 11 pid: 90925 timeout: 3075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598954:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598962:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074136.598975:0:19655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005367184s 00010000:00010000:0.0:1783074136.598980:0:19655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598987:0:19655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598993:0:19655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.598999:0:19655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.599003:0:19655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074136.599012:0:19655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.599019:0:19655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.599035:0:19655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.599045:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074136.599195:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3661:x1869685723548672:12345-0@lo:103:ldlm_bl.0 Request processed in 293us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074136.599204:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:2.0:1783074136.599226:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723548672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074136.599232:0:90927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.599242:0:90927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074136.599249:0:90927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159800/0x5fb609b3016df84a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074136.603665:0:90918:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:3.0:1783074136.604401:0:90918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783074136.604461:0:90951:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:2.0:1783074136.604466:0:90951:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:2.0:1783074136.604774:0:90952:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783074136.604981:0:90918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783074136.605072:0:90952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783074136.605505:0:90953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90953:1869685723548800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074136.605584:0:90953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.605614:0:90953:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c64386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.605634:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548800 00000100:00100000:1.0:1783074136.605643:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548800 00000100:00100000:1.0:1783074136.605693:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655 00000100:00100000:1.0:1783074136.605705:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90953:x1869685723548800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074136.605807:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90953:x1869685723548800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.605816:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655 00000100:00100000:0.0:1783074136.605827:0:90953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90953:1869685723548800:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783074136.605850:0:90918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:01000000:0.0:1783074136.605857:0:90953:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783074136.605886:0:90953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90953:1869685723548928:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783074136.605890:0:90918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783074136.605917:0:90953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074136.605949:0:90953:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3cc9240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.606028:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723548928 00000100:00100000:1.0:1783074136.606033:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723548928 00000100:00100000:1.0:1783074136.606061:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3656 00000100:00100000:1.0:1783074136.606066:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90953:x1869685723548928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074136.606167:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90953:x1869685723548928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.606174:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3656 00000100:00100000:0.0:1783074136.606226:0:90953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90953:1869685723548928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074136.606267:0:90953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90953:1869685723549056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783074136.606290:0:90953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074136.606400:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549056 00000100:00100000:1.0:1783074136.606405:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549056 00000100:00100000:0.0:1783074136.606414:0:90953:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074136.606435:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657 00000100:00100000:1.0:1783074136.606442:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90953:x1869685723549056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074136.606495:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90953:x1869685723549056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074136.606502:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657 00000100:00100000:0.0:1783074136.606656:0:90953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90953:1869685723549056:0@lo:1000:lod0000_rec0001.0 00000004:00000080:3.0:1783074136.606775:0:90918:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783074136.606781:0:90918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783074136.606811:0:90918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074136.606903:0:90953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074136.610006:0:90952:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783074136.610065:0:90952:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1783074136.610578:0:90918:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783074136.611874:0:90918:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783074136.611910:0:90918:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783074136.612001:0:90918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783074136.612512:0:90918:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000040:00080000:0.0:1783074136.613840:0:90953:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783074136.613903:0:90953:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783074136.613907:0:90953:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1783074136.614485:0:90918:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00010000:00080000:3.0:1783074136.615111:0:90954:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90954 00010000:02000000:3.0:1783074136.615128:0:90954:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1783074136.615132:0:90954:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1783074136.615135:0:90954:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783074136.615182:0:90918:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783074136.615195:0:90918:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783074136.615208:0:90918:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783074136.615219:0:90918:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783074136.616024:0:90918:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074136.616269:0:90918:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783074136.686394:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074137.519172:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723549184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074137.519244:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074137.519685:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549184 00000100:00100000:1.0:1783074137.519693:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549184 00000100:00100000:1.0:1783074137.519744:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1783074137.519753:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723549184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074137.519784:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074137.519992:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723549184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 239us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074137.520000:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1783074137.520059:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723549312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074137.520086:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074137.520116:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549312 00000100:00100000:1.0:1783074137.520119:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549312 00000100:00100000:1.0:1783074137.520142:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1783074137.520148:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723549312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074137.520159:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074137.520191:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723549312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074137.520197:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1783074137.520234:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723549312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074137.520798:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723549184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074137.584705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074137.584756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074137.584794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074137.584815:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074137.584837:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074137.584871:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059776 00000100:00100000:3.0:1783074137.584879:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059776 00000100:00100000:1.0:1783074137.584899:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059520 00000100:00100000:1.0:1783074137.584905:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059520 00000100:00100000:3.0:1783074137.584933:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059648 00000100:00100000:3.0:1783074137.584938:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059648 00000100:00100000:1.0:1783074137.584947:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:1.0:1783074137.584960:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e431b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:2405:x1869685708059520:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074137.584968:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 817 00000100:00100000:3.0:1783074137.584978:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708059776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074137.585038:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e431b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:2405:x1869685708059520:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074137.585046:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1783074137.585047:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708059904 00000100:00100000:2.0:1783074137.585053:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708059904 00000100:00100000:2.0:1783074137.585090:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060032 00000100:00100000:1.0:1783074137.585094:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1209 00000100:00100000:2.0:1783074137.585095:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060032 00000100:00100000:1.0:1783074137.585103:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869685708059648:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:2.0:1783074137.585120:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2137 00010000:00080000:1.0:1783074137.585127:0:67186:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0510a7c0-d9c1-4de9-a6c3-ede973deaaff' at ffff9524c3568000, cookie 0x5fb609b3016df79b 00000100:00100000:2.0:1783074137.585129:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708059904:12345-192.168.204.26@tcp:400:kworker.0 00010000:00080000:1.0:1783074137.585145:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp recovering/t111669149704 exp ffff9524c3568000 cur 2976 last 1783074136 00010000:02000400:1.0:1783074137.585155:0:67186:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1783074137.585161:0:67186:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783074137.585181:0:67186:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783074137.585256:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708059776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 220us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074137.585265:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 817 00000100:00100000:3.0:1783074137.585296:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2138 00000100:00100000:3.0:1783074137.585305:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708060032:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1783074137.585337:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524c6022000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074137.585383:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708059648:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 279us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074137.585390:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1209 00000100:00100000:2.0:1783074137.585429:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708059904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 301us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074137.585436:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2137 00000100:00080000:1.0:1783074137.585447:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074137.585452:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074137.585455:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074137.585871:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2405:x1869685708060032:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 567us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074137.585879:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2138 00000100:00100000:2.0:1783074137.588000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074137.588067:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708049664 00000100:00100000:3.0:1783074137.588074:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708049664 00000100:00100000:3.0:1783074137.588126:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1210 00000100:00100000:3.0:1783074137.588137:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708049664:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00080000:3.0:1783074137.588155:0:68632:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:3.0:1783074137.588169:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708049664:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 36us (176us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074137.588176:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1210 00010000:00080000:1.0:1783074137.588211:0:90954:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1783074137.710480:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074137.902815:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074137.902935:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060160 00000100:00100000:2.0:1783074137.902945:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060160 00000100:00100000:2.0:1783074137.902998:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1783074137.903009:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df391850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:42363:x1869685708060160:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074137.903027:0:90925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074137.903046:0:90925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3159800/0x5fb609b3016df851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0f2 expref: -99 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074137.903072:0:90925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159800/0x5fb609b3016df851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f2 expref: 10 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074137.903083:0:90925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3159800/0x5fb609b3016df851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f2 expref: 10 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074137.903092:0:90925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159800, rc 0) 00000100:00100000:2.0:1783074137.903158:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df391850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708060160:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 151us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074137.903165:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1783074137.909917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074137.910290:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060288 00000100:00100000:1.0:1783074137.910303:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060288 00000100:00100000:1.0:1783074137.910383:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:1.0:1783074137.910393:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708060288:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783074137.910417:0:90924:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1783074137.910433:0:90924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783074137.910437:0:90924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783074137.910440:0:90924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783074137.910443:0:90924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783074137.910446:0:90924:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:3.0:1783074137.916000:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:42363:x1869685708060288:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 5598us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074137.916016:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 10000000:01000000:1.0:1783074138.479356:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783074138.479363:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524debee000 from 119 10000000:01000000:1.0:1783074138.479368:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783074138.479620:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.479633:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.479645:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.479671:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.479758:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.479810:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.480090:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549440 00000100:00100000:1.0:1783074138.480097:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549440 00000100:00100000:1.0:1783074138.480156:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783074138.480174:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:6527:x1869685723549440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.480188:0:90932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.480201:0:90932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016df85f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df858 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.480226:0:90932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016df85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df858 expref: 11 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.480238:0:90932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016df85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df858 expref: 11 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.480246:0:90932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6a00, rc 0) 00000100:00100000:1.0:1783074138.480298:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723549440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.480306:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783074138.480352:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074138.480370:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.480390:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.480439:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.480471:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.480497:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.480536:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549568 00000100:00100000:2.0:1783074138.480541:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549568 00000100:00100000:2.0:1783074138.480581:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783074138.480590:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c30ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723549568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074138.480610:0:90926:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783074138.480625:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074138.480629:0:90926:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 119 00000100:00100000:2.0:1783074138.480723:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c30ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723549568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.480731:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783074138.480737:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783074138.480783:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783074138.480790:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.480798:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074138.480806:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074138.480808:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 52 10000000:01000000:0.0:1783074138.480810:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074138.480824:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.480831:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.480838:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.480849:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.480881:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.480902:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.481083:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549696 00000100:00100000:1.0:1783074138.481088:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549696 00000100:00100000:1.0:1783074138.481118:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783074138.481124:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723549696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.481131:0:90932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.481139:0:90932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6400/0x5fb609b3016df86d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df866 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.481154:0:90932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6400/0x5fb609b3016df86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df866 expref: 12 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.481162:0:90932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6400/0x5fb609b3016df86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df866 expref: 12 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.481178:0:90932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6400, rc 0) 00000100:00100000:1.0:1783074138.481215:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723549696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.481221:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783074138.481307:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074138.481426:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.481435:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.481497:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.481623:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.481650:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074138.482369:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549824 00000100:00100000:0.0:1783074138.482373:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549824 00000100:00100000:0.0:1783074138.482408:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783074138.482414:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723549824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.483544:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723549824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1125us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074138.483553:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783074138.483653:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.483693:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.483739:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.483766:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.484203:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723549952 00000100:00100000:1.0:1783074138.484209:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723549952 00000100:00100000:1.0:1783074138.484250:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783074138.484259:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723549952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.484370:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723549952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.484377:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783074138.484406:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723549952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074138.485510:0:91185:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783074138.486079:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783074138.486100:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074138.486110:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.486121:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074138.486130:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783074138.486133:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 116 10000000:01000000:1.0:1783074138.486136:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783074138.486164:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.486173:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.486193:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.486212:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.486259:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.486300:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074138.486607:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550080 00000100:00100000:3.0:1783074138.486614:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550080 00000100:00100000:3.0:1783074138.486661:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783074138.486672:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723550080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074138.486683:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074138.486698:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299200/0x5fb609b3016df87b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df874 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.486723:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299200/0x5fb609b3016df87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df874 expref: 13 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.486734:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299200/0x5fb609b3016df87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df874 expref: 13 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.486744:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299200, rc 0) 00000100:00100000:3.0:1783074138.486883:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723550080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074138.486890:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783074138.486954:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074138.486972:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.486981:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074138.487092:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fababb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.487121:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074138.487216:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.487256:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550208 00000100:00100000:2.0:1783074138.487260:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550208 00000100:00100000:3.0:1783074138.487405:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783074138.487412:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723550208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783074138.487426:0:90925:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783074138.487439:0:90925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783074138.487442:0:90925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783074138.487445:0:90925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783074138.487448:0:90925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783074138.487450:0:90925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:3.0:1783074138.487635:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723550208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074138.487643:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783074138.487702:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fababb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783074138.487772:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074138.487778:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.487786:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074138.487797:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783074138.487799:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783074138.488001:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074138.488021:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.488030:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.488039:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.488052:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.488078:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.488107:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074138.488156:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550336 00000100:00100000:0.0:1783074138.488161:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550336 00000100:00100000:0.0:1783074138.488260:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783074138.488270:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723550336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074138.488279:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074138.488291:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670600/0x5fb609b3016df889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df882 expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.488344:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670600/0x5fb609b3016df889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df882 expref: 14 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.488353:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670600/0x5fb609b3016df889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df882 expref: 14 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.488361:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670600, rc 0) 00000100:00100000:0.0:1783074138.488400:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723550336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074138.488407:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783074138.488414:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074138.488428:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.488436:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.488485:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.488525:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074138.489599:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550464 00000100:00100000:3.0:1783074138.489607:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550464 00000100:00100000:2.0:1783074138.489619:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074138.489650:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783074138.489659:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723550464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.489817:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723550464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074138.489826:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783074138.489981:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.490014:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.490057:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.490261:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550592 00000100:00100000:0.0:1783074138.490265:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550592 00000100:00100000:2.0:1783074138.490267:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074138.490291:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783074138.490297:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723550592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.491177:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723550592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 878us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.491184:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783074138.491261:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074138.492708:0:91188:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1783074138.493205:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1783074138.493223:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783074138.493233:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.493241:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074138.493247:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783074138.493249:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9523c6b72800 from 1 10000000:01000000:2.0:1783074138.493251:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783074138.493277:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.493282:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.493289:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.493304:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.493371:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074138.493407:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550720 00000100:00100000:3.0:1783074138.493415:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550720 00000100:00100000:3.0:1783074138.493475:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783074138.493484:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723550720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074138.493514:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074138.493526:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298400/0x5fb609b3016df897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df890 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493553:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298400/0x5fb609b3016df897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df890 expref: 15 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493565:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298400/0x5fb609b3016df897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df890 expref: 15 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493575:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298400, rc 0) 00000100:00100000:3.0:1783074138.493620:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723550720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074138.493628:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783074138.493681:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783074138.493702:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074138.493716:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493725:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074138.493739:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783074138.493744:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493750:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074138.493767:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783074138.493769:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c6b72800 from 7 10000000:01000000:3.0:1783074138.493772:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074138.493786:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493793:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.493800:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074138.493811:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.493838:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074138.493865:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.494042:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550848 00000100:00100000:2.0:1783074138.494046:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550848 00000100:00100000:2.0:1783074138.494077:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783074138.494082:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723550848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074138.494088:0:90932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074138.494094:0:90932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3158400/0x5fb609b3016df8a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df89e expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.494105:0:90932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3158400/0x5fb609b3016df8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df89e expref: 16 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.494111:0:90932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3158400/0x5fb609b3016df8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df89e expref: 16 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.494115:0:90932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158400, rc 0) 00000100:00100000:2.0:1783074138.494145:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723550848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.494150:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783074138.494285:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074138.494298:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.494308:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074138.494378:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.494407:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074138.494444:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.494656:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723550976 00000100:00100000:2.0:1783074138.494661:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723550976 00000100:00100000:2.0:1783074138.494693:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783074138.494700:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faa66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723550976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.495288:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faa66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723550976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 587us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.495295:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783074138.496650:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723550976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.496698:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.496752:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.496782:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551104 00000100:00100000:1.0:1783074138.496786:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.496788:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551104 00000100:00100000:2.0:1783074138.496832:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783074138.496840:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723551104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.496932:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723551104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.496945:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783074138.497264:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074138.497938:0:91192:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074138.498031:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074138.498057:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074138.498067:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.498077:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074138.498085:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074138.498088:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 52 10000000:01000000:0.0:1783074138.498091:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074138.498118:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.498138:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.498147:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.498163:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.498202:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.498237:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.498287:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551232 00000100:00100000:1.0:1783074138.498292:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551232 00000100:00100000:1.0:1783074138.498352:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783074138.498361:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723551232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.498370:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.498382:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6000/0x5fb609b3016df8b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df8ac expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.498402:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6000/0x5fb609b3016df8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df8ac expref: 17 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.498411:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6000/0x5fb609b3016df8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df8ac expref: 17 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.498430:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6000, rc 0) 00000100:00100000:1.0:1783074138.498462:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723551232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.498468:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783074138.498560:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074138.498574:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.498582:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.498625:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.498643:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.498668:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.498681:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551360 00000100:00100000:1.0:1783074138.498685:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551360 00000100:00100000:1.0:1783074138.498714:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783074138.498721:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723551360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.498829:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723551360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.498836:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783074138.498920:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.498945:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.498981:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.499005:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.499053:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551488 00000100:00100000:1.0:1783074138.499057:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551488 00000100:00100000:1.0:1783074138.499116:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783074138.499133:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723551488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.499209:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723551488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.499216:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783074138.499432:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074138.500174:0:91193:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783074138.500407:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783074138.500431:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074138.500439:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.500449:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074138.500467:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783074138.500469:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783074138.500472:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783074138.500493:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.500516:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.500526:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.500542:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.500579:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.500607:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074138.500677:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551616 00000100:00100000:0.0:1783074138.500683:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551616 00000100:00100000:0.0:1783074138.500710:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783074138.500718:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723551616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074138.500727:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074138.500736:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670e00/0x5fb609b3016df8c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df8ba expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.500755:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670e00/0x5fb609b3016df8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df8ba expref: 18 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.500764:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670e00/0x5fb609b3016df8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df8ba expref: 18 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.500772:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670e00, rc 0) 00000100:00100000:0.0:1783074138.500801:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723551616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074138.500807:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783074138.500885:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.500898:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.500907:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.500952:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.500981:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.501035:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074138.501065:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551744 00000100:00100000:0.0:1783074138.501069:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551744 00000100:00100000:0.0:1783074138.501127:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783074138.501135:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f3c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723551744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.501246:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f3c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723551744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074138.501254:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783074138.501381:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.501407:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.501443:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.501457:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.501468:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723551872 00000100:00100000:1.0:1783074138.501471:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723551872 00000100:00100000:1.0:1783074138.501491:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783074138.501497:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723551872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.502871:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723551872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1367us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.502882:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783074138.502953:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723551872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074138.503531:0:91195:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783074138.503578:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783074138.503607:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783074138.503619:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.503629:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074138.503637:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783074138.503640:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49f9000 from 7 10000000:01000000:1.0:1783074138.503643:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783074138.503670:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.503679:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.503688:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.503715:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.503754:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.503788:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d018ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.503807:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552000 00000100:00100000:1.0:1783074138.503811:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552000 00000100:00100000:1.0:1783074138.503846:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783074138.503854:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723552000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.503861:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.503871:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6600/0x5fb609b3016df8cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df8c8 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.503889:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6600/0x5fb609b3016df8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df8c8 expref: 19 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.503896:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6600/0x5fb609b3016df8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df8c8 expref: 19 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.503902:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6600, rc 0) 00000100:00100000:1.0:1783074138.503931:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723552000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.503938:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783074138.503955:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074138.504267:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.504366:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.504427:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.504461:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.504488:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.504511:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552128 00000100:00100000:1.0:1783074138.504516:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552128 00000100:00100000:1.0:1783074138.504548:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783074138.504555:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723552128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.504833:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723552128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.504847:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783074138.504919:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.504948:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.505178:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.505199:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.505406:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552256 00000100:00100000:1.0:1783074138.505412:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552256 00000100:00100000:1.0:1783074138.505438:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783074138.505446:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723552256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.505614:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723552256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.505620:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783074138.505666:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074138.506382:0:91197:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783074138.506432:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783074138.506456:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074138.506466:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.506476:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074138.506485:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074138.506488:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 52 10000000:01000000:1.0:1783074138.506491:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074138.506529:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.506537:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.506546:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.506573:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.506613:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.506646:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.506739:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552384 00000100:00100000:2.0:1783074138.506756:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552384 00000100:00100000:2.0:1783074138.506797:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783074138.506806:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723552384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074138.506817:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074138.506829:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3158000/0x5fb609b3016df8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df8d6 expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.506851:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3158000/0x5fb609b3016df8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df8d6 expref: 20 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.506875:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3158000/0x5fb609b3016df8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df8d6 expref: 20 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.506886:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158000, rc 0) 00000100:00100000:2.0:1783074138.506926:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723552384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.506933:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783074138.508604:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.508625:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.508635:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.508707:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.508756:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.508807:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.509207:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552512 00000100:00100000:2.0:1783074138.509212:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552512 00000100:00100000:2.0:1783074138.509252:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783074138.509262:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723552512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.509400:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723552512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.509408:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783074138.509935:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.509985:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.510030:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.510064:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.510263:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552640 00000100:00100000:2.0:1783074138.510268:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552640 00000100:00100000:2.0:1783074138.510302:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783074138.510331:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723552640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.510419:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723552640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074138.510426:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783074138.510524:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074138.512027:0:91198:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783074138.512203:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783074138.512224:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074138.512235:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.512256:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074138.512271:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783074138.512273:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783074138.512276:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783074138.512306:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.512346:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.512355:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.512372:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.512414:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.512828:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524ca593780 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.513281:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552768 00000100:00100000:1.0:1783074138.513287:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552768 00000100:00100000:1.0:1783074138.513353:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783074138.513361:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723552768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.513372:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.513389:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df39c400/0x5fb609b3016df8eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df8e4 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.513410:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df39c400/0x5fb609b3016df8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df8e4 expref: 21 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.513420:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df39c400/0x5fb609b3016df8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df8e4 expref: 21 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.513433:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df39c400, rc 0) 00000100:00100000:1.0:1783074138.513473:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723552768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.513480:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783074138.513530:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.513543:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.513552:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074138.513601:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.513625:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074138.513647:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.513661:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723552896 00000100:00100000:1.0:1783074138.513664:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723552896 00000100:00100000:1.0:1783074138.513693:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783074138.513700:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723552896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.513815:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723552896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.513833:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783074138.513871:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723552896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.513904:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.513949:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.513971:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb57a480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.514993:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553024 00000100:00100000:1.0:1783074138.514999:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553024 00000100:00100000:1.0:1783074138.515036:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783074138.515048:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723553024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.515761:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723553024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 716us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.515769:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783074138.515859:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074138.516945:0:91199:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783074138.520581:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783074138.520619:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783074138.520631:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.520644:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074138.520653:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783074138.520656:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f4a91000 from 7 10000000:01000000:0.0:1783074138.520659:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783074138.520695:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.520703:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.520713:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.520736:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.520795:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.520833:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.520846:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553152 00000100:00100000:1.0:1783074138.520854:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553152 00000100:00100000:1.0:1783074138.520946:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783074138.520967:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723553152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.520981:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.520993:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df39c000/0x5fb609b3016df8f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df8f2 expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.521016:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df39c000/0x5fb609b3016df8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df8f2 expref: 22 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.521026:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df39c000/0x5fb609b3016df8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df8f2 expref: 22 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.521035:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df39c000, rc 0) 00000100:00100000:1.0:1783074138.521081:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723553152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.521089:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783074138.521205:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074138.521218:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074138.521238:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074138.522300:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074138.522363:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074138.522396:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f454e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.522439:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553280 00000100:00100000:1.0:1783074138.522452:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553280 00000100:00100000:1.0:1783074138.522492:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783074138.522499:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723553280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.522612:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723553280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.522620:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783074138.522699:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.522735:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.522776:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074138.522812:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.522852:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553408 00000100:00100000:1.0:1783074138.522856:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553408 00000100:00100000:1.0:1783074138.522880:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783074138.522887:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723553408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074138.522961:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723553408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.522967:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783074138.523033:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074138.524946:0:91201:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783074138.525366:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783074138.525392:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783074138.525407:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.525419:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074138.525429:0:6527:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1783074138.525432:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9524e69d19c0 from 1 10000000:01000000:2.0:1783074138.525435:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783074138.525485:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.525494:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.525512:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.525534:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.525591:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.525618:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524ca593300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.526060:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553536 00000100:00100000:1.0:1783074138.526068:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553536 00000100:00100000:1.0:1783074138.526117:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783074138.526125:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723553536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.526137:0:90926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.526150:0:90926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df39d800/0x5fb609b3016df907 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df900 expref: -99 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.526171:0:90926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df39d800/0x5fb609b3016df907 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df900 expref: 23 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.526181:0:90926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df39d800/0x5fb609b3016df907 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df900 expref: 23 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.526199:0:90926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df39d800, rc 0) 00000100:00100000:1.0:1783074138.526303:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723553536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.526333:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783074138.526682:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074138.526699:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.526709:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074138.526727:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783074138.526731:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.526736:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074138.526742:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783074138.526744:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:2.0:1783074138.526747:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783074138.526766:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.526779:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074138.526787:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074138.526801:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.526837:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.526861:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524ca593300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074138.527121:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553664 00000100:00100000:1.0:1783074138.527126:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553664 00000100:00100000:1.0:1783074138.527160:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783074138.527167:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723553664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074138.527176:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074138.527185:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df39d000/0x5fb609b3016df915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016df90e expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.527202:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df39d000/0x5fb609b3016df915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016df90e expref: 24 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.527277:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df39d000/0x5fb609b3016df915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016df90e expref: 24 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074138.527285:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df39d000, rc 0) 00000100:00100000:1.0:1783074138.527338:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723553664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074138.527344:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783074138.527387:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074138.527400:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.527409:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074138.527545:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074138.527576:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074138.527600:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553792 00000100:00100000:2.0:1783074138.527605:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553792 00000100:00100000:3.0:1783074138.527618:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783074138.527639:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783074138.527646:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723553792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074138.527719:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723553792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (141us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074138.527727:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783074138.527746:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723553792:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783074138.527781:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783074138.527787:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074138.527795:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1783074138.541675:0:91204:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783074138.734488:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783074139.017850:0:91256:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783074139.018085:0:91256:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1783074139.529830:0:91306:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783074139.530051:0:91306:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783074139.758636:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074140.782484:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074141.614539:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783074141.614546:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723553920:0@lo:400:kworker.0 00000100:00080000:2.0:1783074141.614559:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074141.614563:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074141.614572:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2975 00000100:00080000:2.0:1783074141.614576:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783074141.614585:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074141.614609:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523caed2d80 x1869685723554048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074141.614651:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074141.614668:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074141.614672:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074141.614674:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074141.614678:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2975 00000100:00100000:0.0:1783074141.614704:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074141.614711:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723554176:0@lo:400:kworker.0 00000100:00080000:2.0:1783074141.614753:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783074141.614760:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074141.614775:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.614777:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df3bb480 x1869685723554304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074141.614819:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074141.614823:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074141.614826:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074141.614830:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2975 00000100:00080000:2.0:1783074141.614833:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783074141.614838:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074141.614863:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723553920 00000100:00100000:1.0:1783074141.614863:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554176 00000100:00100000:2.0:1783074141.614869:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4b78a80 x1869685723554688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074141.614870:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723553920 00000100:00100000:1.0:1783074141.614871:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554176 00000100:00100000:0.0:1783074141.614887:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723554560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074141.614915:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1783074141.614920:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074141.614927:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783074141.614928:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723553920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074141.614931:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074141.614936:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2975 00000100:00080000:2.0:1783074141.614940:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783074141.614946:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074141.614947:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1783074141.614953:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074141.614960:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723554176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.614963:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4af7800 x1869685723555072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074141.614998:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074141.615008:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723554432:0@lo:400:kworker.0 00000100:00100000:3.0:1783074141.615019:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723553920:12345-0@lo:400:kworker.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074141.615028:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1783074141.615029:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783074141.615036:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783074141.615036:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723554176:12345-0@lo:400:kworker.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00080000:2.0:1783074141.615041:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c32ce800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783074141.615049:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00080000:2.0:1783074141.615051:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9523c32ce800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074141.615068:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc258380 x1869685723555584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074141.615075:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723554048:0@lo:38:kworker.0 00000100:00080000:1.0:1783074141.615075:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074141.615094:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074141.615102:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723554944:0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.615103:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723555200:0@lo:400:kworker.0 00000100:00100000:0.0:1783074141.615138:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723555328:0@lo:400:kworker.0 00000100:00100000:1.0:1783074141.615146:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.615160:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074141.615170:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783074141.615179:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723554816:0@lo:400:kworker.0 00000100:00100000:0.0:1783074141.615191:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074141.615211:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.615228:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554944 00000100:00100000:1.0:1783074141.615228:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.615235:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554944 00000100:00100000:3.0:1783074141.615252:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723554304:0@lo:38:kworker.0 00000100:00100000:1.0:1783074141.615260:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723555456:0@lo:400:kworker.0 00000100:00100000:0.0:1783074141.615272:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723554176:0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.615277:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555328 00000100:00100000:2.0:1783074141.615281:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555328 00000100:00100000:0.0:1783074141.615288:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723553920:0@lo:400:kworker.0 00000100:00100000:3.0:1783074141.615293:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074141.615301:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.615331:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554816 00000100:00100000:2.0:1783074141.615335:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554816 00000100:00100000:0.0:1783074141.615351:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555456 00000100:00100000:0.0:1783074141.615356:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555456 00000100:00100000:2.0:1783074141.615369:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1783074141.615386:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723554944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074141.615401:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1783074141.615416:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723555328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074141.615719:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723554688:0@lo:38:kworker.0 00000100:00100000:1.0:1783074141.615742:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554432 00000100:00100000:1.0:1783074141.615747:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554432 00000100:00100000:0.0:1783074141.615752:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723555328:12345-0@lo:400:kworker.0 Request processed in 335us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074141.615755:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723554944:12345-0@lo:400:kworker.0 Request processed in 370us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074141.615767:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:1.0:1783074141.615775:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554048 00000100:00100000:1.0:1783074141.615779:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554048 00000100:00100000:1.0:1783074141.615794:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554304 00000100:00100000:1.0:1783074141.615796:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554304 00000100:00100000:1.0:1783074141.615810:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:3.0:1783074141.615815:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074141.615822:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074141.615843:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723555072:0@lo:38:kworker.0 00000100:00100000:1.0:1783074141.615862:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723554432:12345-0@lo:400:kworker.0 Request processed in 41us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.615870:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1783074141.615882:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1783074141.615886:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723554048:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074141.615892:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783074141.615916:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2980 last 0 00000100:00100000:3.0:1783074141.615926:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723555584:0@lo:38:kworker.0 00000020:00000080:1.0:1783074141.615955:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016df91c 00000100:00100000:3.0:1783074141.615958:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:1.0:1783074141.615978:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783074141.615986:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555072 00000100:00100000:2.0:1783074141.615987:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:3.0:1783074141.615991:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555072 00000100:00100000:0.0:1783074141.615996:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:0.0:1783074141.616009:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.616014:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:3.0:1783074141.616016:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555584 00000100:00100000:3.0:1783074141.616020:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555584 00000100:00100000:2.0:1783074141.616026:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723555456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074141.616038:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1783074141.616046:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723554304:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074141.616052:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723554816:12345-0@lo:400:kworker.0 Request processed in 47us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074141.616060:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00010000:00080000:3.0:1783074141.616065:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2980 last 0 00000100:00100000:2.0:1783074141.616078:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723555456:12345-0@lo:400:kworker.0 Request processed in 53us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074141.616087:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1783074141.616104:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723555328:0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.616116:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554560 00000100:00100000:0.0:1783074141.616120:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723554432:0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.616129:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554560 00000100:00100000:2.0:1783074141.616166:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555200 00000100:00100000:2.0:1783074141.616169:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555200 00000100:00080000:1.0:1783074141.616170:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524c6e2d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074141.616180:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723554688 00000100:00100000:0.0:1783074141.616185:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723554688 00000100:00100000:2.0:1783074141.616191:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658 00000100:00100000:2.0:1783074141.616199:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3659:x1869685723554560:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074141.616207:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3659 00000100:00100000:0.0:1783074141.616217:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3658:x1869685723555200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074141.616222:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723554048:12345-0@lo:38:kworker.0 Request processed in 331us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.616230:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1783074141.616260:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3658:x1869685723555200:12345-0@lo:400:kworker.0 Request processed in 46us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074141.616266:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3659 00000020:00000080:3.0:1783074141.616278:0:66202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb609b3016df923 00000100:00100000:0.0:1783074141.616281:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660 00000100:00100000:0.0:1783074141.616287:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723554688:12345-0@lo:38:kworker.0 00000004:00100000:3.0:1783074141.616294:0:66202:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1783074141.616305:0:8453:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9524c356a800, cookie 0x5fb609b3016df7a2 00000004:00000024:2.0:1783074141.616334:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00080000:3.0:1783074141.616345:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524d08ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074141.616350:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1783074141.616357:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723555072:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783074141.616372:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2980 last 0 00000100:00100000:2.0:1783074141.616380:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723554560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 181us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074141.616388:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658 00000100:00100000:3.0:1783074141.616397:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fababb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869685723554304:12345-0@lo:38:kworker.0 Request processed in 349us (1106us total) trans 0 rc 0/0 00000020:00000080:1.0:1783074141.616400:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb609b3016df92a 00000100:00100000:3.0:1783074141.616410:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000004:00100000:1.0:1783074141.616411:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783074141.616433:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524c6e2c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074141.616434:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1783074141.616440:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723555200:0@lo:400:kworker.0 00000100:00100000:2.0:1783074141.616484:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723554560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074141.616490:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869685723555072:12345-0@lo:38:kworker.0 Request processed in 131us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.616498:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00010000:00080000:0.0:1783074141.616512:0:8453:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9524c356a800 cur 2980 last 1783074136 00000004:00100000:0.0:1783074141.616525:0:8453:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783074141.616532:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723555584:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783074141.616548:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9524f08dd000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1783074141.616552:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2980 last 0 00000100:00100000:1.0:1783074141.616572:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723554816:0@lo:400:kworker.0 00000020:00000080:3.0:1783074141.616585:0:66202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb609b3016df931 00000100:00100000:1.0:1783074141.616588:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723555456:0@lo:400:kworker.0 00000004:00100000:3.0:1783074141.616596:0:66202:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783074141.616607:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723554944:0@lo:400:kworker.0 00000100:00100000:0.0:1783074141.616610:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723554688:12345-0@lo:38:kworker.0 Request processed in 320us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074141.616621:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660 00000100:00080000:3.0:1783074141.616622:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9524f4945800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1783074141.616642:0:90954:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00080000:2.0:1783074141.616647:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783074141.616649:0:90954:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 111669149704 00000100:00080000:2.0:1783074141.616654:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1783074141.616655:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074141.616660:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:1.0:1783074141.616664:0:90954:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:1.0:1783074141.616667:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:3.0:1783074141.616669:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723555584:12345-0@lo:38:kworker.0 Request processed in 224us (708us total) trans 0 rc 0/0 00000100:00080000:2.0:1783074141.616670:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783074141.616680:0:90954:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708049664 t111669149704 from 192.168.204.26@tcp req@ffff9524df768700 x1869685708049664/t0(111669149704) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:463/0 lens 528/0 e 0 to 0 dl 1783074148 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783074141.616682:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524fc258380 x1869685723555584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074141.616684:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00080000:0.0:1783074141.616711:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:0.0:1783074141.616721:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783074141.616727:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783074141.616729:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c32ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074141.616735:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723555584:0@lo:38:kworker.0 00010000:00080000:0.0:1783074141.616748:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9523caed2d80 x1869685723554048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074141.616759:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000004:00080000:1.0:1783074141.617822:0:90954:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1067us 00000100:00080000:0.0:1783074141.618058:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9523caed2d80 x1869685723554048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074166 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074141.618068:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074141.618073:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074141.618077:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074141.618083:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723554048:0@lo:38:kworker.0 00010000:00080000:0.0:1783074141.618106:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524df3bb480 x1869685723554304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074141.618118:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:0.0:1783074141.620284:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9524df3bb480 x1869685723554304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074166 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074141.620307:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074141.620332:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074141.620338:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074141.620345:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723554304:0@lo:38:kworker.0 00000100:00080000:0.0:1783074141.620380:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:0.0:1783074141.620390:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783074141.620394:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783074141.620397:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:0.0:1783074141.620401:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9524f0d24800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:0.0:1783074141.620404:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1783074141.622030:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723554688:0@lo:38:kworker.0 00010000:00080000:1.0:1783074141.622063:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f4af7800 x1869685723555072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074141.622077:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00010000:00080000:0.0:1783074141.622146:0:91319:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1783074141.622151:0:91319:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1783074141.622156:0:91319:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1783074141.624584:0:91319:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:1.0:1783074141.624799:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9524f4af7800 x1869685723555072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074166 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074141.624809:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783074141.624814:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074141.624818:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783074141.624824:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723555072:0@lo:38:kworker.0 00000100:00100000:1.0:1783074141.624990:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723555712:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783074141.625056:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074141.625158:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555712 00000100:00100000:0.0:1783074141.625166:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555712 00000100:00100000:0.0:1783074141.625257:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3661 00000100:00100000:0.0:1783074141.625267:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723555712:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783074141.625285:0:23954:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524f4af7800 x1869685723555712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:467/0 lens 224/0 e 0 to 0 dl 1783074152 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074141.625295:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723555712:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (240us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074141.625302:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3661 00010000:00010000:1.0:1783074141.631255:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631278:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631294:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631307:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631343:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631352:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631730:0:90954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631737:0:90954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631741:0:90954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631745:0:90954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074141.631749:0:90954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631753:0:90954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631763:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d0c84c00) 00010000:00010000:1.0:1783074141.631766:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074141.631768:0:90954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631772:0:90954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39d400/0x5fb609b3016df938 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074141.631787:0:90954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e790004 reply state 000000000d8f29e6 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631800:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.631805:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0c84900) 00010000:00010000:1.0:1783074141.631807:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074141.631809:0:90954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783074141.631946:0:90954:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1783074141.631964:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074141.631966:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:1.0:1783074141.631969:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783074141.631971:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000001:00080000:0.0:1783074141.633187:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149704 is committed 00010000:00010000:1.0:1783074141.633245:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.633255:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.633262:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.633267:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39ca00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074141.633269:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.633274:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.633285:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d0c84900) 00010000:00010000:1.0:1783074141.633287:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074141.633294:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.633298:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df39ca00/0x5fb609b3016df93f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074141.634939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074141.635012:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708050176 00000100:00100000:1.0:1783074141.635022:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708050176 00000100:00100000:1.0:1783074141.635080:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1215 00000100:00100000:1.0:1783074141.635091:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708050176:12345-192.168.204.26@tcp:36:rm.0 00010000:00080000:1.0:1783074141.635111:0:66201:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:1.0:1783074141.635133:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708050176:12345-192.168.204.26@tcp:36:rm.0 Request processed in 45us (202us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074141.635140:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1215 00000020:00080000:3.0:1783074141.635213:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.635226:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:3.0:1783074141.635230:0:90954:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:3.0:1783074141.635234:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.635242:0:90954:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708050176 t111669149705 from 192.168.204.26@tcp req@ffff9524fc494700 x1869685708050176/t0(111669149705) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:467/0 lens 512/0 e 0 to 0 dl 1783074152 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783074141.635374:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635389:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635401:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635422:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635430:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635437:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635532:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635542:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635548:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635759:0:90954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635767:0:90954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635773:0:90954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635778:0:90954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074141.635782:0:90954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635789:0:90954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635808:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9524c8cd5700) 00010000:00010000:3.0:1783074141.635810:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783074141.635815:0:90954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635821:0:90954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298000/0x5fb609b3016df954 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635840:0:90954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635846:0:90954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635853:0:90954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635858:0:90954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074141.635861:0:90954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635866:0:90954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635872:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524c8cd5a00) 00010000:00010000:3.0:1783074141.635874:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074141.635877:0:90954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635882:0:90954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298a00/0x5fb609b3016df946 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074141.635903:0:90954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f8a6bfd reply state 0000000037223d0d transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635913:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.635919:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524c8cd5600) 00010000:00010000:3.0:1783074141.635922:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074141.635924:0:90954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783074141.635994:0:90954:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783074141.636007:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.636010:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:3.0:1783074141.636014:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.636016:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:0.0:1783074141.638066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074141.638131:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051072 00000100:00100000:1.0:1783074141.638149:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051072 00000100:00100000:1.0:1783074141.638198:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1216 00000100:00100000:1.0:1783074141.638208:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708051072:12345-192.168.204.26@tcp:36:dd.0 00010000:00080000:1.0:1783074141.638232:0:66200:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:1.0:1783074141.638250:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708051072:12345-192.168.204.26@tcp:36:dd.0 Request processed in 44us (191us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074141.638257:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1216 00000020:00080000:3.0:1783074141.638300:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.638305:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:3.0:1783074141.638638:0:90954:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149704) 00000020:00080000:3.0:1783074141.638644:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.638653:0:90954:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708051072 t111669149708 from 192.168.204.26@tcp req@ffff9524fc495180 x1869685708051072/t0(111669149708) o36->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:467/0 lens 488/0 e 0 to 0 dl 1783074152 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783074141.638913:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.638926:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.638936:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074141.638985:0:90954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:3.0:1783074141.639005:0:90954:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b7f5af2 reply state 000000009367183c transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.639016:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.639024:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:3.0:1783074141.639027:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074141.639030:0:90954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783074141.639211:0:90954:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783074141.639270:0:90954:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1783074141.639279:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.639282:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:3.0:1783074141.639285:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074141.639287:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:0.0:1783074141.641291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074141.641406:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708051456 00000100:00100000:3.0:1783074141.641414:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708051456 00000100:00100000:3.0:1783074141.641469:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1217 00000100:00100000:3.0:1783074141.641477:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2401:x1869685708051456:12345-192.168.204.26@tcp:101:dd.0 00010000:00080000:3.0:1783074141.641494:0:66202:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1783074141.641546:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2401:x1869685708051456:12345-192.168.204.26@tcp:101:dd.0 Request processed in 70us (261us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074141.641551:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1217 00000020:00080000:0.0:1783074141.641579:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074141.641582:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:0.0:1783074141.641586:0:90954:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:0.0:1783074141.641589:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074141.641597:0:90954:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708051456 t111669149709 from 192.168.204.26@tcp req@ffff9524fc495f80 x1869685708051456/t0(111669149709) o101->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:467/0 lens 640/0 e 0 to 0 dl 1783074152 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1783074141.641617:0:90954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074141.641635:0:90954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016df962 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0a5 expref: -99 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.641680:0:90954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016df969 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.641693:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016df969 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.641705:0:90954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016df969 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074141.641809:0:90954:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x4b1:0x0], count =625 00000004:00080000:0.0:1783074141.641812:0:90954:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x4b1:0x0]+625 in llog 00000004:00080000:0.0:1783074141.641835:0:90954:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00000004:00080000:0.0:1783074141.641839:0:90954:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x723:0x0], index 0: 0 00010000:00010000:0.0:1783074141.641892:0:90954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016df969 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 14 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.641912:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:0.0:1783074141.641914:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1783074141.641924:0:90954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016df962 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 14 pid: 90954 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.641933:0:90954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016df969 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 13 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.641954:0:90954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:0.0:1783074141.641956:0:90954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1783074141.641958:0:90954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671200, rc 0) 00010000:00080000:0.0:1783074141.642023:0:90954:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783074141.642034:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074141.642036:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:0.0:1783074141.642038:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074141.642040:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:0.0:1783074141.645052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074141.645247:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060544 00000100:00100000:2.0:1783074141.645256:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060544 00000100:00100000:1.0:1783074141.645904:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 820 00000100:00100000:1.0:1783074141.645914:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708060544:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783074141.645933:0:67186:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524fc495c00 x1869685708060544/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:467/0 lens 224/0 e 0 to 0 dl 1783074152 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074141.645963:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708060544:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 Request processed in 52us (922us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074141.645970:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 820 00000020:00080000:0.0:1783074141.645994:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074141.646000:0:90954:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:0.0:1783074141.646004:0:90954:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783074141.646008:0:90954:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074141.646016:0:90954:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783074141.646019:0:90954:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783074141.646131:0:90954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:2.0:1783074141.648473:0:90919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:2.0:1783074141.648483:0:90919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783074141.648506:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00010000:00010000:0.0:1783074141.648631:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648657:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648664:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648670:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074141.648675:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648683:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648701:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074141.648703:0:90954:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1783074141.648710:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016df94d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648738:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648744:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1783074141.648748:0:90954:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:0.0:1783074141.648751:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648757:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074141.648761:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1783074141.648763:0:90954:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9524f4af7800 x1869685723555712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:467/0 lens 224/0 e 0 to 0 dl 1783074152 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074141.648775:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648792:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:0.0:1783074141.648795:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074141.648844:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.648851:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016df95b lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1783074141.648928:0:90954:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.26@tcp: req@ffff9524fc495c00 x1869685708060544/t0(0) o400->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:467/0 lens 224/0 e 0 to 0 dl 1783074152 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783074141.648991:0:90954:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1783074141.649463:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783074141.649476:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9524fc494e00 x1869685723555712/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074157 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074141.649488:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9524fc494e00 x1869685723555712/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074157 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074141.649494:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074141.649553:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783074141.649561:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f1b00c4e): req@ffff9524debf0a80 x1869685723535360/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074126 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074141.649583:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723555712:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783074141.649639:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074141.650037:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723555840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074141.650081:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074141.650167:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723535360 00000100:00100000:0.0:1783074141.650174:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723535360 00000100:00100000:0.0:1783074141.650214:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555840 00000100:00100000:0.0:1783074141.650218:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555840 00000100:00100000:0.0:1783074141.650239:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3662 00000100:00100000:1.0:1783074141.650246:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663 00000100:00100000:0.0:1783074141.650247:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723535360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074141.650253:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723555840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074141.650273:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000004:00000024:0.0:1783074141.650273:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783074141.651411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074141.651925:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723535360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074141.651957:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3662 00000100:00100000:1.0:1783074141.652061:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723555840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1800us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.652069:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663 00000100:00100000:1.0:1783074141.652090:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060416 00000100:00100000:1.0:1783074141.652096:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060416 00000100:00100000:1.0:1783074141.652142:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1218 00000100:00100000:1.0:1783074141.652150:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:69756:x1869685708060416:12345-192.168.204.26@tcp:41:lfs.0 00000100:00100000:0.0:1783074141.652242:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723555840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074141.652277:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723535360:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074141.652414:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:1.0:1783074141.652560:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:69756:x1869685708060416:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 370us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.652567:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1218 00000100:00100000:0.0:1783074141.655894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074141.656023:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060672 00000100:00100000:1.0:1783074141.656051:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060672 00000100:00100000:1.0:1783074141.656166:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1219 00000100:00100000:1.0:1783074141.656186:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69756:x1869685708060672:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074141.656216:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074141.656299:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69756:x1869685708060672:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 123us (446us total) trans 0 rc 0/0 00000100:00080000:2.0:1783074141.656306:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074141.656327:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1219 00000100:00100000:0.0:1783074141.659585:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074141.660086:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060800 00000100:00100000:1.0:1783074141.660121:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060800 00000100:00100000:1.0:1783074141.660205:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1707 00000100:00100000:1.0:1783074141.660215:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:69756:x1869685708060800:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:1.0:1783074141.660248:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783074141.660293:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074141.660356:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:69756:x1869685708060800:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 124us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.660364:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1707 00000100:00100000:1.0:1783074141.663515:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074141.664993:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708060928 00000100:00100000:2.0:1783074141.665004:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708060928 00000100:00100000:2.0:1783074141.665093:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1708 00000100:00100000:2.0:1783074141.665103:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69756:x1869685708060928:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074141.665136:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074141.665200:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:69756:x1869685708060928:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 97us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074141.665219:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1708 00000100:00080000:1.0:1783074141.665288:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:3.0:1783074141.667912:0:90954:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc84dfe10 00100000:10000000:3.0:1783074141.667926:0:90954:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1783074141.669858:0:90940:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:2.0:1783074141.669903:0:90940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90940:1869685723555968:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783074141.669961:0:90942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:2.0:1783074141.669971:0:90940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.670005:0:90940:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757180 going to sleep for 11 seconds 00000100:00100000:0.0:1783074141.670295:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723555968 00000100:00100000:0.0:1783074141.670302:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723555968 00000100:00100000:0.0:1783074141.670383:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1783074141.670392:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:90940:x1869685723555968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783074141.670421:0:26175:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -30 00002000:02000040:0.0:1783074141.670426:0:26175:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1857) 00000100:00100000:1.0:1783074141.671086:0:90942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4b78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90942:1869685723556096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783074141.671296:0:90942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074141.671346:0:90942:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab180 going to sleep for 11 seconds 00000100:00100000:3.0:1783074141.672343:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556096 00000100:00100000:3.0:1783074141.672352:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556096 00000100:00100000:3.0:1783074141.672404:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000100:00100000:3.0:1783074141.672412:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:90942:x1869685723556096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783074141.672436:0:26172:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -31 00002000:02000040:3.0:1783074141.672451:0:26172:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1857) 00002000:00010000:0.0:1783074141.679655:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.679667:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.679683:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.679687:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.679693:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.679710:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.679721:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.679751:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.679865:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783074141.679974:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.679990:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.679999:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.680003:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.680007:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.680016:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.680025:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.680033:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680329:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074141.680336:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680344:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.680349:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680359:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680375:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680383:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99b7e95/0x5fb609b3016df970 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680404:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074141.680408:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680426:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.680429:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680437:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680460:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.680469:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.680470:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.680472:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.681250:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074141.681258:0:26175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b584c6/0x5fb609b3016df977 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.681417:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783074141.681788:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.681797:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681808:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.681813:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.681829:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681841:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681850:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681858:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681873:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074141.681882:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074141.681887:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681895:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.681899:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681907:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681919:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681938:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbb8aaa5/0x5fb609b3016df97e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.681952:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.681954:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.681955:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074141.682276:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.682283:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682329:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.682334:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.682338:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682348:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682356:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682363:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682378:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074141.682467:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.682473:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682480:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.682484:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.682488:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682519:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682539:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682546:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682586:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783074141.682640:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.682645:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682653:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.682656:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.682661:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682670:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682679:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682731:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682750:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783074141.682791:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.682796:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682804:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.682807:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.682811:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682820:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682827:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682834:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682846:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783074141.682905:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.682911:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682925:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.682928:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.682932:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682941:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682948:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682959:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.682968:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783074141.683015:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683021:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683029:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683031:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683035:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683044:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683062:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683069:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683082:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783074141.683124:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683132:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683140:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683145:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683150:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683159:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683167:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683174:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683192:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783074141.683233:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683238:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683250:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683253:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683258:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683267:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683275:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683283:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683295:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783074141.683377:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683382:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683404:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683412:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683417:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683484:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683493:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683500:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683517:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783074141.683566:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683583:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683591:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683594:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683598:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683619:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683627:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683653:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683661:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1783074141.683827:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683833:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683850:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683853:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683857:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683865:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683873:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683879:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683887:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1783074141.683945:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.683951:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683974:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.683977:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.683982:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.683991:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684017:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684026:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684035:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1783074141.684071:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.684076:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684084:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.684087:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.684091:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684100:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684136:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684155:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684164:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1783074141.684211:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.684216:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684224:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.684227:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.684231:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684257:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684266:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684273:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.684529:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1783074141.685251:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.685258:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685268:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.685272:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.685277:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685287:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685295:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685302:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685331:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1783074141.685408:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074141.685450:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1783074141.685457:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685466:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685470:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685479:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685508:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685515:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe466ef6/0x5fb609b3016df985 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685535:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1783074141.685540:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685546:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39da00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685548:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685556:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685566:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685573:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f967f2/0x5fb609b3016df98c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685584:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1783074141.685588:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685600:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685604:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685612:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685623:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685631:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb2b0f0c/0x5fb609b3016df993 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685643:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1783074141.685647:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685654:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39cc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685658:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685666:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685675:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685687:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7f32d2/0x5fb609b3016df99a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685700:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1783074141.685703:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685710:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39c800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685714:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685722:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685732:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685740:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f429a65a/0x5fb609b3016df9a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685751:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783074141.685755:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685762:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685769:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685778:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685788:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685796:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de8bd34e/0x5fb609b3016df9a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685807:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783074141.685811:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685818:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39ca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.685821:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685829:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685862:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685872:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.685880:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.685885:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685896:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685911:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.685922:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aee8ab82/0x5fb609b3016df9af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685944:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685951:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.685961:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783074141.686012:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686018:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686026:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.686029:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686034:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686043:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686057:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686070:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686092:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:2.0:1783074141.686111:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783074141.686115:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.686123:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d600 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:1.0:1783074141.686168:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686174:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686182:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:2.0:1783074141.686198:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.686207:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.686219:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.686226:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a242945/0x5fb609b3016df9b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.686239:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1783074141.686254:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686259:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686269:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686277:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686285:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686294:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783074141.686348:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686354:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686367:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.686370:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686374:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686384:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686392:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686401:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686409:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1783074141.686454:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686460:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686469:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.686472:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686476:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686485:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686505:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686513:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686522:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1783074141.686556:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686561:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686569:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.686572:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686575:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686584:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686593:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686601:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686620:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1783074141.686655:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686660:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686668:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.686671:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686676:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686685:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686693:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686819:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686829:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1783074141.686864:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.686869:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686877:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.686891:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.686896:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686906:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686915:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686923:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.686931:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:2.0:1783074141.687001:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687014:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39d200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687018:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687037:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687050:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687057:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000151d5a66/0x5fb609b3016df9bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687073:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1783074141.687078:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687085:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39de00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687088:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687101:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687111:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687122:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a466694/0x5fb609b3016df9c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074141.687224:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074141.687255:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1783074141.687260:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687266:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39ce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687271:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687279:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687294:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687303:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047694f4/0x5fb609b3016df9cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.687352:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687383:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1783074141.687398:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.687402:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.687407:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.687417:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.687426:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.687439:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.687460:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1783074141.687507:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074141.687519:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687528:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df39dc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687531:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687548:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687564:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687573:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086cf4fc9/0x5fb609b3016df9d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687586:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1783074141.687591:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687598:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687601:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687609:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687620:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687627:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016df9d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687656:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1783074141.687660:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687667:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dba00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687670:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687678:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687689:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687696:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016df9e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687709:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783074141.687712:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687719:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dae00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687723:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687740:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687755:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687763:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016df9e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687777:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783074141.687780:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687787:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.687791:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687799:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.687809:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.689554:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.689570:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.689574:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.689581:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.689595:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.689606:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.689614:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.689630:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1783074141.689743:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016df9ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.689783:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783074141.689787:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.689795:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbe00 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:1.0:1783074141.690017:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.690023:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.690037:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.690041:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.690045:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.690055:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.690064:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.690071:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.690079:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1783074141.690197:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.690207:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.690427:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.690436:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016df9f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690591:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1783074141.690600:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690609:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.690613:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690621:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690634:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690641:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016df9fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.690650:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.690659:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690659:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1783074141.690666:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690672:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.690680:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.690689:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.690691:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690695:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690712:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690713:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690735:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690737:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690751:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016dfa03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690776:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690780:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783074141.690787:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690790:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1783074141.690798:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.690802:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690810:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690821:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690836:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dfa0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690856:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783074141.690860:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690866:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.690869:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.690876:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.690877:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690884:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690892:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690894:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.690903:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.690913:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690913:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dfa11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690939:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690944:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074141.690949:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690950:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.690970:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690970:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ec00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.690981:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783074141.690981:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.690993:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691005:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691012:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec9c230/0x5fb609b3016dfa18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.691019:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.691025:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691028:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783074141.691035:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691046:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.691048:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ee00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.691051:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.691053:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691058:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691065:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691073:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691079:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691085:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691094:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691102:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783074141.691150:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dfa1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.691154:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.691162:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691173:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.691176:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.691177:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074141.691181:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691183:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691204:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691204:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.691210:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691224:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691231:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691238:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691241:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691255:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1783074141.691287:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.691293:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691300:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.691303:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.691307:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691343:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000871c5b2d/0x5fb609b3016dfa26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691350:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691360:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691361:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783074141.691368:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691374:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691380:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.691387:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691407:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783074141.691419:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691429:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691437:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017097bc7/0x5fb609b3016dfa2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.691461:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.691465:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074141.691468:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691470:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691487:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.691488:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.691491:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.691494:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691497:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691513:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691516:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691533:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691534:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691558:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691559:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120f8cde/0x5fb609b3016dfa34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691580:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783074141.691598:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783074141.691603:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691609:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.691613:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.691620:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.691621:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691629:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691636:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691638:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.691647:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea1e31c/0x5fb609b3016dfa3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691649:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.691657:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691670:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691672:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783074141.691679:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691682:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691696:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.691700:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691702:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691719:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1783074141.691733:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691746:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691753:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e48e6ee/0x5fb609b3016dfa42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.691755:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.691764:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691772:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783074141.691774:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.691777:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691778:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.691787:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691791:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.691796:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691801:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691811:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691815:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691822:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691842:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691842:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50b72d2/0x5fb609b3016dfa49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691865:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1783074141.691883:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783074141.691887:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691894:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.691898:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.691904:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.691906:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691912:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691922:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691923:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.691930:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.691939:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691940:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c0a3944/0x5fb609b3016dfa50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691965:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691969:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783074141.691975:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.691978:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.691994:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.691997:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692000:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692014:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783074141.692028:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692041:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.692048:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.692048:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6de13ff/0x5fb609b3016dfa57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692059:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692068:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783074141.692074:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692080:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.692084:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.692086:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.692091:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692100:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692108:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692115:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692122:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783074141.692158:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.692162:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692170:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.692172:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.692176:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692183:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692202:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692209:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692217:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783074141.692250:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.692255:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692262:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.692265:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.692268:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692276:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692284:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692290:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692308:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1783074141.692365:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.692369:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692376:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.692379:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.692383:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692391:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692398:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692405:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.692413:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1783074141.692461:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692471:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692483:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692500:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820c00f5/0x5fb609b3016dfa5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692510:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783074141.692517:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692526:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.692529:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783074141.692530:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692534:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692544:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.692548:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692570:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692571:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692602:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692603:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692625:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a44a1910/0x5fb609b3016dfa6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692626:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bbfac54/0x5fb609b3016dfa65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692665:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783074141.692667:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074141.692669:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692672:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692686:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.692691:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.692692:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692698:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692706:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692720:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692725:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692730:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb02563/0x5fb609b3016dfa73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692746:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692767:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008329ed07/0x5fb609b3016dfa7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692772:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074141.692777:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692784:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074141.692785:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.692790:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692792:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692812:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692813:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.692818:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692829:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692832:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692847:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb366f14/0x5fb609b3016dfa81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692854:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692861:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074141.692865:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9b7f24/0x5fb609b3016dfa88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692866:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692883:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.692887:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692914:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692915:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.692919:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.692923:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.692930:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.692938:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016dfa8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.692939:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.692956:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.692959:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.692963:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.692973:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074141.693307:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074141.693343:0:26175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.693353:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:1.0:1783074141.693357:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074141.693361:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.693372:0:26175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.693391:0:26175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.693398:0:26175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074141.693417:0:26175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783074141.693461:0:26175:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00000100:00100000:1.0:1783074141.693547:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:90940:x1869685723555968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23152us (23572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074141.693557:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00000100:00100000:2.0:1783074141.693729:0:90940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90940:1869685723555968:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783074141.693747:0:90940:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x723:0x0] 00000100:00100000:2.0:1783074141.693813:0:90940:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc258e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90940:1869685723556352:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783074141.693846:0:90940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.693865:0:90940:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757180 going to sleep for 11 seconds 00000100:00100000:2.0:1783074141.693895:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556352 00000100:00100000:2.0:1783074141.693901:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556352 00000100:00100000:2.0:1783074141.693937:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:2.0:1783074141.693944:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:90940:x1869685723556352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783074141.693977:0:26166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00000001:00100000:0.0:1783074141.694548:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783074141.695235:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723556224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074141.695288:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1783074141.695358:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783074141.695395:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556224 00000100:00100000:0.0:1783074141.695402:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556224 00000100:00100000:0.0:1783074141.695453:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:0.0:1783074141.695463:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1869685723556224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783074141.695482:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074141.695529:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1869685723556224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074141.695536:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:2.0:1783074141.695761:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723556224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783074141.695784:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074141.695791:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.695803:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.695807:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.695817:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.695834:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.695841:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c4154a3/0x5fb609b3016dfa96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.695861:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.695863:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074141.695864:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074141.696184:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696192:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696203:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696215:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696221:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696233:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696242:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696250:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696273:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074141.696373:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696378:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696385:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696388:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696392:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696401:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696409:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696422:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696437:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783074141.696483:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696489:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696496:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696499:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696503:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696511:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696519:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696527:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696548:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783074141.696582:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696587:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696602:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696605:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696609:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696619:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696627:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696635:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696647:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783074141.696682:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696687:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696695:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696698:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696702:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696711:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696730:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696737:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696746:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783074141.696778:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696783:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696791:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696794:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696798:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696807:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696815:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696823:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696841:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1783074141.696874:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696879:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696887:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696890:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696894:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696903:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696911:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696919:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696928:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1783074141.696965:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.696971:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.696979:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.696987:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.696992:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697002:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697011:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697019:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697028:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1783074141.697045:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783074141.697054:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.697064:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.697075:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697077:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783074141.697080:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0031400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.697086:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697092:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.697099:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.697102:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0030c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.697105:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697108:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697127:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697136:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697149:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697158:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1783074141.697191:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.697197:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697205:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.697208:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.697213:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697222:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697230:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697238:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697253:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1783074141.697255:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697267:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697273:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697280:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.697286:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.697298:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697301:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15ec97a/0x5fb609b3016dfaa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697308:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697349:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:2.0:1783074141.697350:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cf5f9ee/0x5fb609b3016dfa9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697356:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.697358:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783074141.697369:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697369:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697378:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783074141.697386:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697391:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0030000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.697396:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697397:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697402:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0031e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.697409:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697421:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697422:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697428:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697458:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697460:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697466:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697479:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af1bc0f3/0x5fb609b3016dfaab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697488:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1783074141.697491:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd0b7d0/0x5fb609b3016dfab2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697506:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783074141.697510:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697516:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0031a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.697519:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697526:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.697531:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074141.697536:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697538:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697558:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002734278d/0x5fb609b3016dfab9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697559:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.697567:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.697576:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697582:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783074141.697588:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697589:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697607:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c0030400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.697620:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697628:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697632:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697643:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697649:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697655:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1783074141.697660:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20878c6/0x5fb609b3016dfac0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697687:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783074141.697691:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783074141.697692:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.697698:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074141.697698:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697706:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.697710:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697712:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.697719:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697720:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697725:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.697734:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.697746:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697748:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697748:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697771:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697778:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697780:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697781:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016dfac7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697804:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697806:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016dface lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697815:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697815:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783074141.697822:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697840:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.697848:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783074141.697852:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783074141.697853:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697855:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697875:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.697877:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697880:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.697891:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.697896:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697899:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697902:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697927:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697927:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016dfad5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697928:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.697935:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.697945:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697947:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016dfadc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.697964:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074141.697971:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697973:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.697980:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074141.697987:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.697993:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698000:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.698002:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.698012:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698012:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698013:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698038:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698041:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783074141.698065:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698065:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.698078:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074141.698091:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016dfae3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698092:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698113:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.698117:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074141.698124:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074141.698130:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698134:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698143:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698145:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074141.698151:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698159:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698172:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698183:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783074141.698195:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698205:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016dfaea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.698217:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074141.698220:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074141.698224:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698226:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698242:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:2.0:1783074141.698243:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.698247:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074141.698249:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698254:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698267:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698271:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698276:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698285:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698286:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016dfaf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698302:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698338:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074141.698339:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074141.698345:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698352:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074141.698356:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698365:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698366:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074141.698378:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.698390:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698394:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698395:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698409:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:0.0:1783074141.698418:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016dfaf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698419:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074141.698420:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016dfaff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698430:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698461:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698470:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698473:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.698473:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074141.698477:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.698481:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698482:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074141.698484:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698494:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074141.698507:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074141.698516:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074141.698520:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698533:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bcc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.698536:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698543:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698554:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698560:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016dfb0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698575:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074141.698576:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074141.698578:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074141.698616:0:26172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074141.698621:0:26172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698633:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=2980s v=(0 0) 00010000:00010000:3.0:1783074141.698639:0:26172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074141.698640:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074141.698645:0:26172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698646:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698670:0:26172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698671:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698687:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698690:0:26172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698705:0:26172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698708:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016dfb06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074141.698732:0:26172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074141.698744:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074141.698749:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074141.698756:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.698757:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc0c63ce0) 00002000:00080000:3.0:1783074141.698761:0:26172:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00010000:00010000:0.0:1783074141.698763:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698773:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698783:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698790:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016dfb14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074141.698801:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.698803:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074141.698805:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074141.698870:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:90942:x1869685723556096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 26456us (27571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074141.698880:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00010000:00010000:1.0:1783074141.699090:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074141.699355:0:90942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4b78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90942:1869685723556096:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783074141.699369:0:90942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:1.0:1783074141.699468:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783074141.699515:0:90942:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0929500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90942:1869685723556608:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783074141.699563:0:90942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074141.699591:0:90942:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757780 going to sleep for 11 seconds 00000100:00100000:2.0:1783074141.699611:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556608 00000100:00100000:2.0:1783074141.699616:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556608 00000100:00100000:2.0:1783074141.699666:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:2.0:1783074141.699675:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:90942:x1869685723556608:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783074141.699712:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00000100:00100000:2.0:1783074141.701478:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:90942:x1869685723556608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1800us (1910us total) trans 4294968712 rc 0/0 00000100:00100000:2.0:1783074141.701489:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000100:00100000:3.0:1783074141.701525:0:90942:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0929500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90942:1869685723556608:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783074141.701540:0:90942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00000001:00080000:0.0:1783074141.701674:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968716 is committed 00000100:00100000:2.0:1783074141.702251:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:90940:x1869685723556352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8307us (8404us total) trans 4294968716 rc 0/0 00000100:00100000:2.0:1783074141.702259:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00100000:3.0:1783074141.702290:0:90940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968716 gen 2 00000100:00100000:1.0:1783074141.702391:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723556480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074141.702426:0:90940:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc258e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90940:1869685723556352:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783074141.702436:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783074141.702451:0:90940:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00000100:00100000:2.0:1783074141.702592:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556480 00000100:00100000:2.0:1783074141.702598:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556480 00000100:00100000:2.0:1783074141.702667:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:2.0:1783074141.702675:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723556480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074141.702695:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074141.702732:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723556480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074141.702738:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:3.0:1783074141.702766:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723556480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783074141.806465:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074142.639675:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723556736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074142.639756:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723556864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074142.639821:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074142.639861:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074142.639902:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556864 00000100:00100000:1.0:1783074142.639909:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556864 00000100:00100000:1.0:1783074142.639954:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556736 00000100:00100000:1.0:1783074142.639957:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556736 00000100:00100000:1.0:1783074142.639978:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1783074142.639985:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723556864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074142.640035:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074142.640072:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723556864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074142.640085:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1783074142.640105:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1783074142.640112:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723556736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074142.640122:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074142.640152:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723556736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074142.640157:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:0.0:1783074142.640171:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723556864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074142.640195:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723556736:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1783074142.641274:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783074142.704572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074142.704615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074142.704653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074142.704682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074142.704713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074142.704751:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061568 00000100:00100000:1.0:1783074142.704761:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061568 00000100:00100000:1.0:1783074142.704868:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061440 00000100:00100000:1.0:1783074142.704871:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061440 00000100:00100000:1.0:1783074142.704902:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2143 00000100:00100000:1.0:1783074142.704913:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708061568:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074142.705001:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708061568:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074142.705009:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2143 00000100:00100000:1.0:1783074142.705029:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2144 00000100:00100000:1.0:1783074142.705036:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708061440:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074142.705065:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708061440:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074142.705079:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2144 00000100:00100000:3.0:1783074142.705090:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061312 00000100:00100000:3.0:1783074142.705096:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061312 00000100:00100000:3.0:1783074142.705132:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061184 00000100:00100000:3.0:1783074142.705136:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061184 00000100:00100000:3.0:1783074142.705159:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 821 00000100:00100000:3.0:1783074142.705167:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708061312:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074142.705209:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2402:x1869685708061312:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 43us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074142.705216:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 821 00000100:00100000:3.0:1783074142.705231:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 822 00000100:00100000:3.0:1783074142.705237:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708061184:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074142.705261:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2402:x1869685708061184:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074142.705267:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 822 00000100:00100000:2.0:1783074142.705763:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061056 00000100:00100000:2.0:1783074142.705768:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061056 00000100:00100000:2.0:1783074142.705843:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:2.0:1783074142.705853:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2402:x1869685708061056:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074142.705896:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2402:x1869685708061056:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 45us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074142.705912:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00010000:00010000:1.0:1783074142.830403:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074143.856614:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074144.206650:0:91503:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1783074144.878483:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783074144.970673:0:91551:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783074145.904533:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074146.345478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074146.345551:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061696 00000100:00100000:2.0:1783074146.345560:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061696 00000100:00080000:1.0:1783074146.345626:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074146.345640:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1220 00000100:00100000:2.0:1783074146.345652:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:70226:x1869685708061696:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074146.345671:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074146.345697:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b0f9 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.345755:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.345768:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.345779:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074146.345827:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074146.345831:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074146.345853:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.345875:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.345892:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.345913:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:2.0:1783074146.345915:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074146.345919:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086d200, rc 0) 00000100:00100000:2.0:1783074146.345977:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70226:x1869685708061696:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 328us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074146.345984:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1220 00000100:00100000:1.0:1783074146.348594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074146.348644:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061824 00000100:00100000:3.0:1783074146.348651:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061824 00000100:00100000:3.0:1783074146.348705:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1221 00000100:00100000:3.0:1783074146.348714:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70226:x1869685708061824:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074146.348753:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:3.0:1783074146.348824:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70226:x1869685708061824:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 112us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.348829:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1221 00000100:00100000:1.0:1783074146.350982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074146.351072:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708061952 00000100:00100000:3.0:1783074146.351080:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708061952 00000100:00100000:3.0:1783074146.351364:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1222 00000100:00100000:3.0:1783074146.351376:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:70226:x1869685708061952:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074146.351407:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:3.0:1783074146.351469:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:70226:x1869685708061952:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 96us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.351477:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1222 00000100:00080000:1.0:1783074146.351550:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074146.355280:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074146.355390:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708062080 00000100:00100000:3.0:1783074146.355398:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708062080 00000100:00080000:1.0:1783074146.355444:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074146.355497:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1713 00000100:00100000:3.0:1783074146.355507:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:70226:x1869685708062080:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074146.355534:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074146.355597:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:70226:x1869685708062080:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.355604:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1713 00000100:00100000:0.0:1783074146.357411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.357479:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708062208 00000100:00100000:1.0:1783074146.357486:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708062208 00000100:00080000:2.0:1783074146.357555:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074146.357585:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1714 00000100:00100000:1.0:1783074146.357595:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:70226:x1869685708062208:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:1.0:1783074146.357620:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074146.357676:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:70226:x1869685708062208:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074146.357683:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1714 00000100:00100000:1.0:1783074146.375661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074146.375735:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708062464 00000100:00100000:2.0:1783074146.375745:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708062464 00000100:00100000:2.0:1783074146.375804:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1223 00000100:00100000:2.0:1783074146.375816:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70242:x1869685708062464:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074146.375835:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074146.375854:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c200/0x5fb609b3016dfb29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b100 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.375922:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.375936:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.375947:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.375961:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.375968:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.375989:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376064:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376072:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376079:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376085:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074146.376088:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376095:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376107:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:2.0:1783074146.376109:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074146.376112:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376118:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376128:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376134:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376146:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376150:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086de00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074146.376153:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376158:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376166:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d6c55a00) 00010000:00010000:2.0:1783074146.376168:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074146.376170:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376176:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376209:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c200/0x5fb609b3016dfb29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b100 expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376218:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:2.0:1783074146.376221:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074146.376224:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c200/0x5fb609b3016dfb29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b100 expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.376234:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c200, rc 0) 00000100:00100000:2.0:1783074146.376299:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70242:x1869685708062464:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 481us (643us total) trans 0 rc 301/301 00000100:00100000:2.0:1783074146.376369:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1223 00000100:00100000:2.0:1783074146.381869:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.381951:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708062592 00000100:00100000:1.0:1783074146.381961:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708062592 00000100:00100000:1.0:1783074146.382017:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1224 00000100:00100000:1.0:1783074146.382027:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70242:x1869685708062592:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1783074146.382092:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382109:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382137:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382152:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382159:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382166:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382378:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382387:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382394:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074146.382433:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1783074146.382437:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074146.382448:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382461:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382467:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382482:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382488:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382494:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.382498:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382505:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382515:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:1.0:1783074146.382518:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.382523:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382529:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382540:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382546:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382552:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382556:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.382563:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382569:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382575:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524f4575800) 00010000:00010000:1.0:1783074146.382578:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.382580:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382586:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382598:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382604:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382609:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382613:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.382616:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382621:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382627:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:1.0:1783074146.382629:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.382636:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.382641:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb4c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074146.382710:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70242:x1869685708062592:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 684us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074146.382717:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1224 00000100:00100000:0.0:1783074146.394492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074146.394682:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708062848 00000100:00100000:2.0:1783074146.394692:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708062848 00000100:00100000:2.0:1783074146.394802:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1225 00000100:00100000:2.0:1783074146.394813:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70246:x1869685708062848:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074146.394833:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074146.394850:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b107 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.394926:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.394939:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.394950:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.394964:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.394970:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.394977:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395052:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395072:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395079:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395085:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395092:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074146.395096:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395103:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395115:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:2.0:1783074146.395118:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074146.395122:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395129:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c800/0x5fb609b3016dfb5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395141:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395148:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395154:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395164:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074146.395167:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395174:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395181:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524d6c55a00) 00010000:00010000:2.0:1783074146.395184:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074146.395187:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395193:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d600/0x5fb609b3016dfb61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395224:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b107 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395233:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:2.0:1783074146.395236:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074146.395240:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086de00/0x5fb609b3016dfb53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b107 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074146.395248:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086de00, rc 0) 00000100:00100000:2.0:1783074146.395308:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70246:x1869685708062848:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 497us (825us total) trans 0 rc 301/301 00000100:00100000:2.0:1783074146.395370:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1225 00000100:00100000:2.0:1783074146.397522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.397670:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708062976 00000100:00100000:1.0:1783074146.397677:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708062976 00000100:00100000:1.0:1783074146.397722:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1226 00000100:00100000:1.0:1783074146.397730:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70246:x1869685708062976:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1783074146.397785:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397798:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397807:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397819:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397824:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397830:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397945:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397960:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.397967:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074146.398004:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1783074146.398008:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074146.398134:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398146:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398152:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398158:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398174:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.398177:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398184:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398195:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:1.0:1783074146.398198:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.398201:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398216:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398229:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398234:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398240:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398244:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.398247:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398252:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398260:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524f4575800) 00010000:00010000:1.0:1783074146.398262:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.398265:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398270:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398283:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398287:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398298:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398302:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.398305:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398485:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398496:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:1.0:1783074146.398498:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.398501:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.398507:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb76 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074146.398620:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70246:x1869685708062976:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 889us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074146.398628:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1226 00000100:00100000:0.0:1783074146.417169:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.417229:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708063232 00000100:00100000:1.0:1783074146.417239:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708063232 00000100:00100000:1.0:1783074146.417300:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1227 00000100:00100000:1.0:1783074146.417334:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70252:x1869685708063232:12345-192.168.204.26@tcp:101:md5sum.0 00010000:00010000:1.0:1783074146.417364:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074146.417383:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b10e expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417479:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417646:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417668:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417686:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417694:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417701:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417805:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016dfb92 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417826:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016dfb92 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417834:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016dfb92 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074146.417843:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1783074146.417932:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417949:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417955:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417972:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417977:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.417982:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.417990:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418001:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:1.0:1783074146.418004:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.418008:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418023:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfb84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418036:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418042:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418048:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418080:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074146.418083:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418088:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418096:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9524f4575800) 00010000:00010000:1.0:1783074146.418098:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074146.418100:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418105:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfb8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418165:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfb7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b10e expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418178:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016dfb92 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b10e expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074146.418184:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:1.0:1783074146.418186:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074146.418189:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e400, rc 0) 00000100:00100000:1.0:1783074146.418247:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:70252:x1869685708063232:12345-192.168.204.26@tcp:101:md5sum.0 Request processed in 938us (1085us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1783074146.418254:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1227 00000100:00100000:0.0:1783074146.424136:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.424218:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708063360 00000100:00100000:1.0:1783074146.424238:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708063360 00002000:00100000:1.0:1783074146.424293:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff9524fc630450 x1869685708063360/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:472/0 lens 488/0 e 0 to 0 dl 1783074157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074146.424304:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc630450 with x1869685708063360 ext(0->32767) 00002000:00010000:1.0:1783074146.424326:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc630450 00000100:00100000:1.0:1783074146.424371:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 523 00000100:00100000:1.0:1783074146.424380:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708063360:12345-192.168.204.26@tcp:3:md5sum.0 00000100:00100000:1.0:1783074146.425412:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708063360:12345-192.168.204.26@tcp:3:md5sum.0 Request processed in 1030us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074146.425420:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 523 00002000:00100000:1.0:1783074146.425429:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff9524fc630450 x1869685708063360/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:472/0 lens 488/440 e 0 to 0 dl 1783074157 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074146.425437:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc630450 with x1869685708063360 ext(0->32767) 00002000:00010000:1.0:1783074146.425442:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc630450 00000100:00100000:0.0:1783074146.434224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.434641:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708063488 00000100:00100000:1.0:1783074146.434651:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708063488 00002000:00100000:1.0:1783074146.434698:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff9524fc497800 x1869685708063488/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:472/0 lens 488/0 e 0 to 0 dl 1783074157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074146.434709:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc497800 with x1869685708063488 ext(32768->1048575) 00002000:00010000:1.0:1783074146.434715:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc497800 00000100:00100000:2.0:1783074146.434952:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 524 00000100:00100000:2.0:1783074146.434967:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708063488:12345-192.168.204.26@tcp:3:md5sum.0 00000100:00100000:3.0:1783074146.434976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074146.435033:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708063616 00000100:00100000:1.0:1783074146.435039:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708063616 00002000:00100000:1.0:1783074146.435058:0:8449:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff9524e71ad500 x1869685708063616/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:472/0 lens 488/0 e 0 to 0 dl 1783074157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074146.435067:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524e71ad500 with x1869685708063616 ext(1048576->2097151) 00002000:00010000:1.0:1783074146.435084:0:8449:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9524e71ad500 00000100:00100000:1.0:1783074146.435111:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 525 00000100:00100000:1.0:1783074146.435119:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708063616:12345-192.168.204.26@tcp:3:md5sum.0 00000100:00100000:2.0:1783074146.436921:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2403:x1869685708063488:12345-192.168.204.26@tcp:3:md5sum.0 Request processed in 1951us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074146.436932:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 524 00002000:00100000:2.0:1783074146.436942:0:24854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff9524fc497800 x1869685708063488/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:472/0 lens 488/440 e 0 to 0 dl 1783074157 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074146.436953:0:24854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc497800 with x1869685708063488 ext(32768->1048575) 00002000:00010000:2.0:1783074146.436959:0:24854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc497800 00000100:00100000:1.0:1783074146.444805:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2403:x1869685708063616:12345-192.168.204.26@tcp:3:md5sum.0 Request processed in 9676us (9821us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1783074146.444819:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 525 00002000:00100000:1.0:1783074146.444831:0:8449:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff9524e71ad500 x1869685708063616/t0(0) o3->0510a7c0-d9c1-4de9-a6c3-ede973deaaff@192.168.204.26@tcp:472/0 lens 488/440 e 0 to 0 dl 1783074157 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074146.444841:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524e71ad500 with x1869685708063616 ext(1048576->2097151) 00002000:00010000:1.0:1783074146.444847:0:8449:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9524e71ad500 00000100:00100000:2.0:1783074146.456278:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074146.456643:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708063872 00000100:00100000:0.0:1783074146.456652:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708063872 00000100:00100000:0.0:1783074146.456693:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:0.0:1783074146.456700:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:70252:x1869685708063872:12345-192.168.204.26@tcp:35:md5sum.0 00000100:00100000:0.0:1783074146.456996:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:70252:x1869685708063872:12345-192.168.204.26@tcp:35:md5sum.0 Request processed in 294us (726us total) trans 115964116994 rc 0/0 00000100:00100000:0.0:1783074146.457004:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:3.0:1783074146.734561:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723556992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074146.734579:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723557120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074146.734589:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723557248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074146.734814:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723557376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074146.735966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074146.735972:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074146.736103:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723556992 00000100:00100000:3.0:1783074146.736112:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723556992 00000100:00100000:0.0:1783074146.736131:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074146.736157:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723557760:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.736188:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1783074146.736189:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074146.736203:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723556992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074146.736214:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723558272:0@lo:400:kworker.0 00002000:00000024:3.0:1783074146.736230:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074146.736241:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074146.736261:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783074146.736268:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723557888:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.736289:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723556992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074146.736298:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074146.736300:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1783074146.736335:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723558400:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.736361:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723557504:0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.736392:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074146.736404:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074146.736444:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557760 00000100:00100000:0.0:1783074146.736444:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557376 00000100:00100000:1.0:1783074146.736449:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557760 00000100:00100000:0.0:1783074146.736449:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557376 00000100:00100000:3.0:1783074146.736454:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723558016:0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.736481:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557248 00000100:00100000:0.0:1783074146.736486:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557248 00000100:00100000:3.0:1783074146.736490:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074146.736501:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557888 00000100:00100000:1.0:1783074146.736505:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557888 00000100:00100000:0.0:1783074146.736513:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664 00000100:00100000:3.0:1783074146.736518:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723558528:0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.736528:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723557376:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074146.736535:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558400 00000100:00100000:1.0:1783074146.736537:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558400 00000004:00000024:0.0:1783074146.736550:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:3.0:1783074146.736557:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074146.736557:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558016 00000100:00100000:1.0:1783074146.736560:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558016 00000100:00100000:1.0:1783074146.736589:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1783074146.736597:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723557760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.736601:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1869685723557376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074146.736607:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664 00000100:00100000:3.0:1783074146.736619:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723556992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074146.736625:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3665 00000100:00100000:0.0:1783074146.736634:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723557248:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074146.736643:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783074146.736643:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723557760:12345-0@lo:400:kworker.0 Request processed in 47us (455us total) trans 0 rc 0/0 00000004:00000024:0.0:1783074146.736646:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445445632 avail 1299206144 00000100:00100000:1.0:1783074146.736652:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:3.0:1783074146.736654:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723557632:0@lo:400:kworker.0 00000100:00100000:1.0:1783074146.736670:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1783074146.736678:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723557248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074146.736685:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723557888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.736685:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3665 00000100:00100000:3.0:1783074146.736692:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074146.736708:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558272 00000100:00100000:0.0:1783074146.736712:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558272 00000100:00100000:3.0:1783074146.736717:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723558144:0@lo:400:kworker.0 00000100:00100000:1.0:1783074146.736725:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723557888:12345-0@lo:400:kworker.0 Request processed in 42us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074146.736732:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1783074146.736738:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558528 00000100:00100000:0.0:1783074146.736740:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558528 00000100:00100000:1.0:1783074146.736745:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557632 00000100:00100000:3.0:1783074146.736748:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074146.736749:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557632 00000100:00080000:2.0:1783074146.736761:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074146.736769:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783074146.736773:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1783074146.736774:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558144 00000100:00080000:2.0:1783074146.736775:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074146.736777:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558144 00000100:00100000:3.0:1783074146.736779:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723558656:0@lo:400:kworker.0 00000100:00080000:2.0:1783074146.736781:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074146.736784:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723558400:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074146.736786:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074146.736800:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:0.0:1783074146.736812:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723558272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074146.736814:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1783074146.736817:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074146.736831:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723558528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.736850:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557504 00000100:00100000:3.0:1783074146.736855:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557504 00000100:00100000:0.0:1783074146.736868:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723558272:12345-0@lo:400:kworker.0 Request processed in 60us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074146.736876:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1783074146.736890:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723558528:12345-0@lo:400:kworker.0 Request processed in 62us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.736891:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783074146.736897:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1783074146.736902:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.736918:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723558144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.736944:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723557504:12345-0@lo:400:kworker.0 Request processed in 44us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.736950:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783074146.736981:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723557504:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.736992:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723558528:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.737025:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074146.737065:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558656 00000100:00100000:3.0:1783074146.737069:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558656 00000100:00100000:0.0:1783074146.737071:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723558144:12345-0@lo:400:kworker.0 Request processed in 155us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.737090:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1783074146.737098:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723558016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.737133:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723558016:12345-0@lo:400:kworker.0 Request processed in 36us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.737139:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1783074146.737160:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1783074146.737166:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723557632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.737200:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723557632:12345-0@lo:400:kworker.0 Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.737206:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1783074146.737217:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1783074146.737223:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723558656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074146.737265:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723558400:12345-0@lo:400:kworker.0 Request processed in 484us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.737274:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723558656:12345-0@lo:400:kworker.0 Request processed in 50us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.737281:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1783074146.737343:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1783074146.737358:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723557120 00000100:00100000:3.0:1783074146.737363:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723557120 00000100:00100000:2.0:1783074146.737394:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1783074146.737405:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723557120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783074146.737420:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074146.737426:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723557888:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.737440:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723558400:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.737454:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723558272:0@lo:400:kworker.0 00000100:00100000:1.0:1783074146.737459:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1783074146.737467:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723557120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074146.737473:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723557760:0@lo:400:kworker.0 00000100:00100000:2.0:1783074146.737488:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:3.0:1783074146.737497:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723557248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074146.737531:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723557376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074146.737535:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723557632:0@lo:400:kworker.0 00000100:00100000:2.0:1783074146.737554:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723558144:0@lo:400:kworker.0 00000100:00100000:3.0:1783074146.737556:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723557120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074146.737569:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723558656:0@lo:400:kworker.0 00000100:00100000:2.0:1783074146.737582:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723558016:0@lo:400:kworker.0 00000100:00100000:0.0:1783074146.737949:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00010000:00010000:1.0:1783074146.927783:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074147.758550:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723558784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074147.758638:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074147.758685:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783074147.758694:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723558912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074147.758725:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558784 00000100:00100000:1.0:1783074147.758729:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074147.758735:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558784 00000100:00100000:0.0:1783074147.758772:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723558912 00000100:00100000:0.0:1783074147.758822:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723558912 00000100:00100000:3.0:1783074147.758845:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:3.0:1783074147.758860:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723558784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074147.758885:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074147.758961:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723558784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074147.759530:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723558784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074147.759587:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:1.0:1783074147.759654:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1783074147.759667:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723558912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074147.759695:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074147.759746:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723558912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074147.759755:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:3.0:1783074147.759785:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723558912:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1783074147.760690:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968712 is committed 00000001:00080000:1.0:1783074147.762762:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000100:00100000:3.0:1783074147.824213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074147.824274:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064000 00000100:00100000:2.0:1783074147.824284:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064000 00000100:00100000:2.0:1783074147.824366:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1783074147.824378:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708064000:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074147.824475:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:da924155-7591-4a6a-a2d2-c0d2908d0bfb+10:2404:x1869685708064000:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074147.824483:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:1.0:1783074147.828110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074147.828136:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074147.828169:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074147.828208:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074147.828216:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064128 00000100:00100000:3.0:1783074147.828226:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064128 00000100:00100000:0.0:1783074147.828231:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064256 00000100:00100000:1.0:1783074147.828234:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064512 00000100:00100000:0.0:1783074147.828238:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064256 00000100:00100000:2.0:1783074147.828239:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064384 00000100:00100000:1.0:1783074147.828240:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064512 00000100:00100000:2.0:1783074147.828254:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064384 00000100:00100000:3.0:1783074147.828278:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 829 00000100:00100000:3.0:1783074147.828291:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708064128:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074147.828291:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2148 00000100:00100000:0.0:1783074147.828291:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 830 00000100:00100000:2.0:1783074147.828305:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2149 00000100:00100000:1.0:1783074147.828306:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708064512:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074147.828308:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708064256:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074147.828353:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708064384:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074147.828419:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708064512:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074147.828419:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2404:x1869685708064256:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074147.828421:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708064128:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074147.828431:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2405:x1869685708064384:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074147.828436:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2148 00000100:00100000:0.0:1783074147.828442:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 830 00000100:00100000:2.0:1783074147.828448:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2149 00000100:00100000:3.0:1783074147.828460:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 829 00010000:00010000:2.0:1783074147.951052:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074148.975035:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074149.613286:0:91745:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 06:22:28 (1783074148) 00000100:00100000:1.0:1783074149.649839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074149.649952:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064768 00000100:00100000:0.0:1783074149.649962:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064768 00000100:00080000:3.0:1783074149.650017:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074149.650040:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1228 00000100:00100000:0.0:1783074149.650052:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:70830:x1869685708064768:12345-192.168.204.26@tcp:36:mkdir.0 00000100:00100000:0.0:1783074149.650156:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66200:1869685723559040:0@lo:900:mdt00_000.0 00000100:00100000:0.0:1783074149.650193:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074149.650217:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074149.650345:0:66212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559040 00000100:00100000:3.0:1783074149.650349:0:66212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559040 00000100:00100000:3.0:1783074149.650384:0:66212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783074149.650391:0:66212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc220c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66200:x1869685723559040:12345-0@lo:900:mdt00_000.0 00000100:00100000:3.0:1783074149.650465:0:66212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc220c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66200:x1869685723559040:12345-0@lo:900:mdt00_000.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.650472:0:66212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783074149.651007:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66200:1869685723559040:0@lo:900:mdt00_000.0 00000100:00100000:0.0:1783074149.651065:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559168:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783074149.651115:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074149.651147:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.651162:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559168 00000100:00100000:2.0:1783074149.651167:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559168 00000100:00100000:2.0:1783074149.651276:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666 00000100:00100000:2.0:1783074149.651287:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.651421:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559168:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.651429:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666 00000100:00100000:0.0:1783074149.651451:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559168:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783074149.651503:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559296:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783074149.651525:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074149.651785:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074149.651819:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559296 00000100:00100000:3.0:1783074149.651824:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559296 00000100:00100000:3.0:1783074149.651855:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667 00000100:00100000:3.0:1783074149.651863:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783074149.651949:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559296:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.651956:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1783074149.652106:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559296:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.652142:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559424:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.652173:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.652200:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074149.652367:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559424 00000100:00100000:3.0:1783074149.652371:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559424 00000100:00100000:3.0:1783074149.652413:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3668 00000100:00100000:3.0:1783074149.652418:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783074149.652499:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559424:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (325us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783074149.652506:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3668 00000100:00100000:2.0:1783074149.652608:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559424:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783074149.652677:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.652689:0:66200:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.652699:0:66200:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074149.652711:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559552:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1783074149.652739:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.652755:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.652767:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559552 00000100:00100000:2.0:1783074149.652769:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559552 00000100:00100000:2.0:1783074149.652801:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:2.0:1783074149.652808:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66200:x1869685723559552:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783074149.652818:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074149.652839:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfba0 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.652866:0:26189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.652876:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.652898:0:26189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.652911:0:26189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 8 pid: 66201 timeout: 3088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074149.652921:0:26189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26189:1869685723559680:192.168.204.26@tcp:104: 00000100:00100000:2.0:1783074149.654692:0:26189:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b300 going to sleep for 11 seconds 00000100:00100000:0.0:1783074149.658684:0:26189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26189:1869685723559680:192.168.204.26@tcp:104: 00000100:00100000:2.0:1783074149.658685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1783074149.658722:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.658735:0:26189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:0.0:1783074149.658739:0:26189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074149.658743:0:26189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.658754:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c400, rc 0) 00000100:00100000:1.0:1783074149.658818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708064896 00000100:00100000:1.0:1783074149.658826:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708064896 00000100:00100000:0.0:1783074149.658828:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66200:x1869685723559552:12345-0@lo:101:mdt00_000.0 Request processed in 6018us (6088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074149.658840:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00010000:00010000:1.0:1783074149.658868:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 9 pid: 66201 timeout: 3088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074149.658880:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559552:0@lo:101:mdt00_000.0 00000100:00080000:0.0:1783074149.658893:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783074149.658898:0:66200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.658899:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2581 00010000:00010000:2.0:1783074149.658909:0:66200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.658909:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:2405:x1869685708064896:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074149.658923:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074149.658930:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 9 pid: 66201 timeout: 3088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.658942:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 9 pid: 66201 timeout: 3088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.658991:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086d200/0x5fb609b3016dfb22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f9 expref: 9 pid: 66201 timeout: 3088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.659004:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:1.0:1783074149.659009:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 6 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.659019:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 6 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.659028:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 6 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.659058:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 6 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.659072:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6514:1869685723559808:0@lo:105: 00000100:00100000:1.0:1783074149.659110:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074149.659157:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.659210:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783074149.659234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559808 00000100:00100000:2.0:1783074149.659242:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559808 00000100:00100000:2.0:1783074149.659278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1783074149.659284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c643e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6514:x1869685723559808:12345-0@lo:105: 00010000:00010000:2.0:1783074149.659303:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.659330:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.659339:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.659347:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.659353:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.659363:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.659381:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9524f086cc00) 00000100:00100000:2.0:1783074149.659412:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c643e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6514:x1869685723559808:12345-0@lo:105: Request processed in 128us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.659430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783074149.659463:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6514:1869685723559808:0@lo:105: 00010000:00010000:1.0:1783074149.659474:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074149.659555:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2405:x1869685708064896:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 646us (876us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074149.659556:0:66200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.659568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2581 00010000:00010000:0.0:1783074149.659573:0:66200:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074149.659598:0:66200:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783074149.659639:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.659658:0:66200:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.659668:0:66200:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.659684:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559936:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1783074149.659714:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074149.659741:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.659995:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723559936 00000100:00100000:2.0:1783074149.660000:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723559936 00000100:00100000:2.0:1783074149.660034:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:2.0:1783074149.660041:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66200:x1869685723559936:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783074149.660064:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074149.660077:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfbae expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.660095:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfbae expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.660105:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfbae expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.660112:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9523c8d7ca00) 00010000:00010000:2.0:1783074149.660114:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074149.660117:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086dc00, rc 0) 00000100:00100000:2.0:1783074149.660156:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723559936:12345-0@lo:101:mdt00_000.0 Request processed in 115us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.660162:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1783074149.660786:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723559936:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783074149.660802:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.660809:0:66200:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074149.660820:0:66200:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1783074149.660844:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560064:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783074149.660866:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074149.660886:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074149.660926:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560064 00000100:00100000:0.0:1783074149.660930:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560064 00000100:00100000:0.0:1783074149.660964:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:0.0:1783074149.660972:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783074149.661038:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560064:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074149.661045:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:1.0:1783074149.661097:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560064:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783074149.661132:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560192:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783074149.661154:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074149.661175:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074149.661211:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560192 00000100:00100000:0.0:1783074149.661215:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560192 00000100:00100000:0.0:1783074149.661278:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:0.0:1783074149.661286:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783074149.661396:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560192:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (240us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783074149.661403:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:1.0:1783074149.661484:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560192:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783074149.661547:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560320:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783074149.661569:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074149.662179:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.662232:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560320 00000100:00100000:2.0:1783074149.662238:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560320 00000100:00100000:2.0:1783074149.662271:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:2.0:1783074149.662281:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662385:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560320:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (814us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074149.662393:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:2.0:1783074149.662435:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560320:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662556:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662632:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.662653:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.662663:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560448 00000100:00100000:2.0:1783074149.662666:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560448 00000100:00100000:2.0:1783074149.662685:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:2.0:1783074149.662693:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662744:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560448:12345-0@lo:1000:mdt00_000.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.662751:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00100000:2.0:1783074149.662781:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662821:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560576:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662842:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.662854:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.662864:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560576 00000100:00100000:2.0:1783074149.662866:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560576 00000100:00100000:2.0:1783074149.662885:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:2.0:1783074149.662889:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662927:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560576:12345-0@lo:1000:mdt00_000.0 Request processed in 39us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.662932:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:2.0:1783074149.662947:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560576:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662976:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560704:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.662991:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.663000:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.663009:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560704 00000100:00100000:2.0:1783074149.663011:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560704 00000100:00100000:2.0:1783074149.663028:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:2.0:1783074149.663032:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.663075:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560704:12345-0@lo:1000:mdt00_000.0 Request processed in 43us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.663079:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:2.0:1783074149.663105:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560704:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783074149.663208:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560832:0@lo:700:mdt00_000.0 00000100:00100000:2.0:1783074149.663235:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.663251:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.663268:0:66210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723560832 00000100:00100000:2.0:1783074149.663271:0:66210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723560832 00000100:00100000:2.0:1783074149.663331:0:66210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783074149.663340:0:66209:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:2.0:1783074149.663341:0:66210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560832:12345-0@lo:700:mdt00_000.0 00000100:00100000:0.0:1783074149.663351:0:66209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:2.0:1783074149.663395:0:66210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:66200:x1869685723560832:12345-0@lo:700:mdt00_000.0 Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.663402:0:66210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783074149.663410:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723560832:0@lo:700:mdt00_000.0 00000040:00080000:0.0:1783074149.663495:0:66200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074149.663516:0:66200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].29, 64 off34624 00000004:00080000:0.0:1783074149.663524:0:66200:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9524f4a46480 with version 5 00000040:00080000:0.0:1783074149.663585:0:66200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074149.663596:0:66200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].30, 64 off34688 00000004:00080000:2.0:1783074149.663599:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 5 rpc_version 5 00000004:00080000:0.0:1783074149.663602:0:66200:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9524f4a46a80 with version 6 00000020:00100000:2.0:1783074149.663621:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783074149.663631:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9523c4aead80 x1869685723561088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074149.663648:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723561088:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783074149.663683:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.663700:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.663714:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723561088 00000100:00100000:2.0:1783074149.663718:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723561088 00000100:00100000:2.0:1783074149.663745:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:2.0:1783074149.663752:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723561088:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1783074149.664659:0:66200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074149.664735:0:66200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400013a0:0x3:0x0].15, 64 off33728 00000040:00080000:2.0:1783074149.664965:0:66200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].1, 1000 off33768 00000040:00080000:2.0:1783074149.665077:0:66200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].1, 1152 off33920 00000004:00080000:2.0:1783074149.665149:0:66200:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9523c456bcc0 with version 7 00000001:00080000:1.0:1783074149.669481:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00000100:00100000:0.0:1783074149.669710:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723561088:12345-0@lo:1000:osp_up0-1.0 Request processed in 5953us (6022us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1783074149.669723:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000004:00080000:2.0:1783074149.669736:0:75600:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:2.0:1783074149.669743:0:75600:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000100:00100000:2.0:1783074149.669762:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723561088:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783074149.669788:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 6 rpc_version 6 00000020:00100000:2.0:1783074149.669813:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783074149.669820:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9523c4aead80 x1869685723561344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074149.669842:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723561344:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783074149.669882:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.669917:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074149.669968:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723561344 00000100:00100000:0.0:1783074149.669974:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723561344 00000100:00100000:0.0:1783074149.670148:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:0.0:1783074149.670159:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723561344:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1783074149.674511:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00000100:00100000:0.0:1783074149.674771:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723561344:12345-0@lo:1000:osp_up0-1.0 Request processed in 4610us (4886us total) trans 115964116996 rc 0/0 00000100:00100000:0.0:1783074149.674783:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000004:00080000:1.0:1783074149.674858:0:75600:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116996 committed transno 115964116996 00000100:00100000:1.0:1783074149.674863:0:75600:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000100:00100000:1.0:1783074149.674880:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723561344:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783074149.674904:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 7 rpc_version 7 00000020:00100000:1.0:1783074149.674934:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783074149.674941:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9524debf7b80 x1869685723561600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074149.674968:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723561600:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783074149.675077:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074149.675109:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c480d480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074149.675880:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723561600 00000100:00100000:3.0:1783074149.675888:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723561600 00000100:00100000:3.0:1783074149.675966:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:3.0:1783074149.675974:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723561600:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783074149.677369:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75600:x1869685723561600:12345-0@lo:1000:osp_up0-1.0 Request processed in 1391us (2287us total) trans 115964116997 rc 0/0 00000100:00100000:1.0:1783074149.677378:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00000100:00100000:2.0:1783074149.677412:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723561600:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1783074149.677588:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677605:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677616:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074149.677629:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d2d650f reply state 000000009c438da4 transno 77309411442 ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677640:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677649:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:0.0:1783074149.677659:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074149.677664:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783074149.677671:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00080000:0.0:1783074149.677680:0:66200:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783074149.677690:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677700:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677707:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677732:0:66200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783074149.677737:0:66200:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783074149.677743:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.677750:0:66200:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.677771:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074149.677781:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.677792:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086cc00 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:3.0:1783074149.677799:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074149.677809:0:8460:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.677834:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70830:x1869685708064768:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 27779us (27996us total) trans 77309411442 rc 0/0 00000100:00100000:0.0:1783074149.677843:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1228 00010000:00010000:3.0:1783074149.677844:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.677851:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074149.677878:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.677889:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1783074149.677896:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524f086cc00/0x5fb609b3016dfba0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfba7 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.677907:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723561728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074149.677916:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074149.677920:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074149.677924:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074149.677956:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074149.678097:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723561728 00000100:00100000:1.0:1783074149.678103:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723561728 00000100:00100000:3.0:1783074149.678158:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1783074149.678168:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+9:3659:x1869685723561728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074149.678182:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074149.678794:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086c400/0x5fb609b3016dfba7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfba0 expref: 9 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.678810:0:19658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d6c55600) 00010000:00010000:3.0:1783074149.678820:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074149.678894:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+8:3659:x1869685723561728:12345-0@lo:103:ldlm_bl.0 Request processed in 727us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.678901:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1783074149.679037:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723561728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074149.684863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074149.684969:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065024 00000100:00100000:1.0:1783074149.684978:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065024 00000100:00100000:1.0:1783074149.685035:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1229 00000100:00100000:1.0:1783074149.685043:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70834:x1869685708065024:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074149.685066:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074149.685091:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016dfbc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b115 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.685161:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016dfbca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.685174:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016dfbca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.685184:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016dfbca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074149.685217:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783074149.685220:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074149.685237:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016dfbca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.685272:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016dfbc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b115 expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.685301:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016dfbca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b115 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.685334:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4575200) 00010000:00010000:1.0:1783074149.685338:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783074149.685341:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e600, rc 0) 00000100:00100000:1.0:1783074149.685397:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065024:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 354us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074149.685404:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1229 00000100:00100000:0.0:1783074149.686724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074149.686809:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065152 00000100:00100000:3.0:1783074149.686815:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065152 00000100:00100000:3.0:1783074149.686860:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1230 00000100:00100000:3.0:1783074149.686870:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065152:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074149.686882:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074149.686897:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016dfbd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b11c expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.686940:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.686958:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.686968:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.686981:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.686992:0:66201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfbae expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.687000:0:66201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.687033:0:66201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfbae expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074149.687050:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66201:1869685723561856:0@lo:104: 00000100:00100000:3.0:1783074149.687104:0:66201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.687145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723561856 00000100:00100000:2.0:1783074149.687151:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723561856 00000100:00100000:3.0:1783074149.687163:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cec300 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.687198:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783074149.687208:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66201:x1869685723561856:12345-0@lo:104: 00010000:00010000:2.0:1783074149.687220:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.687309:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783074149.687336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66201:x1869685723561856:12345-0@lo:104: Request processed in 131us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.687347:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66201:1869685723561856:0@lo:104: 00000100:00100000:2.0:1783074149.687348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:0.0:1783074149.687352:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074149.687362:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.687372:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299e00 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:3.0:1783074149.687373:0:66201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.687379:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074149.687390:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.687418:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.687424:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074149.687451:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.687458:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3299e00/0x5fb609b3016dfbae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfbb5 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074149.687470:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783074149.687479:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074149.687482:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074149.687485:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723561984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074149.687486:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074149.687520:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074149.687558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723561984 00000100:00100000:0.0:1783074149.687563:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723561984 00010000:00010000:0.0:1783074149.687579:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x5fb609b3016dfbae expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.687603:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1783074149.687617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3658:x1869685723561984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074149.687627:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1783074149.689448:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00010000:00010000:0.0:1783074149.689660:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f086dc00/0x5fb609b3016dfbb5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfbae expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.689678:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9523c8d7ca00) 00010000:00010000:0.0:1783074149.689685:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.689695:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.689703:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.689736:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074149.689761:0:66201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.689771:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.689803:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723561984:12345-0@lo:103:ldlm_bl.0 Request processed in 2185us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074149.689813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1783074149.689917:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66201:1869685723562112:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783074149.689952:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723561984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074149.689991:0:66201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074149.690031:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562112 00000100:00100000:2.0:1783074149.690036:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562112 00000100:00100000:3.0:1783074149.690040:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cec600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074149.690094:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:2.0:1783074149.690102:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66201:x1869685723562112:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783074149.690188:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66201:x1869685723562112:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.690195:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00100000:3.0:1783074149.690372:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66201:1869685723562112:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783074149.690424:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016dfbe6 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690434:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016dfbe6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690442:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016dfbe6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074149.690463:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016dfbe6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690476:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690483:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690491:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690498:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.690502:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690517:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690535:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4575200) 00010000:00010000:3.0:1783074149.690538:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.690543:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690550:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016dfbd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690563:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690570:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690576:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690581:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bca00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.690585:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690589:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690596:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9523c8d7ca00) 00010000:00010000:3.0:1783074149.690597:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.690599:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690603:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016dfbdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690659:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016dfbd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b11c expref: 11 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690678:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016dfbe6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b11c expref: 10 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.690685:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3000) 00010000:00010000:3.0:1783074149.690686:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074149.690688:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bda00, rc 0) 00000100:00100000:3.0:1783074149.690734:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:70834:x1869685708065152:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 3866us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.690742:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1230 00000100:00100000:2.0:1783074149.692355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074149.692393:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065280 00000100:00100000:0.0:1783074149.692400:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065280 00000100:00100000:0.0:1783074149.692451:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1231 00000100:00100000:0.0:1783074149.692462:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:70834:x1869685708065280:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074149.692481:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074149.692502:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dfbed lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b123 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.692549:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298200/0x5fb609b3016dfbf4 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.692568:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298200/0x5fb609b3016dfbf4 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.692575:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298200/0x5fb609b3016dfbf4 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074149.692617:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783074149.692622:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783074149.692652:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dfbed lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b123 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.692667:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298200/0x5fb609b3016dfbf4 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b123 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.692732:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:0.0:1783074149.692735:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783074149.692739:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298200, rc 0) 00000100:00100000:0.0:1783074149.692787:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065280:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 328us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074149.692792:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1231 00000100:00100000:2.0:1783074149.694886:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074149.695040:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065408 00000100:00100000:3.0:1783074149.695049:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065408 00000100:00100000:3.0:1783074149.695158:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1232 00000100:00100000:3.0:1783074149.695170:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065408:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074149.695188:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074149.695208:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfbfb lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b12a expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695272:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695287:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695340:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695364:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695373:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695380:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695419:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695427:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695439:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695447:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695453:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.695458:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695465:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695481:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:3.0:1783074149.695484:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.695490:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695503:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfc02 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695514:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695519:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695526:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695530:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.695534:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695541:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695560:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9523cadc3a00) 00010000:00010000:3.0:1783074149.695563:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.695566:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695573:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfc09 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695607:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfbfb lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b12a expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695629:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:3.0:1783074149.695632:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.695637:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfbfb lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b12a expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.695648:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bcc00, rc 0) 00000100:00100000:3.0:1783074149.695688:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065408:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 521us (807us total) trans 0 rc 301/301 00000100:00100000:3.0:1783074149.695696:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1232 00000100:00100000:2.0:1783074149.697248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074149.697415:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065536 00000100:00100000:3.0:1783074149.697422:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065536 00000100:00100000:3.0:1783074149.697494:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1233 00000100:00100000:3.0:1783074149.697504:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065536:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074149.697518:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074149.697533:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bc200/0x5fb609b3016dfc10 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b131 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697583:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697599:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697610:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697625:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697640:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697649:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697678:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697686:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 2/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697692:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697698:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bca00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.697703:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697710:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697721:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:3.0:1783074149.697725:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.697730:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697737:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfc17 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697749:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697761:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697768:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697773:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.697776:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697782:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697792:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9523cadc3200) 00010000:00010000:3.0:1783074149.697796:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.697799:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697806:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bde00/0x5fb609b3016dfc1e lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697836:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bc200/0x5fb609b3016dfc10 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b131 expref: 10 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697846:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:3.0:1783074149.697849:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074149.697852:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bc200/0x5fb609b3016dfc10 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b131 expref: 10 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.697874:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc200, rc 0) 00000100:00100000:3.0:1783074149.698038:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065536:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 535us (792us total) trans 0 rc 301/301 00000100:00100000:3.0:1783074149.698046:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1233 00000100:00100000:2.0:1783074149.702876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074149.703023:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065664 00000100:00100000:0.0:1783074149.703033:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065664 00000100:00100000:0.0:1783074149.703116:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1234 00000100:00100000:0.0:1783074149.703127:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+9:70834:x1869685708065664:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074149.703148:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074149.703194:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dfc25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b138 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.703278:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299e00/0x5fb609b3016dfc2c lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.703302:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299e00/0x5fb609b3016dfc2c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.703362:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299e00/0x5fb609b3016dfc2c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074149.703404:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783074149.703408:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074149.703427:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299e00/0x5fb609b3016dfc2c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.703457:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dfc25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b138 expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.703480:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299e00/0x5fb609b3016dfc2c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b138 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.703490:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:0.0:1783074149.703493:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783074149.703497:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299e00, rc 0) 00000100:00100000:0.0:1783074149.703553:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:70834:x1869685708065664:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 426us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074149.703562:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1234 00000100:00100000:3.0:1783074149.708523:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074149.708563:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708065920 00000100:00100000:1.0:1783074149.708572:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708065920 00000100:00100000:1.0:1783074149.708631:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1235 00000100:00100000:1.0:1783074149.708640:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:70834:x1869685708065920:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074149.708661:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074149.708685:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e800/0x5fb609b3016dfc33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b13f expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074149.708791:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783074149.708907:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e800/0x5fb609b3016dfc33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b13f expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.708925:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074149.708929:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783074149.708942:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e800/0x5fb609b3016dfc33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b13f expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.708960:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e800, rc 0) 00000100:00100000:1.0:1783074149.709030:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:70834:x1869685708065920:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 390us (516us total) trans 77309411443 rc 301/301 00000100:00100000:1.0:1783074149.709038:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1235 00000100:00100000:2.0:1783074149.711344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074149.711390:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708066176 00000100:00100000:1.0:1783074149.711398:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708066176 00000100:00100000:1.0:1783074149.711452:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1236 00000100:00100000:1.0:1783074149.711462:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:70834:x1869685708066176:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:1.0:1783074149.711510:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074149.711532:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299e00/0x5fb609b3016dfc2c lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b138 expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.711546:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:1.0:1783074149.711551:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074149.711606:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.711622:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.711634:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.711651:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.711658:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.711674:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712244:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712256:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712265:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074149.712280:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca0fc0c4 reply state 0000000086dfa71d transno 77309411444 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712302:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712330:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524f4575100) 00010000:00010000:1.0:1783074149.712333:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074149.712337:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783074149.712343:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1783074149.712353:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712361:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712369:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712376:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074149.712387:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712396:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712407:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:1.0:1783074149.712410:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074149.712414:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712421:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28fc00/0x5fb609b3016dfc41 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074149.712432:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca0fc0c4 reply state 0000000086dfa71d transno 77309411444 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712440:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.712446:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9524f4575b00) 00010000:00010000:1.0:1783074149.712449:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074149.712451:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783074149.712525:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:70834:x1869685708066176:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 1064us (1187us total) trans 77309411444 rc 0/0 00000100:00100000:1.0:1783074149.712534:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1236 00000100:00100000:2.0:1783074149.716738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074149.716844:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708066432 00000100:00100000:0.0:1783074149.716853:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708066432 00000100:00100000:0.0:1783074149.716909:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:0.0:1783074149.716919:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+12:70834:x1869685708066432:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1783074149.717217:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:70834:x1869685708066432:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 299us (486us total) trans 77309411445 rc 0/0 00000100:00100000:0.0:1783074149.717226:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:2.0:1783074149.743100:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074149.743143:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074149.743174:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708066560 00000100:00100000:0.0:1783074149.743183:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708066560 00000100:00100000:2.0:1783074149.743197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074149.743199:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708066688 00000100:00100000:3.0:1783074149.743206:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708066688 00000100:00100000:0.0:1783074149.743230:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708066816 00000100:00100000:0.0:1783074149.743235:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708066816 00000100:00100000:3.0:1783074149.743259:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 693 00000100:00100000:2.0:1783074149.743270:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 694 00000100:00100000:3.0:1783074149.743273:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da924155-7591-4a6a-a2d2-c0d2908d0bfb+12:2403:x1869685708066560:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783074149.743302:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da924155-7591-4a6a-a2d2-c0d2908d0bfb+12:2402:x1869685708066688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074149.743303:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074149.743338:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074149.743354:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159800/0x5fb609b3016df851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0f2 expref: 12 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.743355:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158a00/0x5fb609b3016df71d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0dd expref: 12 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074149.743355:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 695 00000100:00100000:0.0:1783074149.743372:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:da924155-7591-4a6a-a2d2-c0d2908d0bfb+12:2403:x1869685708066816:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074149.743381:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074149.743383:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074149.743398:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158600/0x5fb609b3016df724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0e4 expref: 10 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.743401:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074149.743412:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074149.743428:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:2403:x1869685708066560:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.743434:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 693 00000100:00100000:0.0:1783074149.743440:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:da924155-7591-4a6a-a2d2-c0d2908d0bfb+9:2403:x1869685708066816:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074149.743451:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 695 00000100:00100000:2.0:1783074149.743452:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da924155-7591-4a6a-a2d2-c0d2908d0bfb+8:2402:x1869685708066688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 165us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074149.743614:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 694 00000100:00100000:2.0:1783074149.745147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074149.745187:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708067072 00000100:00100000:3.0:1783074149.745194:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708067072 00000100:00100000:3.0:1783074149.745257:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4915 00000100:00100000:3.0:1783074149.745266:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+6:2401:x1869685708067072:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:3.0:1783074149.745303:0:26172:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df36c 00000020:00010000:3.0:1783074149.745324:0:26172:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524ee2c0800: total 0 00000100:00080000:3.0:1783074149.745329:0:26172:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c4800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783074149.745335:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1783074149.745372:0:26172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968712 00000020:00010000:2.0:1783074149.745375:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524ee2c0800: total 0 00010000:00010000:2.0:1783074149.745426:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524ee2c0800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1783074149.745456:0:6518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1783074149.745460:0:6518:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb atime from disk: 0 -> 1783074108 00002000:00010000:2.0:1783074149.745513:0:6518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1783074149.745535:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c0db4f3/0x5fb609b3016df675 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0b3 expref: 4 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.745559:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524ee2c0800, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1783074149.745566:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+3:2401:x1869685708067072:12345-192.168.204.26@tcp:9:umount.0 Request processed in 300us (421us total) trans 0 rc 0/0 00010000:00010000:2.0:1783074149.745575:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074149.745576:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4915 00010000:00010000:2.0:1783074149.745579:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074149.745583:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074149.752027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074149.752088:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708067456 00000100:00100000:2.0:1783074149.752099:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708067456 00000100:00100000:2.0:1783074149.752165:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4916 00000100:00100000:2.0:1783074149.752177:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+7:2401:x1869685708067456:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:2.0:1783074149.752210:0:8443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df365 00000020:00010000:2.0:1783074149.752218:0:8443:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524d2ca4000: total 0 00000100:00080000:2.0:1783074149.752222:0:8443:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783074149.752277:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968716 00000020:00010000:1.0:1783074149.752332:0:46245:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524d2ca4000: total 0 00010000:00010000:1.0:1783074149.752337:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074149.752344:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074149.752473:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+5:2401:x1869685708067456:12345-192.168.204.26@tcp:9:umount.0 Request processed in 298us (453us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074149.752474:0:46245:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524d2ca4000, canceled 0 locks, left on hash table 2. 00000100:00100000:2.0:1783074149.752492:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4916 00010000:00010000:1.0:1783074149.752536:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002443102f/0x5fb609b3016df67c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0ba expref: 4 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.752587:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016df66e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0ac expref: 3 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.752604:0:46245:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524d2ca4000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783074149.752619:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074149.752621:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074149.752623:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074149.756993:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074149.757039:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708067968 00000100:00100000:2.0:1783074149.757046:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708067968 00000100:00100000:2.0:1783074149.757089:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1237 00000100:00100000:2.0:1783074149.757096:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+10:2401:x1869685708067968:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:2.0:1783074149.757132:0:66200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df79b 00000020:00010000:2.0:1783074149.757146:0:66200:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524c3568000: total 0 00000100:00080000:2.0:1783074149.757151:0:66200:0:(import.c:65:import_set_state_nolock()) ffff9524c6022000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783074149.757180:0:66200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116997 00000020:00010000:0.0:1783074149.757328:0:8460:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524c3568000: total 0 00010000:00010000:0.0:1783074149.757386:0:8460:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524c3568000, canceled 0 locks, left on hash table 4. 00000100:00100000:2.0:1783074149.757391:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+8:2401:x1869685708067968:12345-192.168.204.26@tcp:39:umount.0 Request processed in 293us (405us total) trans 115964116998 rc 0/0 00000100:00100000:2.0:1783074149.757398:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1237 00010000:00010000:0.0:1783074149.757424:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4575200) 00010000:00010000:0.0:1783074149.757429:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074149.757440:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016dfbca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b115 expref: 7 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.757495:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:0.0:1783074149.757498:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1783074149.757503:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016df969 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0a5 expref: 6 pid: 90954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.757518:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3000) 00010000:00010000:0.0:1783074149.757521:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074149.757525:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016dfbe6 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b11c expref: 5 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.757540:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9524c8cd5e00) 00010000:00010000:0.0:1783074149.757542:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074149.757545:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016dfb92 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b10e expref: 4 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.757559:0:8460:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524c3568000, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1783074149.757573:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074149.757575:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074149.757576:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074149.766177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074149.766341:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708068224 00000100:00100000:1.0:1783074149.766350:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708068224 00000100:00100000:1.0:1783074149.766414:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1238 00000100:00100000:1.0:1783074149.766425:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+13:2401:x1869685708068224:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:1.0:1783074149.766467:0:67186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016d9fab 00000020:00010000:1.0:1783074149.766481:0:67186:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524fc252000: total 0 00000100:00080000:1.0:1783074149.766486:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524c5fd9800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1783074149.766527:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524fc252000: total 0 00000001:00000004:1.0:1783074149.766529:0:67186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411445 00010000:00010000:3.0:1783074149.766568:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.766580:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.766583:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524fc252000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783074149.766590:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.766598:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074149.766603:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.766724:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:3.0:1783074149.766725:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.766730:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783074149.766744:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff600) 00010000:00010000:3.0:1783074149.766748:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074149.766751:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298200/0x5fb609b3016dfbf4 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b123 expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074149.766753:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.766759:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0510a7c0-d9c1-4de9-a6c3-ede973deaaff+11:2401:x1869685708068224:12345-192.168.204.26@tcp:39:umount.0 Request processed in 332us (587us total) trans 77309411446 rc 0/0 00010000:00010000:3.0:1783074149.766772:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dfbbc lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.766780:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1238 00010000:00010000:0.0:1783074149.766807:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524fc252000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783074149.766811:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766820:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.766821:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074149.766825:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074149.766829:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074149.766830:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074149.766848:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074149.766852:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766858:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766867:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9524f4575b00) 00010000:00010000:1.0:1783074149.766870:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074149.766873:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766879:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016dfc48 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766892:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766898:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766903:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766908:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074149.766911:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766916:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766939:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524f4575100) 00010000:00010000:1.0:1783074149.766941:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074149.766944:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074149.766949:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016dfc4f lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074149.786879:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074149.786926:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708068480 00000100:00100000:3.0:1783074149.786934:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708068480 00000100:00100000:3.0:1783074149.786990:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:3.0:1783074149.787001:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+7:2401:x1869685708068480:12345-192.168.204.26@tcp:251:umount.0 00000020:00000080:3.0:1783074149.787064:0:90925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df70f 00000020:00010000:3.0:1783074149.787071:0:90925:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524d2ca0000: total 0 00000100:00080000:3.0:1783074149.787076:0:90925:0:(import.c:65:import_set_state_nolock()) ffff9524c3569800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1783074149.787188:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524d2ca0000: total 0 00000100:00100000:3.0:1783074149.787203:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da924155-7591-4a6a-a2d2-c0d2908d0bfb+3:2401:x1869685708068480:12345-192.168.204.26@tcp:251:umount.0 Request processed in 204us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074149.787210:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00010000:00010000:2.0:1783074149.787264:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524d2ca0000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783074149.787361:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671c00/0x5fb609b3016df72b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b0eb expref: 2 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074149.787376:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524d2ca0000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1783074149.787388:0:6518:0:(genops.c:906:class_export_put()) final put ffff9524d2ca0000/da924155-7591-4a6a-a2d2-c0d2908d0bfb 00010000:00010000:2.0:1783074149.787409:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074149.787412:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074149.787413:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783074149.787478:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca0000/da924155-7591-4a6a-a2d2-c0d2908d0bfb for MGS 00000020:00000080:3.0:1783074149.787513:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c3569800 for MGS 00010000:00010000:3.0:1783074149.998577:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074150.311987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.312134:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708068608 00000100:00100000:3.0:1783074150.312145:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708068608 00000100:00100000:3.0:1783074150.312192:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:3.0:1783074150.312201:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1869685708068608:12345-192.168.204.26@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783074150.312229:0:90926:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp t0 exp 0000000000000000 cur 2989 last 0 00000020:00000080:3.0:1783074150.312251:0:90926:0:(genops.c:1406:class_connect()) connect: client f1623620-a4b0-4769-84e0-0d08c968afe8, cookie 0x5fb609b3016dfc56 00000100:00080000:3.0:1783074150.312301:0:90926:0:(import.c:65:import_set_state_nolock()) ffff9524f7814800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074150.312439:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+5:2401:x1869685708068608:12345-192.168.204.26@tcp:250:mount.lustre.0 Request processed in 238us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.312445:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:0.0:1783074150.315466:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074150.317059:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708068736 00000100:00100000:1.0:1783074150.317071:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708068736 00000100:00100000:1.0:1783074150.317143:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:1.0:1783074150.317154:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+5:70857:x1869685708068736:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783074150.317174:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074150.317192:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28f800/0x5fb609b3016dfc5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b154 expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074150.317217:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28f800/0x5fb609b3016dfc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b154 expref: 6 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074150.317226:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28f800/0x5fb609b3016dfc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b154 expref: 6 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074150.317234:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28f800, rc 0) 00000100:00100000:1.0:1783074150.317299:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70857:x1869685708068736:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 148us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074150.317304:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:1.0:1783074150.318531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.318582:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708068864 00000100:00100000:2.0:1783074150.318589:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708068864 00000100:00100000:2.0:1783074150.318632:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1783074150.318645:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70857:x1869685708068864:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783074150.318978:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70857:x1869685708068864:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 332us (446us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074150.318987:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1783074150.320138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.320188:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708068992 00000100:00100000:3.0:1783074150.320195:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708068992 00000100:00100000:3.0:1783074150.320238:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:3.0:1783074150.320247:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d24a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70857:x1869685708068992:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783074150.320257:0:90925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074150.320274:0:90925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bde00/0x5fb609b3016dfc64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b15b expref: -99 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074150.320363:0:90925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bde00/0x5fb609b3016dfc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b15b expref: 7 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074150.320373:0:90925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bde00/0x5fb609b3016dfc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b15b expref: 7 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074150.320382:0:90925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bde00, rc 0) 00000100:00100000:3.0:1783074150.320434:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d24a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+7:70857:x1869685708068992:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 189us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.320441:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:0.0:1783074150.324568:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.324626:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069120 00000100:00100000:3.0:1783074150.324636:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069120 00000100:00100000:3.0:1783074150.324697:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:3.0:1783074150.324708:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+7:70857:x1869685708069120:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783074150.324873:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70857:x1869685708069120:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 168us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.324881:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:1.0:1783074150.329355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.329751:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069248 00000100:00100000:2.0:1783074150.329761:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069248 00000100:00100000:2.0:1783074150.329824:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:2.0:1783074150.329837:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f02d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70857:x1869685708069248:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783074150.329995:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f02d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70857:x1869685708069248:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 160us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074150.330003:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:2.0:1783074150.333385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.334306:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069376 00000100:00100000:3.0:1783074150.334339:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069376 00000100:00100000:3.0:1783074150.334408:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:3.0:1783074150.334418:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70875:x1869685708069376:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783074150.334582:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70875:x1869685708069376:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 165us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.334591:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:0.0:1783074150.350524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.350666:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069504 00000100:00100000:3.0:1783074150.350690:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069504 00000100:00100000:3.0:1783074150.350754:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:3.0:1783074150.350764:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70875:x1869685708069504:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783074150.350955:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70875:x1869685708069504:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 192us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.350964:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1783074150.356592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.356669:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069632 00000100:00100000:3.0:1783074150.356680:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069632 00000100:00100000:3.0:1783074150.356750:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:3.0:1783074150.356761:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70875:x1869685708069632:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783074150.356916:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70875:x1869685708069632:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 156us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.356929:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:0.0:1783074150.359895:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.360108:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069760 00000100:00100000:2.0:1783074150.360117:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069760 00000100:00100000:2.0:1783074150.360169:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:2.0:1783074150.360179:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70857:x1869685708069760:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783074150.360196:0:90924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074150.360215:0:90924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086c000/0x5fb609b3016dfc6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b18c expref: -99 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074150.360246:0:90924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c000/0x5fb609b3016dfc6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b18c expref: 9 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074150.360259:0:90924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086c000/0x5fb609b3016dfc6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b18c expref: 9 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074150.360269:0:90924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c000, rc 0) 00000100:00100000:2.0:1783074150.360490:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70857:x1869685708069760:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 313us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074150.360496:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:0.0:1783074150.363494:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.364003:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708069888 00000100:00100000:2.0:1783074150.364014:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708069888 00000100:00100000:2.0:1783074150.364076:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:2.0:1783074150.364087:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70857:x1869685708069888:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783074150.364113:0:90926:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783074150.364137:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783074150.364141:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783074150.364144:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783074150.364147:0:90926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783074150.364149:0:90926:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:2.0:1783074150.366706:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70857:x1869685708069888:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 2612us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074150.366720:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:0.0:1783074150.370524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.370573:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070016 00000100:00100000:3.0:1783074150.370584:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070016 00000100:00100000:3.0:1783074150.370642:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:3.0:1783074150.370654:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70857:x1869685708070016:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783074150.370672:0:90925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074150.370692:0:90925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bc200/0x5fb609b3016dfc72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b193 expref: -99 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074150.370723:0:90925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bc200/0x5fb609b3016dfc72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b193 expref: 10 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074150.370734:0:90925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bc200/0x5fb609b3016dfc72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b193 expref: 10 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074150.370762:0:90925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc200, rc 0) 00000100:00100000:3.0:1783074150.370815:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70857:x1869685708070016:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 164us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.370820:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:0.0:1783074150.372477:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.372722:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070144 00000100:00100000:3.0:1783074150.372727:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070144 00000100:00100000:3.0:1783074150.372762:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:3.0:1783074150.372768:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70857:x1869685708070144:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783074150.373536:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70857:x1869685708070144:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 764us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.373545:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:1.0:1783074150.375993:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.376084:0:90924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070272 00000100:00100000:2.0:1783074150.376092:0:90924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070272 00000100:00100000:2.0:1783074150.376223:0:90924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:2.0:1783074150.376233:0:90924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70857:x1869685708070272:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783074150.376408:0:90924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70857:x1869685708070272:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 175us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074150.376415:0:90924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:0.0:1783074150.378115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.378241:0:90926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070400 00000100:00100000:2.0:1783074150.378247:0:90926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070400 00000100:00100000:2.0:1783074150.378305:0:90926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:2.0:1783074150.378338:0:90926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70880:x1869685708070400:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783074150.378467:0:90926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70880:x1869685708070400:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 154us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074150.378475:0:90926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:0.0:1783074150.379866:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.379937:0:90925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070528 00000100:00100000:3.0:1783074150.379943:0:90925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070528 00000100:00100000:3.0:1783074150.379976:0:90925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:3.0:1783074150.379984:0:90925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e016a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70880:x1869685708070528:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783074150.380130:0:90925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e016a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70880:x1869685708070528:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 142us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.380138:0:90925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:1.0:1783074150.382988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.383059:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070656 00000100:00100000:3.0:1783074150.383065:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070656 00000100:00100000:3.0:1783074150.383108:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1239 00000100:00100000:3.0:1783074150.383115:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708070656:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783074150.383144:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 2989 last 0 00000020:00000080:3.0:1783074150.383291:0:66201:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016dfc79 00000004:00100000:3.0:1783074150.383412:0:66201:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783074150.383515:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524f7812000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074150.383578:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708070656:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 461us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.383585:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1239 00000100:00100000:2.0:1783074150.383689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.383822:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070912 00000100:00100000:3.0:1783074150.383827:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070912 00000100:00100000:3.0:1783074150.383859:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1240 00000100:00100000:3.0:1783074150.383864:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869685708070912:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783074150.383879:0:66200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 2989 last 0 00000020:00000080:3.0:1783074150.383910:0:66200:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016dfc80 00000004:00100000:3.0:1783074150.383922:0:66200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783074150.383976:0:66200:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074150.384013:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708070912:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.384020:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1240 00000100:00100000:2.0:1783074150.385952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074150.386029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074150.386150:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071168 00000100:00100000:3.0:1783074150.386159:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708070784 00000100:00100000:1.0:1783074150.386160:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071168 00000100:00100000:3.0:1783074150.386163:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708070784 00000100:00100000:3.0:1783074150.386214:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1241 00000100:00100000:3.0:1783074150.386223:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:0:x1869685708070784:12345-192.168.204.26@tcp:41:mount.lustre.0 00000100:00100000:1.0:1783074150.386398:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1242 00000100:00100000:1.0:1783074150.386407:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70857:x1869685708071168:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783074150.386439:0:68632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444708352 avail 1298468864 00000004:00000024:1.0:1783074150.386439:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444708352 avail 1298468864 00000100:00080000:0.0:1783074150.386499:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783074150.386508:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:0:x1869685708070784:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 286us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.386516:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1241 00000100:00100000:1.0:1783074150.386651:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071168:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 245us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074150.386658:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1242 00000100:00100000:0.0:1783074150.386822:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.386849:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071040 00000100:00100000:3.0:1783074150.386853:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071040 00000100:00100000:3.0:1783074150.386908:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1243 00000100:00100000:3.0:1783074150.386916:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:0:x1869685708071040:12345-192.168.204.26@tcp:41:mount.lustre.0 00000100:00080000:1.0:1783074150.386936:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1783074150.386993:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:3.0:1783074150.387039:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:0:x1869685708071040:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 123us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.387046:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1243 00000100:00100000:2.0:1783074150.389881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074150.389977:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071296 00000100:00100000:3.0:1783074150.389994:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071296 00000100:00100000:3.0:1783074150.390082:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1244 00000100:00100000:3.0:1783074150.390092:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071296:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783074150.390168:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071296:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074150.390176:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1244 00000100:00100000:2.0:1783074150.391749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074150.391832:0:66211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071680 00000100:00100000:1.0:1783074150.391838:0:66211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071680 00000100:00100000:1.0:1783074150.391975:0:66211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:1.0:1783074150.391996:0:66211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071680:12345-192.168.204.26@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783074150.392057:0:66211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071680:12345-192.168.204.26@tcp:900:mount.lustre.0 Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074150.392069:0:66211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1783074150.392167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074150.392228:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074150.392261:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071424 00000100:00100000:0.0:1783074150.392265:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071424 00000100:00100000:0.0:1783074150.392361:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071552 00000100:00100000:0.0:1783074150.392365:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071552 00000100:00100000:0.0:1783074150.392383:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4917 00000100:00100000:0.0:1783074150.392388:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1869685708071424:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783074150.392413:0:17659:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 2989 last 0 00000020:00000080:0.0:1783074150.392439:0:17659:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016dfc87 00002000:00100000:0.0:1783074150.392452:0:17659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b/ffff9524fb548800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783074150.392482:0:17659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783074150.392549:0:17659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783074150.392575:0:17659:0:(import.c:65:import_set_state_nolock()) ffff9524fb54e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074150.392611:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708071424:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 221us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074150.392619:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4917 00000100:00100000:0.0:1783074150.392635:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4918 00000100:00100000:0.0:1783074150.392639:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1869685708071552:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783074150.392656:0:17659:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 2989 last 0 00000020:00000080:0.0:1783074150.392673:0:17659:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016dfc8e 00002000:00100000:0.0:1783074150.392679:0:17659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b/ffff9524fb548000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783074150.392691:0:17659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783074150.392723:0:17659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074150.392736:0:17659:0:(import.c:65:import_set_state_nolock()) ffff9524fb549000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074150.392774:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708071552:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 133us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074150.392780:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4918 00000100:00100000:2.0:1783074150.394415:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074150.394952:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071808 00000100:00100000:0.0:1783074150.394963:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071808 00000100:00100000:0.0:1783074150.395011:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 230 00000100:00100000:0.0:1783074150.395019:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071808:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783074150.395100:0:80537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783074150.395176:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70857:x1869685708071808:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 156us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074150.395198:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 230 00010000:00010000:0.0:1783074151.022898:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074151.806638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074151.806693:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708071936 00000100:00100000:1.0:1783074151.806704:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708071936 00000100:00100000:1.0:1783074151.806763:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1245 00000100:00100000:1.0:1783074151.806775:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708071936:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074151.806804:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074151.806831:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ee00/0x5fb609b3016dfc95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1c4 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074151.806923:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfc9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074151.806940:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfc9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074151.806954:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfc9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074151.806996:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783074151.807000:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074151.807018:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfc9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074151.807042:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ee00/0x5fb609b3016dfc95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 8 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074151.807060:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfc9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074151.807070:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4575100) 00010000:00010000:1.0:1783074151.807072:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783074151.807076:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28f600, rc 0) 00000100:00100000:1.0:1783074151.807131:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70923:x1869685708071936:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 359us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074151.807139:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1245 00000100:00100000:2.0:1783074151.812522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074151.812687:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072064 00000100:00100000:0.0:1783074151.812697:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072064 00000100:00100000:0.0:1783074151.812792:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1246 00000100:00100000:0.0:1783074151.812803:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708072064:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074151.812847:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:0.0:1783074151.812918:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708072064:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 117us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074151.812926:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1246 00000100:00100000:2.0:1783074151.815433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074151.815534:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072192 00000100:00100000:0.0:1783074151.815543:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072192 00000100:00100000:0.0:1783074151.815665:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1719 00000100:00100000:0.0:1783074151.815675:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708072192:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074151.815707:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074151.815771:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708072192:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 97us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074151.815779:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1719 00000100:00080000:1.0:1783074151.815822:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074151.817445:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074151.817537:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072320 00000100:00100000:2.0:1783074151.817543:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072320 00000100:00100000:2.0:1783074151.817637:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1720 00000100:00100000:2.0:1783074151.817646:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708072320:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074151.817670:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074151.817848:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70923:x1869685708072320:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 203us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074151.817855:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1720 00000100:00080000:1.0:1783074151.818051:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074151.854523:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074151.854544:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723562240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074151.854609:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.854682:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562240 00000100:00100000:3.0:1783074151.854689:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562240 00000100:00100000:3.0:1783074151.854742:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:3.0:1783074151.854750:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723562240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783074151.854780:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074151.854828:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723562240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.854835:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00080000:3.0:1783074151.854857:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074151.854879:0:3661:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968712 gen 2 00000100:00100000:3.0:1783074151.854916:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723562240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074151.855062:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723562368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074151.855145:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074151.855580:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723562496:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.855604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074151.855621:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723563008:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.855635:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074151.855644:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723563520:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.855654:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074151.855666:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783074151.855669:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723562624:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.855679:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074151.855687:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723563136:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.855697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.855744:0:90932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562496 00000100:00100000:3.0:1783074151.855747:0:90932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562496 00000100:00100000:3.0:1783074151.855766:0:90932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783074151.855770:0:90932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723562496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.855808:0:90932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723562496:12345-0@lo:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.855815:0:90932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783074151.855841:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563008 00000100:00100000:3.0:1783074151.855844:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563008 00000100:00100000:3.0:1783074151.855865:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563520 00000100:00100000:3.0:1783074151.855866:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563520 00000100:00100000:3.0:1783074151.855876:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562624 00000100:00100000:3.0:1783074151.855878:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562624 00000100:00100000:3.0:1783074151.855886:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1783074151.855889:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723563008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.855915:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723563008:12345-0@lo:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.855918:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1783074151.855925:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1783074151.855930:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723563520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.855957:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723563520:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.855963:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1783074151.855973:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1783074151.855986:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723562624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856018:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723562624:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.856023:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:3.0:1783074151.856038:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074151.856042:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074151.856066:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723562752:0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856097:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.856115:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723563264:0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856130:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.856143:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723563776:0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856161:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.856177:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783074151.856182:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723562880:0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856200:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.856213:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723563392:0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856238:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.856270:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723563904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074151.856280:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562752 00000100:00100000:2.0:1783074151.856285:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562752 00000100:00100000:3.0:1783074151.856307:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563264 00000100:00100000:3.0:1783074151.856326:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563264 00000100:00100000:2.0:1783074151.856339:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563776 00000100:00100000:2.0:1783074151.856344:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563776 00000100:00100000:3.0:1783074151.856363:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563392 00000100:00100000:2.0:1783074151.856366:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562880 00000100:00100000:3.0:1783074151.856368:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563392 00000100:00100000:2.0:1783074151.856371:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562880 00000100:00100000:2.0:1783074151.856397:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1783074151.856400:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1783074151.856408:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723563264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074151.856416:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723562752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856454:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723563264:12345-0@lo:400:kworker.0 Request processed in 46us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074151.856469:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723562752:12345-0@lo:400:kworker.0 Request processed in 56us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.856472:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:2.0:1783074151.856482:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1783074151.856500:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1783074151.856501:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1783074151.856510:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723563392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074151.856514:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723563776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.856552:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723563392:12345-0@lo:400:kworker.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074151.856559:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723563776:12345-0@lo:400:kworker.0 Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.856560:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1783074151.856570:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1783074151.856588:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1783074151.856596:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723562880:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074151.856606:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783074151.856611:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074151.856614:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074151.856618:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074151.856628:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723562880:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.856634:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1783074151.856649:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074151.856660:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723564032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074151.856693:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074151.856723:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564032 00000100:00100000:3.0:1783074151.856727:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564032 00000100:00100000:3.0:1783074151.856750:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:3.0:1783074151.856755:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723564032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074151.856766:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074151.856794:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723564032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.856800:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00080000:3.0:1783074151.856821:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074151.857074:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723562368 00000100:00100000:3.0:1783074151.857078:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723562368 00000100:00100000:3.0:1783074151.857103:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563136 00000100:00100000:3.0:1783074151.857105:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563136 00000100:00100000:3.0:1783074151.857121:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:3.0:1783074151.857126:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723562368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783074151.857154:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:3.0:1783074151.857193:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723562368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.857199:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000100:00100000:3.0:1783074151.857212:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:3.0:1783074151.857218:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723563136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074151.857263:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723563136:12345-0@lo:400:kworker.0 Request processed in 34us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074151.857270:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00000100:00100000:1.0:1783074151.857383:0:3658:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116997 gen 3 00000004:00080000:1.0:1783074151.857389:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116997 committed transno 115964116997 00000100:00100000:1.0:1783074151.857428:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723563136:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.857436:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723563648:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.857463:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074151.857484:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723562496:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.857496:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723563008:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.857506:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723563520:0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.857574:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723562624:0@lo:400:kworker.0 00000100:00100000:0.0:1783074151.857588:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074151.857621:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723562752:0@lo:400:kworker.0 00000100:00100000:0.0:1783074151.857629:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723563264:0@lo:400:kworker.0 00000100:00100000:0.0:1783074151.857635:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723563776:0@lo:400:kworker.0 00000100:00100000:0.0:1783074151.857648:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723562880:0@lo:400:kworker.0 00000100:00100000:0.0:1783074151.857662:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723563392:0@lo:400:kworker.0 00000100:00100000:2.0:1783074151.857871:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563904 00000100:00100000:2.0:1783074151.857876:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563904 00000100:00100000:3.0:1783074151.857885:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723562368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074151.857908:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:2.0:1783074151.857917:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723563904:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074151.857932:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723564032:0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1783074151.857939:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444708352 avail 1298468864 00000100:00100000:2.0:1783074151.857976:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723563904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074151.857982:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:1.0:1783074151.858005:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723563648 00000100:00100000:1.0:1783074151.858010:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723563648 00000100:00100000:1.0:1783074151.858050:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:1.0:1783074151.858056:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723563648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074151.858137:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723563648:12345-0@lo:400:kworker.0 Request processed in 80us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074151.858143:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:3.0:1783074151.858211:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723563648:0@lo:400:kworker.0 00000100:00100000:0.0:1783074151.859285:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723563904:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783074152.046462:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074152.195533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074152.195612:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072448 00000100:00100000:1.0:1783074152.195623:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072448 00000100:00080000:3.0:1783074152.195674:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783074152.195705:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1247 00000100:00100000:1.0:1783074152.195717:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708072448:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:1.0:1783074152.195739:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074152.195760:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1cb expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195819:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195834:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195844:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195854:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195859:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195863:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195913:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016dfcb8 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195918:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016dfcb8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195922:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016dfcb8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074152.195950:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016dfcb8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195961:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195966:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195970:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195974:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195980:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074152.195984:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.195991:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196003:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524f4575100) 00010000:00010000:1.0:1783074152.196011:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074152.196016:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196021:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016dfcaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196031:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196037:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196043:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196047:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ea00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074152.196050:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196185:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196193:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9524f4575000) 00010000:00010000:1.0:1783074152.196196:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074152.196199:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196204:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ea00/0x5fb609b3016dfcb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196236:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f200/0x5fb609b3016dfca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1cb expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196280:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016dfcb8 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1cb expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.196288:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524f4575c00) 00010000:00010000:1.0:1783074152.196290:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783074152.196293:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28fa00, rc 0) 00000100:00100000:1.0:1783074152.196373:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708072448:12345-192.168.204.26@tcp:101:cp.0 Request processed in 659us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074152.196381:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1247 00000100:00100000:0.0:1783074152.202331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074152.202390:0:66212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072576 00000100:00100000:1.0:1783074152.202400:0:66212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072576 00000100:00080000:2.0:1783074152.202445:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074152.202475:0:66212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:1.0:1783074152.202489:0:66212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70957:x1869685708072576:12345-192.168.204.26@tcp:900:cp.0 00000100:00100000:1.0:1783074152.202587:0:66212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70957:x1869685708072576:12345-192.168.204.26@tcp:900:cp.0 Request processed in 101us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074152.202594:0:66212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1783074152.207756:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074152.207962:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072704 00000100:00100000:3.0:1783074152.207972:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072704 00000100:00100000:3.0:1783074152.208029:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1248 00000100:00100000:3.0:1783074152.208039:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70957:x1869685708072704:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:3.0:1783074152.208073:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074152.208100:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfcbf lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1d2 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.208169:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfcc6 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.208185:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfcc6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.208208:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfcc6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074152.208265:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783074152.208269:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783074152.208334:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bca00/0x5fb609b3016dfcbf lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1d2 expref: 8 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.208351:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfcc6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1d2 expref: 7 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.208360:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:3.0:1783074152.208363:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783074152.208367:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bcc00, rc 0) 00000100:00100000:3.0:1783074152.208422:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708072704:12345-192.168.204.26@tcp:101:cp.0 Request processed in 384us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074152.208429:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1248 00000100:00100000:1.0:1783074152.211501:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074152.211566:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072832 00000100:00100000:2.0:1783074152.211576:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072832 00000100:00100000:2.0:1783074152.211654:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1249 00000100:00100000:2.0:1783074152.211665:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708072832:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:2.0:1783074152.211687:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074152.211710:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086c400/0x5fb609b3016dfccd lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1d9 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211775:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211790:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211802:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211818:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211824:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211831:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211908:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086da00/0x5fb609b3016dfce2 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.211916:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086da00/0x5fb609b3016dfce2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212080:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086da00/0x5fb609b3016dfce2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074152.212128:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1783074152.212132:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074152.212154:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086da00/0x5fb609b3016dfce2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212166:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212173:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 2/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212180:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212188:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086ce00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074152.212192:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212200:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212214:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:2.0:1783074152.212217:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074152.212222:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212228:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086ce00/0x5fb609b3016dfcd4 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212241:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212267:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212273:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212278:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074152.212281:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212288:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212296:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9524d6c55600) 00010000:00010000:2.0:1783074152.212299:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074152.212302:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212308:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086d800/0x5fb609b3016dfcdb lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212437:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086c400/0x5fb609b3016dfccd lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1d9 expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212452:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086da00/0x5fb609b3016dfce2 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1d9 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074152.212460:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:2.0:1783074152.212463:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783074152.212472:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086da00, rc 0) 00000100:00100000:2.0:1783074152.212536:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708072832:12345-192.168.204.26@tcp:101:cp.0 Request processed in 872us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074152.212543:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1249 00000100:00100000:2.0:1783074152.215555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074152.216498:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708072960 00000100:00100000:1.0:1783074152.216509:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708072960 00000100:00100000:1.0:1783074152.216578:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1250 00000100:00100000:1.0:1783074152.216590:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708072960:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:1.0:1783074152.216612:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074152.216633:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28ea00/0x5fb609b3016dfce9 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1e0 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216715:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216732:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216745:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216758:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216765:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216772:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216810:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216818:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216824:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216831:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216839:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074152.216850:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216858:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216872:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:1.0:1783074152.216876:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074152.216880:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216887:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016dfcf0 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216899:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216905:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216911:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216917:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074152.216921:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216926:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216934:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9524f4575000) 00010000:00010000:1.0:1783074152.216936:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074152.216946:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216953:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e200/0x5fb609b3016dfcf7 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.216990:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28ea00/0x5fb609b3016dfce9 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1e0 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.217002:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:1.0:1783074152.217005:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074152.217009:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28ea00/0x5fb609b3016dfce9 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1e0 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074152.217021:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28ea00, rc 0) 00000100:00100000:1.0:1783074152.217094:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708072960:12345-192.168.204.26@tcp:101:cp.0 Request processed in 507us (1550us total) trans 0 rc 301/301 00000100:00100000:1.0:1783074152.217102:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1250 00000100:00100000:2.0:1783074152.219684:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074152.219832:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073088 00000100:00100000:3.0:1783074152.219841:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073088 00000100:00100000:3.0:1783074152.219943:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1251 00000100:00100000:3.0:1783074152.219955:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708073088:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:3.0:1783074152.219974:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074152.219994:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfcfe lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1e7 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220054:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220081:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220093:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220108:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220116:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220123:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220161:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220169:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220175:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220182:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220188:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074152.220192:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220200:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220219:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:3.0:1783074152.220222:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074152.220428:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220436:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bdc00/0x5fb609b3016dfd05 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220448:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220455:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220460:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220466:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074152.220469:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220475:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220482:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9523cadc3a00) 00010000:00010000:3.0:1783074152.220485:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074152.220488:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220494:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd000/0x5fb609b3016dfd0c lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220547:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfcfe lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1e7 expref: 9 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220560:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:3.0:1783074152.220563:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074152.220568:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bd200/0x5fb609b3016dfcfe lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1e7 expref: 9 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074152.220579:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd200, rc 0) 00000100:00100000:3.0:1783074152.220642:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708073088:12345-192.168.204.26@tcp:101:cp.0 Request processed in 690us (963us total) trans 0 rc 301/301 00000100:00100000:3.0:1783074152.220650:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1251 00000100:00100000:2.0:1783074152.223950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074152.223990:0:66210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073216 00000100:00100000:0.0:1783074152.223999:0:66210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073216 00000100:00100000:0.0:1783074152.224066:0:66210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1783074152.224076:0:66210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708073216:12345-192.168.204.26@tcp:700:cp.0 00000020:02000000:0.0:1783074152.224090:0:66210:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:0.0:1783074152.230955:0:66210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:70957:x1869685708073216:12345-192.168.204.26@tcp:700:cp.0 Request processed in 6869us (7000us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074152.230981:0:66210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1783074152.878613:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723564160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074152.878690:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074152.878742:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564160 00000100:00100000:0.0:1783074152.878750:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564160 00000100:00100000:0.0:1783074152.878798:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:0.0:1783074152.878810:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723564160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074152.878837:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074152.878889:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723564160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074152.878898:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00100000:0.0:1783074152.878951:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723564160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074152.879061:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074152.879072:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723564288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074152.879099:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074152.879150:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564288 00000100:00100000:2.0:1783074152.879155:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564288 00000100:00100000:2.0:1783074152.879205:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:2.0:1783074152.879214:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723564288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074152.879241:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074152.879290:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723564288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074152.879298:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00100000:0.0:1783074152.879339:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723564288:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783074153.070455:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783074153.990450:0:91940:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783074153.990510:0:91940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.990525:0:91940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.990533:0:91940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.990541:0:91940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.990576:0:91940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783074153.990582:0:91940:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783074153.990610:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074153.990615:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783074153.990621:0:91940:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783074153.990644:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9523c32ce800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783074153.991370:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723564416:0@lo:39:umount.0 00000100:00100000:1.0:1783074153.991445:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074153.991496:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564416 00000100:00100000:2.0:1783074153.991503:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564416 00000100:00100000:2.0:1783074153.991548:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1783074153.991555:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723564416:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783074153.991579:0:66201:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df931 00000100:00080000:2.0:1783074153.991586:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524f4945800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783074153.991632:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869685723564416:12345-0@lo:39:umount.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074153.991637:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000020:00000080:2.0:1783074153.991652:0:66201:0:(genops.c:906:class_export_put()) final put ffff9524d08cc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783074153.991674:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d08cc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783074153.991712:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f4945800 for lustre-MDT0000 00010000:00010000:0.0:1783074153.992150:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074153.992160:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.992170:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074153.992174:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.992184:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074153.992193:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074153.992199:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783074153.992202:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783074153.992204:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783074153.992243:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.992250:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074153.992286:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.992294:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6e00/0x5fb609b3016df82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df835 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.992306:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074153.992308:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074153.992328:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074153.992335:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074153.992373:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783074153.992385:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723564544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074153.992410:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074153.992581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564544 00000100:00100000:0.0:1783074153.992586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564544 00000100:00100000:0.0:1783074153.992627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1783074153.992636:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723564544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074153.992650:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074153.992665:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671000/0x5fb609b3016df835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df82e expref: 24 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.992678:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074153.992716:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3660:x1869685723564544:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074153.992723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1783074153.992760:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723564544:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783074153.992868:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c32ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783074153.992885:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723564416:0@lo:39:umount.0 00000100:00080000:2.0:1783074153.992906:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074153.992911:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783074153.992915:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783074153.993993:0:91940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994012:0:91940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994019:0:91940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994025:0:91940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994092:0:91940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074153.994099:0:91940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994106:0:91940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994112:0:91940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994117:0:91940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994231:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074153.994238:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994245:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074153.994248:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994262:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074153.994268:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074153.994274:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074153.994276:0:6517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783074153.994295:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994300:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074153.994336:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994344:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6200/0x5fb609b3016df74e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df755 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994356:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074153.994359:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074153.994365:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723564672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074153.994367:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074153.994373:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994381:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074153.994388:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074153.994399:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074153.994402:0:6517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:3.0:1783074153.994417:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074153.994418:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994425:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074153.994433:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.994441:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074153.994443:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074153.994446:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074153.994482:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783074153.994490:0:91940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1783074153.994491:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723564800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074153.994497:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074153.994498:0:91940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016df858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df85f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074153.994509:0:91940:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783074153.994518:0:91940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074153.994522:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074153.994532:0:91940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994540:0:91940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994547:0:91940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074153.994555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564672 00010000:00010000:2.0:1783074153.994558:0:91940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783074153.994560:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564672 00000100:00100000:3.0:1783074153.994563:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564800 00010000:00010000:2.0:1783074153.994564:0:91940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074153.994570:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564800 00010000:00010000:2.0:1783074153.994573:0:91940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994580:0:91940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074153.994587:0:91940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074153.994596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00010000:00010000:2.0:1783074153.994598:0:91940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783074153.994601:0:91940:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1783074153.994604:0:91940:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1783074153.994604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723564672:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074153.994611:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00010000:00010000:1.0:1783074153.994615:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783074153.994622:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723564800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074153.994629:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670c00/0x5fb609b3016df755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df74e expref: 24 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074153.994634:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:2.0:1783074153.994636:0:91940:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783074153.994640:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:1.0:1783074153.994642:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1783074153.994647:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1783074153.994652:0:91940:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1783074153.994655:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016df85f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df858 expref: 23 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074153.994672:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074153.994677:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3658:x1869685723564672:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074153.994684:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1783074153.994713:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3658:x1869685723564800:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074153.994719:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1783074153.994780:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723564800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074153.994789:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723564672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074153.994859:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074153.994865:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.994872:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074153.994875:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.994883:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074153.994889:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074153.994894:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783074153.994897:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783074153.994899:0:8460:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783074153.994915:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.994929:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074153.994973:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723564928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074153.994998:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074153.995047:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.995055:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc7800/0x5fb609b3016df820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df827 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.995066:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074153.995070:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.995075:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074153.995078:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.995085:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074153.995091:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074153.995096:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783074153.995098:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783074153.995100:0:8460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783074153.995115:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.995121:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783074153.995346:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723564928 00000100:00100000:1.0:1783074153.995351:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723564928 00000100:00100000:1.0:1783074153.995379:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1783074153.995386:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3660:x1869685723564928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074153.995400:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074153.995409:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670200/0x5fb609b3016df827 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df820 expref: 21 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.995420:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074153.995444:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3660:x1869685723564928:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074153.995451:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1783074153.995465:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723564928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074153.995479:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1783074153.995484:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074153.995486:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723565056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074153.995512:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074153.995555:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565056 00000100:00100000:1.0:1783074153.995560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565056 00000100:00100000:1.0:1783074153.995593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00010000:00010000:0.0:1783074153.995598:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074153.995602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3660:x1869685723565056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074153.995616:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074153.995628:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7600/0x5fb609b3016df747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df740 expref: 20 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074153.995628:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016df740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016df747 expref: -99 pid: 90918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074153.995650:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074153.995654:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074153.995658:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074153.995660:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074153.995677:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3660:x1869685723565056:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074153.995683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1783074153.995716:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723565056:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1783074153.997271:0:91940:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00100000:1.0:1783074154.000083:0:90919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:1.0:1783074154.000095:0:90919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00080000:1.0:1783074154.000103:0:90919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000020:00000080:1.0:1783074154.000108:0:90919:0:(genops.c:906:class_export_put()) final put ffff9524c3568000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:2.0:1783074154.000165:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c3568000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-MDT0000 00000020:00000080:2.0:1783074154.000241:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c6022000 for lustre-MDT0000 00000020:00000080:3.0:1783074154.000242:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/12 00000020:00080000:3.0:1783074154.000253:0:91940:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524f7813800 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 192.168.204.26@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783074154.000260:0:91940:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c6e29000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783074154.000264:0:91940:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524d08ce000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783074154.000269:0:91940:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c6e2d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783074154.000272:0:91940:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524c356a800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116997 stale:0 00000020:00080000:3.0:1783074154.000277:0:91940:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9524fa860000) has exports, disconnecting them 00000020:00080000:3.0:1783074154.000290:0:91940:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.26@tcp (ffff9524f7813800), last request at 1783074152 00000020:00000080:3.0:1783074154.000297:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfc79 00000020:00010000:3.0:1783074154.000306:0:91940:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524f7813800: total 0 00000100:00080000:3.0:1783074154.000332:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524f7812000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783074154.000354:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524f7813800: total 0 00000020:00080000:3.0:1783074154.000356:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524f7813800): rc 0 00010000:00010000:1.0:1783074154.000360:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783074154.000363:0:91940:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c6e29000), last request at 1783074141 00000020:00000080:3.0:1783074154.000368:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df92a 00000100:00080000:3.0:1783074154.000371:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524c6e2c800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783074154.000394:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c6e29000): rc 0 00000020:00000080:3.0:1783074154.000396:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c6e29000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1783074154.000408:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524f7813800, canceled 0 locks, left on hash table 2. 00000020:00080000:3.0:1783074154.000409:0:91940:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524d08ce000), last request at 1783074151 00000020:00000080:3.0:1783074154.000413:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df923 00000100:00080000:3.0:1783074154.000416:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524d08ce800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783074154.000433:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6e29000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1783074154.000461:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016dfc9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 3 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783074154.000468:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c6e2c800 for lustre-MDT0000 00000020:00080000:3.0:1783074154.000484:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524d08ce000): rc 0 00000020:00000080:3.0:1783074154.000486:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524d08ce000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1783074154.000493:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016dfcb8 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1cb expref: 2 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783074154.000497:0:91940:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c6e2d800), last request at 1783074151 00000020:00000080:3.0:1783074154.000503:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df91c 00000100:00080000:3.0:1783074154.000514:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524c6e2d000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783074154.000526:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d08ce000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074154.000554:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d08ce800 for lustre-MDT0000 00010000:00010000:1.0:1783074154.000566:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524f7813800, canceled 2 locks, left on hash table 0. 00000020:00080000:3.0:1783074154.000582:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c6e2d800): rc 0 00000020:00000080:3.0:1783074154.000585:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c6e2d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783074154.000593:0:91940:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524c356a800), last request at 1783074136 00000020:00000080:3.0:1783074154.000597:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7a2 00000100:00080000:3.0:1783074154.000604:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524f08dd000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783074154.000612:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6e2d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074154.000639:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c6e2d000 for lustre-MDT0000 00000020:00080000:3.0:1783074154.000649:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c356a800): rc 0 00000020:00000080:3.0:1783074154.000651:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c356a800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1783074154.000661:0:91940:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd3bc86c3ae0 00000020:00000080:3.0:1783074154.000673:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c356a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783074154.000695:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f08dd000 for lustre-MDT0000 00000100:00080000:3.0:1783074154.000713:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783074154.000717:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1783074154.003090:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074154.003131:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074154.003266:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074154.003908:0:91940:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783074154.003937:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524c809e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783074154.003996:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723565184:0@lo:39:umount.0 00000100:00100000:0.0:1783074154.004066:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074154.004117:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565184 00000100:00100000:2.0:1783074154.004125:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565184 00000100:00100000:2.0:1783074154.004181:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:2.0:1783074154.004190:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723565184:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783074154.004233:0:26189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7e1 00000100:00080000:2.0:1783074154.004239:0:26189:0:(import.c:65:import_set_state_nolock()) ffff9524c4403800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783074154.004258:0:26189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411446 00010000:00010000:0.0:1783074154.004267:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074154.004401:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3657:x1869685723565184:12345-0@lo:39:umount.0 Request processed in 211us (334us total) trans 77309411447 rc 0/0 00000100:00100000:2.0:1783074154.004409:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00080000:0.0:1783074154.004570:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c809e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783074154.004578:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723565184:0@lo:39:umount.0 00000100:00080000:0.0:1783074154.004634:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783074154.004637:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968716 gen 3 00000004:00080000:0.0:1783074154.004644:0:91940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783074154.004984:0:91940:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783074154.004993:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9523c4e78000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783074154.005030:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723565312:0@lo:9:umount.0 00000100:00100000:3.0:1783074154.005058:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074154.005111:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783074154.005113:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968712 gen 3 00000004:00080000:0.0:1783074154.005121:0:91940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074154.005525:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565312 00000100:00100000:3.0:1783074154.005530:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565312 00000100:00100000:3.0:1783074154.005566:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:3.0:1783074154.005572:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723565312:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783074154.005587:0:26174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7f6 00000100:00080000:3.0:1783074154.005593:0:26174:0:(import.c:65:import_set_state_nolock()) ffff9524c5fdc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783074154.005623:0:26174:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968716 00000100:00100000:3.0:1783074154.005710:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723565312:12345-0@lo:9:umount.0 Request processed in 138us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074154.005716:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00080000:3.0:1783074154.005736:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783074154.005743:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074154.005757:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4e78000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783074154.005761:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783074154.005762:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783074154.005765:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723565312:0@lo:9:umount.0 00000100:00080000:0.0:1783074154.005867:0:91940:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783074154.005877:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524fc204000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783074154.005921:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524fa860000) has no exports 00000100:00100000:3.0:1783074154.005974:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723565440:0@lo:9:umount.0 00000100:00100000:3.0:1783074154.005997:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074154.006077:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565440 00000100:00100000:0.0:1783074154.006081:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565440 00000100:00100000:0.0:1783074154.006111:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00000100:00100000:0.0:1783074154.006125:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723565440:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783074154.006138:0:26177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df80b 00000100:00080000:0.0:1783074154.006143:0:26177:0:(import.c:65:import_set_state_nolock()) ffff9523c6942800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1783074154.006176:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1783074154.006476:0:26177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968712 00000100:00100000:0.0:1783074154.006572:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723565440:12345-0@lo:9:umount.0 Request processed in 447us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074154.006578:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00010000:00010000:3.0:1783074154.006620:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783074154.006669:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524fa860000) has no exports 00000100:00080000:2.0:1783074154.006766:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524fc204000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783074154.006781:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783074154.006782:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783074154.006785:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723565440:0@lo:9:umount.0 00000020:00000080:1.0:1783074154.053746:0:6517:0:(genops.c:906:class_export_put()) final put ffff9524f7813800/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000020:00000080:0.0:1783074154.053858:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7813800/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b for lustre-MDT0000 00000020:00000080:0.0:1783074154.054018:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f7812000 for lustre-MDT0000 00010000:00010000:0.0:1783074154.054030:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074154.054032:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074154.054035:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783074154.072485:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7b7 00000020:00000080:3.0:1783074154.072499:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524f7804800/lustre-QMT0000_UUID 00000020:01000000:3.0:1783074154.072512:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783074154.072572:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074154.072584:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783074154.072588:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9524fb4db380) has no exports 00000020:00000080:0.0:1783074154.072603:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7804800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783074154.072846:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7b0 00000020:00000080:2.0:1783074154.072852:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524fc203000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074154.072887:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc203000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783074154.072915:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074154.072923:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783074154.072926:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c86b1800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783074154.072928:0:91940:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c86b1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783074154.072935:0:91940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783074154.073079:0:91940:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c6b0e2a0 - data ffff9523c1ab5000/ffff9524faa44800 00000020:01000000:2.0:1783074154.073489:0:91940:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c6b0e180 - data ffff9524dfb7a5e8/ffff9524e40a3800 00010000:00010000:1.0:1783074154.094503:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074154.107003:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074154.107012:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074154.107027:0:91940:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9524fc496d80 x1869685723565184/t77309411447(77309411447) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074164 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074154.107057:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783074154.108393:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783074154.108397:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968716 gen 4 00000004:00080000:0.0:1783074154.108570:0:91940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074154.108573:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783074154.108817:0:90939:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783074154.108823:0:90939:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:1.0:1783074154.108835:0:90939:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:0.0:1783074154.109394:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783074154.109398:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968712 gen 4 00000004:00080000:0.0:1783074154.109411:0:91940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074154.109413:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783074154.109993:0:90941:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783074154.109997:0:90941:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:2.0:1783074154.110008:0:90941:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1783074154.111525:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df76a 00000020:00000080:0.0:1783074154.111534:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c4e7e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074154.112045:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df77f 00000020:00000080:0.0:1783074154.112049:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524ee2c0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074154.112130:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783074154.112191:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783074154.112196:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074154.112204:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783074154.112216:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9524fa863380) has no exports 00000020:00000080:2.0:1783074154.112240:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1783074154.112435:0:91940:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783074154.112444:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df804 00000020:00000080:0.0:1783074154.112448:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c316d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783074154.112458:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783074154.112462:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074154.112466:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783074154.112470:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783074154.112473:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9523c2284d40) has no exports 00000020:00000080:0.0:1783074154.112478:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7fd 00000020:00000080:0.0:1783074154.112481:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c4404800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074154.112504:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4404800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783074154.112909:0:91940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783074154.112914:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783074154.112919:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968712 gen 5 00000004:00080000:0.0:1783074154.112924:0:91940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074154.112926:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074154.112974:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074154.112982:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074154.112987:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7e8 00000020:00000080:0.0:1783074154.112991:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c3169000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783074154.112994:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783074154.112996:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074154.112999:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783074154.113001:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9524fb4dcd40) has no exports 00000020:00000080:0.0:1783074154.113004:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7da 00000020:00000080:0.0:1783074154.113005:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c4e79800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074154.113087:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fc204000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783074154.113093:0:44310:0:(genops.c:906:class_export_put()) final put ffff9523c316d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074154.113094:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783074154.113097:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074154.113195:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c3169000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783074154.113200:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e79800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783074154.113657:0:91940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783074154.113661:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783074154.113671:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968716 gen 5 00000004:00080000:0.0:1783074154.113675:0:91940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783074154.113676:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074154.113700:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074154.113707:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783074154.113715:0:91940:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783074154.113719:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7cc 00000020:00000080:0.0:1783074154.113723:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c3168000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783074154.113726:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783074154.113729:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074154.113733:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783074154.113735:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9524fb4d8000) has no exports 00000020:00000080:0.0:1783074154.113739:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df7c5 00000020:00000080:0.0:1783074154.113742:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524f41a8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074154.114161:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c4e78000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783074154.114168:0:44310:0:(genops.c:906:class_export_put()) final put ffff9523c316f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074154.114171:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783074154.114177:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074154.114236:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c3168000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783074154.114242:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f41a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783074154.116411:0:91940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1783074154.116419:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783074154.116423:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783074154.116430:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074154.116867:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074154.116882:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074154.116910:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074154.116915:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074154.116920:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c86a8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074154.116924:0:91940:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c86a8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783074154.116931:0:91940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074154.117031:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df786 00000020:00000080:1.0:1783074154.117038:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524ee2c5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783074154.117075:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c809e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783074154.117082:0:44310:0:(genops.c:906:class_export_put()) final put ffff9523c4e78800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074154.117084:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e78800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1783074154.117089:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783074154.117194:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783074154.117199:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074154.117204:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783074154.117217:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9524fa864d40) has no exports 00000020:00000080:1.0:1783074154.117240:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074154.117256:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783074154.117261:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df78d 00000020:00000080:1.0:1783074154.117266:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524ee2c2000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783074154.117274:0:91940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524debee000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783074154.117277:0:91940:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524debee000 3 00000020:01000004:1.0:1783074154.117280:0:91940:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524debee000 from lustre-MDT0000 00000020:00000080:1.0:1783074154.117302:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074154.117306:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783074154.117333:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c4e7a800/lustre-MDT0000_UUID 00000020:00000080:1.0:1783074154.117336:0:91940:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783074154.117344:0:91940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1783074154.117409:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783074154.117418:0:44310:0:(genops.c:906:class_export_put()) final put ffff9523c4e7b800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783074154.117425:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783074154.117429:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783074154.117460:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783074154.117509:0:91940:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783074154.117514:0:91940:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783074154.117517:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783074154.117520:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074154.117523:0:91940:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783074154.117532:0:91940:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524f7811800 f1623620-a4b0-4769-84e0-0d08c968afe8 192.168.204.26@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074154.117538:0:91940:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9524c4401000 522b6a34-04f4-4017-ab45-61a21d19bfef 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074154.117543:0:91940:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9524fa8619c0) has exports, disconnecting them 00000020:00080000:1.0:1783074154.117547:0:91940:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.26@tcp (ffff9524f7811800), last request at 1783074150 00000020:00000080:1.0:1783074154.117561:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfc56 00000020:00010000:1.0:1783074154.117566:0:91940:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524f7811800: total 0 00000100:00080000:1.0:1783074154.117570:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524f7814800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074154.117593:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9524f7811800): rc 0 00000020:00080000:1.0:1783074154.117597:0:91940:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9524c4401000), last request at 1783074136 00000020:00000080:1.0:1783074154.117604:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df732 00000020:00010000:1.0:1783074154.117607:0:91940:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9524c4401000: total 0 00000100:00080000:1.0:1783074154.117609:0:91940:0:(import.c:65:import_set_state_nolock()) ffff9524c4405000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783074154.117662:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c4401000): rc 0 00000020:00080000:1.0:1783074154.117668:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9524fa8619c0) has no exports 00000020:00010000:2.0:1783074154.117745:0:46245:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524f7811800: total 0 00000020:00010000:3.0:1783074154.117748:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9524c4401000: total 0 00010000:00010000:2.0:1783074154.117791:0:46245:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524f7811800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783074154.117809:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9524c4401000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783074154.117833:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28f800/0x5fb609b3016dfc5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b154 expref: 5 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.117835:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6400/0x5fb609b3016df86d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df866 expref: 14 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.117867:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df39c400/0x5fb609b3016df8eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df8e4 expref: 13 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074154.117871:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bc200/0x5fb609b3016dfc72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b193 expref: 4 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.117888:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158000/0x5fb609b3016df8dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df8d6 expref: 12 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074154.117895:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bde00/0x5fb609b3016dfc64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b15b expref: 3 pid: 90925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.117909:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299200/0x5fb609b3016df87b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df874 expref: 11 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074154.117916:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c000/0x5fb609b3016dfc6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b18c expref: 2 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.117927:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df39c000/0x5fb609b3016df8f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df8f2 expref: 10 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074154.117933:0:46245:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524f7811800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1783074154.117943:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670600/0x5fb609b3016df889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df882 expref: 9 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.117959:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df39d800/0x5fb609b3016df907 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df900 expref: 8 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074154.117961:0:46245:0:(genops.c:906:class_export_put()) final put ffff9524f7811800/f1623620-a4b0-4769-84e0-0d08c968afe8 00010000:00010000:2.0:1783074154.117972:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074154.117975:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074154.117979:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074154.117989:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298400/0x5fb609b3016df897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df890 expref: 7 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.118006:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df39d000/0x5fb609b3016df915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df90e expref: 6 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074154.118016:0:90924:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9524df33aa00:90924] 0 exiting: rc = 1 00010000:00010000:3.0:1783074154.118020:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158400/0x5fb609b3016df8a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df89e expref: 5 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.118034:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6000/0x5fb609b3016df8b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df8ac expref: 4 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.118046:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670e00/0x5fb609b3016df8c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df8ba expref: 3 pid: 90924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.118059:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6600/0x5fb609b3016df8cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016df8c8 expref: 2 pid: 90926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074154.118070:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9524c4401000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783074154.118094:0:6518:0:(genops.c:906:class_export_put()) final put ffff9524c4401000/522b6a34-04f4-4017-ab45-61a21d19bfef 00010000:00010000:3.0:1783074154.118101:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074154.118104:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074154.118107:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074154.118125:0:90926:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9524f4949c00:90926] 2 exiting: rc = 0 00000100:00100000:3.0:1783074154.118158:0:90925:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9524f4948e00:90925] 1 exiting: rc = 0 00000020:00000080:1.0:1783074154.118230:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7811800/f1623620-a4b0-4769-84e0-0d08c968afe8 for MGS 00000020:00000080:1.0:1783074154.118258:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c4401000/522b6a34-04f4-4017-ab45-61a21d19bfef for MGS 00000020:00000080:1.0:1783074154.118297:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f7814800 for MGS 00000020:00000080:1.0:1783074154.118302:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c4405000 for MGS 00000100:00100000:3.0:1783074154.122372:0:90932:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9524e6b00200:90932] 3 exiting: rc = 0 00000100:00100000:2.0:1783074154.126398:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126411:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126418:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126424:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126429:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126435:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126440:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126466:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126472:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126477:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126482:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126487:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126492:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126496:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126501:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126507:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126512:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126518:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126525:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126530:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126536:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126541:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126546:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126552:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126558:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126564:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126570:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126575:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126580:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126585:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126590:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126596:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126601:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126607:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126612:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126617:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126622:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126629:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126637:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126643:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126648:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126655:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126669:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126674:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126680:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126685:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126690:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126695:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126701:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126706:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126712:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126718:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126723:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126728:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126733:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126738:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126744:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126749:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126754:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126760:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126766:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126772:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126777:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783074154.126782:0:91940:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783074154.128512:0:91940:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524f4691660 - data ffff9524df8b36c0/ffff9524e41cfc00 00000020:01000000:2.0:1783074154.128637:0:91940:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524fb7566c0 - data ffff9524d37a2ca8/ffff9523c6af0800 00000020:00000080:2.0:1783074154.129052:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df708 00000020:00000080:2.0:1783074154.129060:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524fb549800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783074154.129084:0:91940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524debee000 from MGS, refs=2 00000020:01000004:2.0:1783074154.129087:0:91940:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524debee000 2 00000020:01000004:2.0:1783074154.129090:0:91940:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524debee000 from MGS 00000020:00000080:2.0:1783074154.129111:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074154.129119:0:91940:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783074154.129121:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524fb54c000/MGS 00000020:00000080:2.0:1783074154.129124:0:91940:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54c000/MGS for MGS 00000020:01000000:2.0:1783074154.129130:0:91940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783074154.129204:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783074154.129221:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074154.129230:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783074154.129236:0:91940:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9524c6023000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074154.129243:0:91940:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9523c338b380) has exports, disconnecting them 00000020:00080000:2.0:1783074154.129247:0:91940:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9524c6023000), last request at 1783074136 00000020:00000080:2.0:1783074154.129252:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df843 00000020:00080000:2.0:1783074154.129261:0:91940:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c6023000): rc 0 00000020:00000080:2.0:1783074154.129265:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c6023000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783074154.130220:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb549800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783074154.130231:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6023000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783074154.143373:0:91940:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783074154.143382:0:91940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074154.143387:0:91940:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074154.143395:0:91940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074154.143487:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c32ce800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783074154.143607:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074154.143620:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783074154.143626:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524c6026800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783074154.143630:0:91940:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6026800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783074154.143639:0:91940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783074154.143714:0:91940:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524debee000 1 00000020:00000080:1.0:1783074154.143721:0:91940:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016df6fa 00000020:00000080:1.0:1783074154.143727:0:91940:0:(genops.c:906:class_export_put()) final put ffff9524fb54b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783074154.143746:0:91940:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783074154.143751:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074154.143756:0:91940:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783074154.143760:0:91940:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9524fb4d99c0) has no exports 00000020:00000080:0.0:1783074154.143827:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb54b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783074154.179550:0:91940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074154.179562:0:91940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783074154.179569:0:91940:0:(genops.c:906:class_export_put()) final put ffff9523c16e5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074154.179573:0:91940:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c16e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783074154.179583:0:91940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783074154.179756:0:91940:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524debea000 00000020:02000400:1.0:1783074154.179819:0:91940:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783074155.119155:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783074155.503650:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708073344 offset 0 length 224: 4 00000100:00100000:2.0:1783074155.503694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074155.503730:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074155.503765:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074155.503870:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073600 00000100:00100000:1.0:1783074155.503873:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073472 00000100:00100000:1.0:1783074155.503881:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073472 00000100:00100000:0.0:1783074155.503882:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073600 00000100:00100000:1.0:1783074155.503934:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 837 00000100:00100000:0.0:1783074155.503944:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1253 00000100:00100000:1.0:1783074155.503951:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2402:x1869685708073600:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074155.503955:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869685708073472:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:0.0:1783074155.503967:0:66200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:3.0:1783074155.504004:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073856 00000100:00100000:3.0:1783074155.504010:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073856 00000100:00100000:0.0:1783074155.504033:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869685708073472:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (301us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074155.504041:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1253 00000100:00100000:3.0:1783074155.504077:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2153 00000100:00100000:3.0:1783074155.504088:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2402:x1869685708073856:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074155.504133:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2402:x1869685708073600:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 189us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074155.504141:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 837 00000100:00080000:1.0:1783074155.504197:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074155.504202:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074155.504385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074155.504432:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073728 00000100:00100000:1.0:1783074155.504437:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073728 00000100:00100000:1.0:1783074155.504474:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2154 00000100:00100000:1.0:1783074155.504481:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2403:x1869685708073728:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074155.504512:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2403:x1869685708073728:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074155.504519:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2154 00000100:00080000:1.0:1783074155.504536:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074155.506416:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2402:x1869685708073856:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 2323us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074155.506429:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2153 00000100:00100000:0.0:1783074155.506520:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074155.506699:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073984 00000100:00100000:1.0:1783074155.506708:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073984 00000100:00100000:1.0:1783074155.506752:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1254 00000100:00100000:1.0:1783074155.506759:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869685708073984:12345-192.168.204.26@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1783074155.506782:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074155.506836:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869685708073984:12345-192.168.204.26@tcp:38:ptlrpcd_00_01.0 Request processed in 76us (317us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074155.506843:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1254 00000001:00100000:0.0:1783074155.954598:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074155.954607:0:9524:0:(genops.c:906:class_export_put()) final put ffff9523c6940800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783074155.954640:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:0.0:1783074155.954645:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:0.0:1783074155.954647:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524ee2c0800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00100000:3.0:1783074155.954866:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783074155.954877:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411447 is committed 00000020:00000080:3.0:1783074155.954880:0:75594:0:(genops.c:906:class_export_put()) final put ffff9524f7803000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783074155.954886:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:3.0:1783074155.954891:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000001:00080000:3.0:1783074155.954896:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411446 is committed 00000020:00000080:3.0:1783074155.954904:0:75594:0:(genops.c:906:class_export_put()) final put ffff9524fc252000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00080000:3.0:1783074155.954910:0:75594:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9523c456ba80 refcount 2 committed 0 result 0 batchid 73014444082 00000020:00080000:3.0:1783074155.954914:0:75594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524c352dc00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9523c456bcc0 00000020:00080000:3.0:1783074155.954918:0:75594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].1 00000020:00080000:3.0:1783074155.954921:0:75594:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524c6ae6c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9523c5731c00 00000020:00080000:3.0:1783074155.954924:0:75594:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].1 00000020:00080000:2.0:1783074155.955035:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444082 committed batchid 68719476742 00000020:00000080:1.0:1783074155.955050:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6940800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00080000:2.0:1783074155.955096:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 68719476742 00000020:00000080:1.0:1783074155.955112:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c0800/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0001 00000020:00000080:1.0:1783074155.955133:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7803000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783074155.955215:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc252000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-MDT0001 00000020:00000080:1.0:1783074155.955304:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6942800 for lustre-OST0001 00000020:00000080:1.0:1783074155.955341:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c4800 for lustre-OST0001 00000020:00000080:1.0:1783074155.955349:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c4403800 for lustre-MDT0001 00000020:00000080:1.0:1783074155.955363:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c5fd9800 for lustre-MDT0001 00000001:00100000:2.0:1783074155.955581:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074155.955585:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524d2470000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783074155.955601:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:2.0:1783074155.955606:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:2.0:1783074155.955608:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524d2ca4000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff 00000020:00000080:1.0:1783074155.955663:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2470000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783074155.955699:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca4000/0510a7c0-d9c1-4de9-a6c3-ede973deaaff for lustre-OST0000 00000020:00000080:1.0:1783074155.955723:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c5fdc800 for lustre-OST0000 00000020:00000080:1.0:1783074155.955726:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c5800 for lustre-OST0000 00010000:00010000:1.0:1783074156.143226:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074156.974533:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723565568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074156.974608:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074156.974698:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723565696:0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.974711:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565568 00000100:00100000:2.0:1783074156.974720:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565568 00000400:00000100:3.0:1783074156.974725:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723565696 offset 0 length 224: 4 00000100:00100000:2.0:1783074156.974776:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:2.0:1783074156.974784:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1869685723565568:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783074156.974793:0:8453:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783074156.974866:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1869685723565568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (255us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074156.974878:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:02020000:3.0:1783074156.974914:0:3658:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1783074156.974920:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783074156.974926:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783074156.974930:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783074156.974935:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074156.974938:0:3658:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2980 00000100:00080000:3.0:1783074156.974945:0:3658:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074156.974969:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc495880 x1869685723565824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074156.975023:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723565824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783074156.975048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074156.975102:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565824 00000100:00100000:0.0:1783074156.975106:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565824 00000100:00100000:0.0:1783074156.975128:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:0.0:1783074156.975133:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723565824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783074156.975151:0:23954:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074156.975258:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723565824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 124us (209us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074156.975265:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00080000:2.0:1783074156.975411:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074156.975416:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074156.975419:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723565824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783074156.976230:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723566336:0@lo:400:kworker.0 00000100:00100000:1.0:1783074156.976261:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074156.976282:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783074156.976288:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723566208:0@lo:400:kworker.0 00000100:00100000:1.0:1783074156.976307:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074156.976339:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723566720:0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.976348:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723565952:0@lo:400:kworker.0 00000100:00100000:1.0:1783074156.976365:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074156.976377:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723566080:0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.976393:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074156.976416:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723566464:0@lo:400:kworker.0 00000100:00100000:0.0:1783074156.976422:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074156.976440:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074156.978379:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566336 00000100:00100000:1.0:1783074156.978389:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566336 00000100:00100000:2.0:1783074156.978401:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566208 00000100:00100000:0.0:1783074156.978406:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723566592:0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.978407:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566208 00000100:00100000:2.0:1783074156.978434:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566720 00000100:00100000:2.0:1783074156.978437:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566720 00000100:00100000:1.0:1783074156.978440:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565952 00000100:00100000:1.0:1783074156.978445:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565952 00000100:00100000:2.0:1783074156.978452:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566080 00000100:00100000:0.0:1783074156.978452:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074156.978457:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566080 00000100:00100000:1.0:1783074156.978468:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1783074156.978482:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723566336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.978486:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1783074156.978496:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723566080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074156.978500:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566464 00000100:00100000:0.0:1783074156.978506:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566464 00000100:00100000:0.0:1783074156.978540:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566592 00000100:00100000:0.0:1783074156.978543:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566592 00000100:00100000:1.0:1783074156.978551:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723566336:12345-0@lo:400:kworker.0 Request processed in 72us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074156.978560:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1783074156.978568:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723566080:12345-0@lo:400:kworker.0 Request processed in 72us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074156.978575:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1783074156.978579:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1783074156.978588:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1783074156.978589:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723566464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074156.978597:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1869685723566208:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783074156.978616:0:66202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783074156.978619:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1783074156.978627:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1869685723566720:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783074156.978633:0:66201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074156.978640:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723566464:12345-0@lo:400:kworker.0 Request processed in 56us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074156.978650:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1783074156.978653:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1869685723566208:12345-0@lo:400:kworker.0 Request processed in 56us (2344us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783074156.978664:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1783074156.978681:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:1.0:1783074156.978687:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1783074156.978690:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1869685723566720:12345-0@lo:400:kworker.0 Request processed in 61us (2325us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074156.978694:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723566592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074156.978698:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3660:x1869685723565952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.978708:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000020:00080000:1.0:1783074156.978713:0:66202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783074156.978751:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723566592:12345-0@lo:400:kworker.0 Request processed in 60us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074156.978756:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3660:x1869685723565952:12345-0@lo:400:kworker.0 Request processed in 57us (2360us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074156.978758:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723566464:0@lo:400:kworker.0 00000100:00100000:0.0:1783074156.978770:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:1.0:1783074156.978787:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00080000:2.0:1783074156.978794:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783074156.978799:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783074156.978804:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783074156.978809:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074156.978811:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074156.978815:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2980 00000100:00080000:1.0:1783074156.978817:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074156.978822:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074156.978824:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074156.978829:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723566080:0@lo:400:kworker.0 00000100:00100000:0.0:1783074156.978850:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723566592:0@lo:400:kworker.0 00000100:00100000:2.0:1783074156.978851:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6cf5500 x1869685723566848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074156.978854:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783074156.978862:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783074156.978869:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783074156.978874:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074156.978878:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2980 00000100:00080000:1.0:1783074156.978882:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074156.978885:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723565952:0@lo:400:kworker.0 00000100:00100000:0.0:1783074156.978898:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723566848:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783074156.978902:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf4a80 x1869685723566976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074156.978922:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723566208:0@lo:400:kworker.0 00000100:00080000:1.0:1783074156.979001:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783074156.979004:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783074156.979007:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783074156.979013:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074156.979020:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074156.979025:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2980 00000100:00080000:1.0:1783074156.979029:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074156.979041:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf4000 x1869685723567104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074156.979051:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723566720:0@lo:400:kworker.0 00000100:00100000:1.0:1783074156.979082:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723566336:0@lo:400:kworker.0 00000100:00100000:0.0:1783074156.979089:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723566976:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783074156.979117:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074156.979186:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723567104:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783074156.979207:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074156.979224:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566848 00000100:00100000:3.0:1783074156.979236:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566848 00000100:00100000:3.0:1783074156.979262:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723566976 00000100:00100000:3.0:1783074156.979266:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723566976 00000100:00100000:3.0:1783074156.979278:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1783074156.979281:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723566848:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783074156.979303:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1783074156.979329:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723566976:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783074156.979347:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1783074156.979354:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074156.979445:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723566976:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 132us (326us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074156.979446:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723567104 00000100:00100000:3.0:1783074156.979452:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723566848:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 165us (436us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074156.979452:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723567104 00000100:00100000:2.0:1783074156.979459:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1783074156.979467:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1783074156.979484:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1783074156.979490:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723567104:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783074156.979502:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074156.979532:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723567104:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 40us (323us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074156.979546:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00080000:0.0:1783074156.979557:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074156.979563:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074156.979567:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723567104:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1783074156.979576:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074156.979579:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074156.979581:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723566848:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1783074156.979600:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074156.979603:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074156.979606:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723566976:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1783074157.166464:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074157.998946:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723567360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074157.998955:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723567232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074158.000216:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074158.000272:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723567232 00000100:00100000:1.0:1783074158.000281:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723567232 00000100:00100000:1.0:1783074158.000358:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:1.0:1783074158.000380:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723567232:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783074158.000390:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1783074158.000413:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074158.000465:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723567232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074158.000472:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:1.0:1783074158.000494:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074158.000566:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723567232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074158.001153:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723567360 00000100:00100000:3.0:1783074158.001158:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723567360 00000100:00080000:2.0:1783074158.001512:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074158.001569:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1783074158.001578:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723567360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783074158.001598:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074158.001651:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723567360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074158.001669:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:1.0:1783074158.001728:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723567360:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783074158.190450:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074159.214462:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074160.238472:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783074160.622777:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708074112 offset 0 length 224: 4 00000100:00100000:0.0:1783074160.622807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074160.622831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074160.622891:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074160.623076:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708074368 00000100:00100000:2.0:1783074160.623077:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708074624 00000100:00100000:2.0:1783074160.623095:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708074624 00000100:00100000:1.0:1783074160.623096:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708074368 00000100:00100000:1.0:1783074160.623163:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 840 00000100:00100000:1.0:1783074160.623175:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708074368:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074160.623286:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708074368:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 113us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074160.623295:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 840 00000100:00100000:1.0:1783074160.623425:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708074496 00000100:00100000:1.0:1783074160.623429:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708074496 00000100:00100000:1.0:1783074160.623593:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2157 00000100:00100000:1.0:1783074160.623601:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708074496:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074160.623632:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708074496:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 32us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074160.623638:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2157 00000100:00100000:2.0:1783074160.623769:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2158 00000100:00100000:2.0:1783074160.623779:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708074624:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074160.623811:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708074624:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074160.623819:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2158 00000100:00100000:3.0:1783074160.623879:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074160.623915:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708074240 00000100:00100000:2.0:1783074160.623921:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708074240 00000100:00100000:2.0:1783074160.623951:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1261 00000100:00100000:2.0:1783074160.623955:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708074240:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:2.0:1783074160.623975:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074160.624001:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708074240:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 44us (123us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074160.624007:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1261 00000100:00080000:0.0:1783074160.624499:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074160.624503:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074160.624506:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783074161.263151:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783074161.583938:0:75594:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444082 batchid updated 00000020:00080000:2.0:1783074161.584242:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444082 00000100:00080000:2.0:1783074161.584359:0:75614:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9524c6cf7480 x1869685723567488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074161.584667:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00080000:1.0:1783074162.094476:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074162.094483:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074162.094487:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074162.094496:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2996 00000100:00080000:1.0:1783074162.094502:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074162.094509:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074162.094527:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723567616:0@lo:400:kworker.0 00000100:00100000:1.0:1783074162.094534:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf5c00 x1869685723567744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074162.094579:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074162.094583:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074162.094585:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074162.094590:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2996 00000400:00000100:2.0:1783074162.094594:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723567616 offset 0 length 224: 4 00000100:00080000:1.0:1783074162.094596:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1783074162.094602:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723567872:0@lo:400:kworker.0 00000100:00080000:1.0:1783074162.094604:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074162.094636:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf5180 x1869685723568000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074162.094647:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074162.094668:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783074162.094670:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723567872 00000100:00080000:1.0:1783074162.094671:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074162.094675:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074162.094679:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2996 00000100:00100000:2.0:1783074162.094680:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723567872 00000100:00080000:1.0:1783074162.094682:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074162.094686:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074162.094752:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1783074162.094763:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723567872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074162.094812:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723567872:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074162.094820:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00080000:2.0:1783074162.094847:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074162.094867:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723568128:0@lo:400:kworker.0 00000100:00100000:2.0:1783074162.094905:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074162.094934:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568128 00000100:00100000:2.0:1783074162.094937:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568128 00000100:00100000:1.0:1783074162.094956:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf7b80 x1869685723568256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074162.094968:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723567872:0@lo:400:kworker.0 00000100:00100000:2.0:1783074162.094969:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1783074162.094978:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723568128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783074162.094997:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074162.095002:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074162.095004:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074162.095009:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2996 00000100:00080000:1.0:1783074162.095012:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783074162.095015:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074162.095017:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723568128:12345-0@lo:400:kworker.0 Request processed in 41us (112us total) trans 0 rc 0/0 00000100:00080000:1.0:1783074162.095019:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074162.095029:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723568512:0@lo:400:kworker.0 00000100:00100000:2.0:1783074162.095029:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1783074162.095037:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf4000 x1869685723568640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074162.095070:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723568128:0@lo:400:kworker.0 00000100:00100000:0.0:1783074162.095329:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723567744:0@lo:38:kworker.0 00000100:00100000:3.0:1783074162.095366:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074162.095367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074162.095500:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723568000:0@lo:38:kworker.0 00000100:00100000:0.0:1783074162.095523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074162.095540:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723568256:0@lo:38:kworker.0 00000100:00100000:0.0:1783074162.095561:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074162.095617:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074162.095625:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723568384:0@lo:400:kworker.0 00000100:00100000:0.0:1783074162.095638:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723568640:0@lo:38:kworker.0 00000100:00100000:3.0:1783074162.095652:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074162.095683:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568512 00000100:00100000:3.0:1783074162.095687:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568512 00000100:00100000:3.0:1783074162.095717:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568384 00000100:00100000:3.0:1783074162.095720:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568384 00000100:00100000:0.0:1783074162.095735:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074162.095768:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723567744 00000100:00100000:2.0:1783074162.095773:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723567744 00000100:00100000:0.0:1783074162.095774:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568256 00000100:00100000:0.0:1783074162.095779:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568256 00000100:00100000:2.0:1783074162.095795:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568000 00000100:00100000:2.0:1783074162.095801:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568000 00000100:00100000:0.0:1783074162.095808:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1783074162.095815:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723568256:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074162.095824:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568640 00000100:00100000:2.0:1783074162.095829:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568640 00010000:00020000:0.0:1783074162.095835:0:8454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074162.095840:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783074162.095847:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723567744:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074162.095850:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:1.0:1783074162.095860:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723568000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074162.095864:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074162.095872:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723568256:12345-0@lo:38:kworker.0 Request processed in 54us (308us total) trans 0 rc -19/-19 00010000:00020000:1.0:1783074162.095887:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074162.095918:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723568000:12345-0@lo:38:kworker.0 Request processed in 58us (394us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074162.095925:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1783074162.095943:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:1.0:1783074162.095950:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1783074162.095956:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723568640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074162.095967:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1783074162.095976:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074162.095982:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074162.095994:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723568000:0@lo:38:kworker.0 00000100:00100000:1.0:1783074162.095996:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723568640:12345-0@lo:38:kworker.0 Request processed in 37us (260us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074162.096006:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00080000:0.0:1783074162.096012:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074162.096018:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074162.096022:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723568256:0@lo:38:kworker.0 00000100:00080000:0.0:1783074162.096031:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074162.096034:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074162.096038:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723568640:0@lo:38:kworker.0 00000100:00100000:2.0:1783074162.096119:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723567744:12345-0@lo:38:kworker.0 Request processed in 270us (754us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074162.096126:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00080000:2.0:1783074162.096156:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074162.096160:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074162.096348:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723567744:0@lo:38:kworker.0 00000100:00100000:3.0:1783074162.096349:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1783074162.096358:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1783074162.096361:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723568512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074162.096371:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723568384:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783074162.096382:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074162.096387:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074162.096414:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723568512:12345-0@lo:400:kworker.0 Request processed in 56us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074162.096422:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723568384:12345-0@lo:400:kworker.0 Request processed in 53us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074162.096426:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1783074162.096435:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1783074162.096525:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723568384:0@lo:400:kworker.0 00000100:00100000:3.0:1783074162.096536:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723568512:0@lo:400:kworker.0 00010000:00010000:3.0:1783074162.286479:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074162.606442:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:3.0:1783074163.118912:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723568768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074163.118912:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723568896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074163.119003:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074163.119053:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568896 00000100:00100000:3.0:1783074163.119061:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568896 00000100:00100000:3.0:1783074163.119111:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1783074163.119121:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723568896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074163.119154:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074163.119245:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074163.119248:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723568896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074163.119269:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1783074163.119291:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723568768 00000100:00100000:3.0:1783074163.119295:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723568768 00000100:00100000:3.0:1783074163.119347:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:3.0:1783074163.119354:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723568768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783074163.119372:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074163.119408:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723568896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074163.119422:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723568768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074163.119429:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00000100:00100000:1.0:1783074163.119462:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723568768:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783074163.310619:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074163.630422:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00010000:00010000:1.0:1783074164.336035:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074164.654838:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00010000:00010000:3.0:1783074165.359408:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074165.678383:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:1.0:1783074165.747332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000400:00000100:1.0:1783074165.747363:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708074752 offset 0 length 224: 4 00000100:00100000:3.0:1783074165.747365:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708074880 00000100:00100000:3.0:1783074165.747375:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708074880 00000100:00100000:1.0:1783074165.747383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074165.747407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074165.747423:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075136 00000100:00100000:0.0:1783074165.747429:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075136 00000100:00100000:1.0:1783074165.747438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074165.747481:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075264 00000100:00100000:0.0:1783074165.747485:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075264 00000100:00100000:0.0:1783074165.747517:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2161 00000100:00100000:0.0:1783074165.747529:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708075136:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074165.747727:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708075136:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 199us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074165.747737:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2161 00000100:00100000:3.0:1783074165.747767:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075008 00000100:00100000:3.0:1783074165.747772:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075008 00000100:00100000:0.0:1783074165.747818:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2162 00000100:00100000:0.0:1783074165.747828:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708075264:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074165.747846:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 843 00000100:00100000:0.0:1783074165.747859:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708075264:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074165.747861:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708075008:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074165.747870:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2162 00000100:00080000:0.0:1783074165.747892:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074165.747897:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074165.747906:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074165.747908:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708075008:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 51us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074165.747917:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 843 00000100:00100000:3.0:1783074165.747933:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1265 00000100:00100000:3.0:1783074165.747938:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708074880:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:3.0:1783074165.747958:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074165.747987:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708074880:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 47us (681us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074165.748005:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1265 00010000:00010000:3.0:1783074166.382510:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074166.702760:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00080000:1.0:1783074167.214485:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074167.214492:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074167.214496:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074167.214505:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3001 00000100:00080000:1.0:1783074167.214512:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783074167.214520:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074167.214525:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783074167.214548:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723569024:0@lo:400:kworker.0 00000100:00100000:1.0:1783074167.214561:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf5500 x1869685723569152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074167.214606:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000100:2.0:1783074167.214611:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723569024 offset 0 length 224: 4 00000100:00080000:1.0:1783074167.214618:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074167.214621:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074167.214625:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3001 00000100:00080000:1.0:1783074167.214628:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783074167.214631:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074167.214644:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f467aa00 x1869685723569408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074167.214676:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074167.214686:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074167.214688:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074167.214692:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3001 00000100:00080000:1.0:1783074167.214695:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783074167.214698:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074167.214710:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f467ad80 x1869685723569664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074167.214730:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074167.214735:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074167.214737:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074167.214740:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3001 00000100:00080000:1.0:1783074167.214743:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783074167.214747:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074167.214767:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f467a300 x1869685723570048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074167.214775:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723569280:0@lo:400:kworker.0 00000100:00100000:1.0:1783074167.214788:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723569152:0@lo:38:kworker.0 00000100:00100000:2.0:1783074167.214818:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074167.214824:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723569920:0@lo:400:kworker.0 00000100:00100000:1.0:1783074167.214832:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723569792:0@lo:400:kworker.0 00000100:00100000:1.0:1783074167.214856:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074167.214872:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569280 00000100:00100000:1.0:1783074167.214876:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783074167.214882:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723569536:0@lo:400:kworker.0 00000100:00100000:2.0:1783074167.214887:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569280 00000100:00100000:0.0:1783074167.214905:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074167.214912:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074167.214948:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569792 00000100:00100000:1.0:1783074167.214951:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569792 00000100:00100000:0.0:1783074167.214952:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569920 00000100:00100000:2.0:1783074167.214955:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569536 00000100:00100000:0.0:1783074167.214956:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569920 00000100:00100000:2.0:1783074167.214974:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569536 00000100:00100000:1.0:1783074167.215007:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1783074167.215015:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1783074167.215021:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1783074167.215029:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723569280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074167.215030:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723569792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074167.215035:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723569920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074167.215077:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1783074167.215090:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723569536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074167.215262:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723569920:12345-0@lo:400:kworker.0 Request processed in 233us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074167.215271:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1783074167.215273:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723569792:12345-0@lo:400:kworker.0 Request processed in 254us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074167.215283:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1783074167.215296:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723569280:12345-0@lo:400:kworker.0 Request processed in 270us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074167.215305:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1783074167.215332:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723569920:0@lo:400:kworker.0 00000100:00100000:1.0:1783074167.215351:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074167.215360:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723569536:12345-0@lo:400:kworker.0 Request processed in 272us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074167.215370:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1783074167.215380:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723569408:0@lo:38:kworker.0 00000100:00100000:0.0:1783074167.215381:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723569536:0@lo:400:kworker.0 00000100:00100000:2.0:1783074167.215384:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569152 00000100:00100000:2.0:1783074167.215391:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569152 00000100:00080000:3.0:1783074167.215397:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074167.215403:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074167.215403:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723569792:0@lo:400:kworker.0 00000100:00080000:3.0:1783074167.215409:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074167.215421:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074167.215432:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569408 00000100:00100000:2.0:1783074167.215437:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569408 00000100:00100000:3.0:1783074167.215443:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1783074167.215445:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723569664:0@lo:38:kworker.0 00000100:00100000:3.0:1783074167.215453:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723569152:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074167.215454:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1783074167.215465:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723569408:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783074167.215473:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1783074167.215476:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1783074167.215480:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074167.215495:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723570048:0@lo:38:kworker.0 00000100:00100000:2.0:1783074167.215513:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723569280:0@lo:400:kworker.0 00000100:00100000:3.0:1783074167.215532:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723569152:12345-0@lo:38:kworker.0 Request processed in 77us (179us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074167.215537:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723569408:12345-0@lo:38:kworker.0 Request processed in 70us (114us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074167.215542:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074167.215550:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1783074167.215555:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723569664 00000100:00100000:0.0:1783074167.215558:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1783074167.215561:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723569664 00000100:00100000:3.0:1783074167.215570:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570048 00000100:00100000:3.0:1783074167.215576:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570048 00000100:00080000:1.0:1783074167.215579:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074167.215585:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074167.215590:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723569152:0@lo:38:kworker.0 00000100:00100000:2.0:1783074167.215594:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1783074167.215604:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723569664:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074167.215606:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00080000:1.0:1783074167.215610:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074167.215616:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074167.215618:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723570048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074167.215621:0:23954:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074167.215622:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723569408:0@lo:38:kworker.0 00010000:00020000:3.0:1783074167.215634:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074167.215816:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723569664:12345-0@lo:38:kworker.0 Request processed in 213us (344us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074167.215822:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:3.0:1783074167.215827:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723570048:12345-0@lo:38:kworker.0 Request processed in 209us (287us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783074167.215879:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074167.215884:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074167.215887:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723569664:0@lo:38:kworker.0 00000100:00100000:3.0:1783074167.215893:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00080000:0.0:1783074167.215897:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074167.215903:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074167.215913:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723570048:0@lo:38:kworker.0 00010000:00010000:2.0:1783074167.406614:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074167.726473:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:1.0:1783074167.793630:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000400:00000100:1.0:1783074167.793652:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708075392 offset 0 length 224: 4 00000100:00100000:1.0:1783074167.793691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074167.793902:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075520 00000100:00100000:2.0:1783074167.793912:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075520 00000100:00100000:2.0:1783074167.793964:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1269 00000100:00100000:2.0:1783074167.793972:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708075520:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:2.0:1783074167.793996:0:66201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074167.794064:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708075520:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 91us (371us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074167.794072:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1269 00000100:00100000:0.0:1783074167.794150:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075776 00000100:00100000:0.0:1783074167.794155:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075776 00000100:00100000:0.0:1783074167.794209:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2165 00000100:00100000:0.0:1783074167.794218:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708075776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074167.794258:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708075776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074167.794264:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2165 00000100:00100000:0.0:1783074167.794301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074167.794374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074167.794419:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075904 00000100:00100000:0.0:1783074167.794423:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075904 00000100:00100000:0.0:1783074167.794449:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2166 00000100:00100000:0.0:1783074167.794456:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708075904:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074167.794486:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708075904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 30us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074167.794492:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2166 00000100:00100000:0.0:1783074167.794508:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708075648 00000100:00100000:0.0:1783074167.794511:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708075648 00000100:00100000:0.0:1783074167.794536:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 846 00000100:00100000:0.0:1783074167.794543:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2401:x1869685708075648:12345-192.168.204.26@tcp:38:kworker.0 00010000:02000400:0.0:1783074167.794559:0:68632:0:(ldlm_lib.c:951:target_handle_reconnect()) lustre-MDT0001: Client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b (at 192.168.204.26@tcp) reconnecting 00000100:00080000:2.0:1783074167.796822:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074167.796831:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074167.796833:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783074167.801667:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp ffff9524f7816800 cur 3007 last 1783074167 00000004:00100000:1.0:1783074167.802045:0:68632:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.204.26@tcp supports cksum type f7, return f7 00000100:00080000:1.0:1783074167.802073:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca0000 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1783074167.802082:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074167.802173:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2401:x1869685708075648:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 7628us (7870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074167.802185:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 846 00000100:00100000:1.0:1783074167.805479:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074167.805547:0:66209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708073216 00000100:00100000:2.0:1783074167.805556:0:66209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708073216 00000100:00100000:2.0:1783074167.805596:0:66209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1783074167.805606:0:66209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708073216:12345-192.168.204.26@tcp:700:cp.0 00000100:00080000:2.0:1783074167.805674:0:66209:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9524c6cf5c00 x1869685723570176/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074167.805686:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 0 seconds 00000100:00100000:1.0:1783074168.238456:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783074168.238486:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723570304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074168.238558:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.238602:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783074168.238610:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723570432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074168.238638:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.238683:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570304 00000100:00100000:1.0:1783074168.238690:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570304 00000100:00100000:1.0:1783074168.238734:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570432 00000100:00100000:1.0:1783074168.238737:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570432 00000100:00100000:1.0:1783074168.238758:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729 00000100:00100000:1.0:1783074168.238767:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723570304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074168.238811:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074168.238863:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723570304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.238872:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729 00000100:00100000:1.0:1783074168.238893:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:1.0:1783074168.238902:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723570432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074168.238918:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074168.238979:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723570432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.238986:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:1.0:1783074168.239032:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723570304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074168.239307:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723570432:0@lo:13:osp-pre-1-1.0 00000020:01000004:0.0:1783074168.409855:0:92361:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783074168.409860:0:92361:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783074168.409867:0:92361:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783074168.410000:0:92361:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9524c6e2d800 00000020:01000004:0.0:1783074168.410015:0:92361:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783074168.410030:0:92361:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783074168.410044:0:92361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9524e69d4d40) 00000020:00000080:0.0:1783074168.410060:0:92361:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1783074168.430449:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1783074168.453413:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783074168.455085:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.455698:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.456025:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783074168.456414:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.456667:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.456954:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.457133:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783074168.457402:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783074168.457578:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783074168.457884:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783074168.458120:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.458341:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.458559:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783074168.459384:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.464103:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.464352:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.464604:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.464890:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.465107:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.465345:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.465812:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.466016:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.466202:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.466412:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.466597:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.466752:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.467006:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.467302:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.467514:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.467737:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.467974:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.468375:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.468640:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.468876:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.469093:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.469308:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.469604:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.469928:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.470133:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.470352:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.470591:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.470926:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.471778:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.471982:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.472159:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783074168.472397:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783074168.472732:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.473173:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.473608:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.474051:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.474275:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1783074168.474528:0:92361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1783074168.475695:0:92361:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783074168.475908:0:92361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783074168.475915:0:92361:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783074168.475925:0:92361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfd1a 00000020:01000004:0.0:1783074168.475931:0:92361:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783074168.476074:0:92361:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783074168.476080:0:92361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524c6e2d800 from MGS 00000020:01000004:0.0:1783074168.476085:0:92361:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783074168.476095:0:92361:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9524e69d3380) 00000020:00000080:0.0:1783074168.476107:0:92361:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:0.0:1783074168.476169:0:92361:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6e2d800 from MGS, refs=2 00080000:01000000:0.0:1783074168.476174:0:92361:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783074168.476179:0:92361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfd28 00010000:00010000:0.0:1783074168.476307:0:92361:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783074168.485098:0:92361:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783074168.485787:0:92365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783074168.485876:0:92361:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783074168.485910:0:92361:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783074168.487033:0:92361:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783074168.487379:0:92361:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783074168.487526:0:92361:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783074168.487533:0:92361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783074168.489678:0:92361:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783074168.489687:0:92361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783074168.490744:0:92361:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783074168.490754:0:92361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783074168.491494:0:92361:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783074168.491517:0:92361:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783074168.491518:0:92361:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783074168.491521:0:92361:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1783074168.491527:0:92361:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783074168.491533:0:92361:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783074168.498323:0:92361:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783074168.498328:0:92361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783074168.498336:0:92361:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c53f9f80 x1869685723565696/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074168.498370:0:92361:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524debf6d80 x1869685723567616/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074168.498382:0:92361:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524debf6300 x1869685723569024/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783074168.498389:0:92361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783074168.498392:0:92361:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783074168.498393:0:92361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783074168.498395:0:92361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1783074168.498583:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723569024:0@lo:400:kworker.0 00000100:00100000:2.0:1783074168.498592:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723567616:0@lo:400:kworker.0 00000100:00100000:3.0:1783074168.498948:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723565696:0@lo:400:kworker.0 10000000:01000000:2.0:1783074168.499062:0:92361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1783074168.499080:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499091:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499097:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1783074168.499116:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499126:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016df900 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df907 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499155:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499162:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499166:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499170:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499174:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670000/0x5fb609b3016df866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df86d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499182:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499189:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499194:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499197:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499200:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3159a00/0x5fb609b3016df882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df889 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499209:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499216:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499221:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499229:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499233:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016df8ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499245:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499251:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499257:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499271:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499275:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc7e00/0x5fb609b3016df8ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499284:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499291:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499296:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499299:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499302:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc7400/0x5fb609b3016df8d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8dd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499332:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499339:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499353:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499358:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499364:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016df8e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499375:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499382:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499387:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499397:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499401:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016df90e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df915 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499413:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499420:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499425:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499437:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499441:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016df874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df87b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499457:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499474:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499479:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074168.499491:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499496:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016df890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df897 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499507:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499513:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499518:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783074168.499521:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499524:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016df89e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8a5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499533:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499539:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499544:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783074168.499547:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499551:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc7c00/0x5fb609b3016df8c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8cf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.499568:0:92361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074168.499575:0:92361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.499580:0:92361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783074168.499584:0:92361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783074168.499588:0:92361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016df8f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016df8f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783074168.499602:0:92361:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 55, was 0): DISCONN 00000100:00080000:2.0:1783074168.499608:0:92361:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074168.499613:0:92361:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 2975 00000100:00080000:2.0:1783074168.499620:0:92361:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074168.499646:0:92361:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6cf6680 x1869685723570560/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074168.499670:0:92361:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1783074168.499713:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723570560:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783074168.499790:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.499843:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570560 00000100:00100000:1.0:1783074168.499851:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570560 00000100:00100000:1.0:1783074168.499886:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783074168.499893:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1869685723570560:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1783074168.499918:0:92367:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo t0 exp 0000000000000000 cur 3007 last 0 00000020:00000080:1.0:1783074168.499959:0:92367:0:(genops.c:1406:class_connect()) connect: client 522b6a34-04f4-4017-ab45-61a21d19bfef, cookie 0x5fb609b3016dfd2f 00000100:00080000:1.0:1783074168.500058:0:92367:0:(import.c:65:import_set_state_nolock()) ffff9523cd174000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074168.500104:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3657:x1869685723570560:12345-0@lo:250:mount.lustre.0 Request processed in 210us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.500112:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783074168.500131:0:3657:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 28 00000100:00080000:0.0:1783074168.500139:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1783074168.500147:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783074168.500150:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783074168.500153:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783074168.500156:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783074168.500222:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783074168.500232:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723570560:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1783074168.500242:0:92361:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1783074168.500251:0:92361:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783074168.500284:0:92361:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783074168.500289:0:92361:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783074168.500469:0:92361:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783074168.500502:0:92361:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783074168.500506:0:92361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783074168.500508:0:92361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074168.500509:0:92361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074168.500511:0:92361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074168.500516:0:92361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074168.500517:0:92361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074168.500518:0:92361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074168.500520:0:92361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074168.500522:0:92361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074168.500523:0:92361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783074168.500526:0:92361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783074168.500528:0:92361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783074168.500529:0:92361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074168.500530:0:92361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074168.500531:0:92361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074168.500532:0:92361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074168.500533:0:92361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074168.500534:0:92361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074168.500535:0:92361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074168.500536:0:92361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074168.500537:0:92361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783074168.500551:0:92361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783074168.500564:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723570688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783074168.500597:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.500628:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c46596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.500675:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570688 00000100:00100000:3.0:1783074168.500680:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570688 00000100:00100000:3.0:1783074168.500718:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783074168.500726:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:92361:x1869685723570688:12345-0@lo:253:mount.lustre.0 00000020:01000000:1.0:1783074168.500727:0:53092:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.126@tcp 10000000:01000000:1.0:1783074168.500739:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783074168.500741:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783074168.500743:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783074168.500744:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074168.500745:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074168.500746:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074168.500747:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074168.500748:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074168.500749:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074168.500751:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:3.0:1783074168.500756:0:92369:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074168.500759:0:92369:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783074168.500761:0:92369:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000000:1.0:1783074168.500784:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783074168.500792:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783074168.500799:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783074168.500800:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783074168.500802:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074168.500803:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074168.500804:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074168.500805:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074168.500806:0:53092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074168.500807:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074168.500808:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783074168.500831:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783074168.500836:0:53092:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783074168.500837:0:53092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783074168.500839:0:53092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783074168.500840:0:53092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074168.500841:0:53092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074168.500842:0:53092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074168.500843:0:53092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074168.500844:0:53092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074168.500845:0:53092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074168.500845:0:53092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783074168.500855:0:53092:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783074168.500879:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074168.500889:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723570816:0@lo:253:kworker.0 10000000:01000000:3.0:1783074168.500908:0:92370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1783074168.500918:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.501019:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723570944:0@lo:253:kworker.0 00000100:00100000:1.0:1783074168.501068:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.501080:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783074168.501086:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723571072:0@lo:253:kworker.0 00000100:00100000:1.0:1783074168.501113:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.501133:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570816 00000100:00100000:1.0:1783074168.501137:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570816 00000100:00100000:1.0:1783074168.501150:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571072 00000100:00100000:0.0:1783074168.501150:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570944 00000100:00100000:1.0:1783074168.501153:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571072 00000100:00100000:0.0:1783074168.501153:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570944 00000100:00100000:1.0:1783074168.501165:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783074168.501170:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3658:x1869685723570816:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783074168.501193:0:92367:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783074168.501274:0:92369:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 119 20000000:01000000:1.0:1783074168.503783:0:92371:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783074168.503788:0:92371:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783074168.503789:0:92371:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783074168.503791:0:92371:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783074168.504061:0:92371:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783074168.504270:0:92369:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074168.504288:0:92369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783074168.504346:0:92367:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783074168.505894:0:92367:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783074168.505916:0:92367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783074168.505964:0:92370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074168.505971:0:92370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074168.505997:0:92370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506017:0:92370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074168.506029:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:92361:x1869685723570688:12345-0@lo:253:mount.lustre.0 Request processed in 5296us (5424us total) trans 0 rc 0/0 20000000:01000000:0.0:1783074168.506033:0:92370:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000062791s 00010000:00010000:0.0:1783074168.506041:0:92370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074168.506048:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1783074168.506054:0:92370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506063:0:92370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506072:0:92370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506079:0:92370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074168.506084:0:92370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506093:0:92370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506109:0:92370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074168.506115:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783074168.506132:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3660:x1869685723571072:12345-0@lo:253:kworker.0 00010000:00010000:0.0:1783074168.506138:0:92370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.506147:0:92370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298600/0x5fb609b3016dfd36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.506149:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723570688:0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783074168.506168:0:92369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1783074168.506171:0:92361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783074168.506176:0:92361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783074168.506178:0:92361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074168.506180:0:92361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074168.506181:0:92361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074168.506182:0:92361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074168.506184:0:92361:0:(tgt_mount.c:1180:server_mti_print()) flags: 20000000:01000000:3.0:1783074168.506185:0:92369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1783074168.506186:0:92361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074168.506189:0:92361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074168.506192:0:92361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074168.506195:0:92361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783074168.506221:0:92361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524c6e2d800 from lustre-MDT0000 10000000:01000000:2.0:1783074168.506256:0:92361:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 00000100:00100000:1.0:1783074168.506257:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3658:x1869685723570816:12345-0@lo:253:kworker.0 Request processed in 5084us (5335us total) trans 0 rc 0/0 10000000:01000000:2.0:1783074168.506263:0:92361:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00000100:00100000:1.0:1783074168.506270:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1783074168.506275:0:92361:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9524c6e2d800 10000000:01000000:2.0:1783074168.506287:0:92361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783074168.506292:0:92361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9524c6e2d800 10000000:01000000:2.0:1783074168.506295:0:92361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783074168.506299:0:92361:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524c6e2d800 from 1 10000000:01000000:2.0:1783074168.506302:0:92361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783074168.506357:0:92361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.506368:0:92361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074168.506429:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783074168.506436:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:3660:x1869685723570944:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783074168.506453:0:92367:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:0.0:1783074168.506518:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783074168.506521:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783074168.506524:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074168.506525:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074168.506526:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074168.506528:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074168.506529:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:2.0:1783074168.506530:0:92361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783074168.506531:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074168.506534:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783074168.506538:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723570816:0@lo:253:kworker.0 00000100:00100000:2.0:1783074168.506558:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074168.508716:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.508765:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074168.508954:0:92368:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1783074168.508964:0:92368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1783074168.509268:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571200 00000100:00100000:1.0:1783074168.509276:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571200 00000100:00100000:0.0:1783074168.509463:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783074168.509474:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+7:92361:x1869685723571200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074168.509490:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074168.509509:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298e00/0x5fb609b3016dfd44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfd3d expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.509536:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298e00/0x5fb609b3016dfd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfd3d expref: 8 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.509548:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298e00/0x5fb609b3016dfd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfd3d expref: 8 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.509557:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298e00, rc 0) 00000100:00100000:0.0:1783074168.509619:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:92361:x1869685723571200:12345-0@lo:101:mount.lustre.0 Request processed in 143us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.509626:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783074168.509726:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074168.509744:0:92361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.509754:0:92361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.509771:0:92361:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783074168.509804:0:92361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.509813:0:92361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.509828:0:92361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783074168.509860:0:92361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783074168.509867:0:92361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9524c6e2d800 10000000:01000000:2.0:1783074168.509869:0:92361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783074168.509873:0:92361:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783074168.509875:0:92361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783074168.509900:0:92361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.509933:0:92361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.509951:0:92361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.509969:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074168.509997:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.510023:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.510070:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571328 00000100:00100000:1.0:1783074168.510074:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571328 00000100:00100000:1.0:1783074168.510106:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783074168.510112:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:92361:x1869685723571328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074168.510119:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074168.510130:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfd4b expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.510144:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 9 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.510152:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 9 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.510169:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28f200, rc 0) 00000100:00100000:1.0:1783074168.510201:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723571328:12345-0@lo:101:mount.lustre.0 Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.510206:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783074168.510274:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074168.510284:0:92361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.510291:0:92361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.510368:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074168.510392:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.510418:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.510475:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571456 00000100:00100000:1.0:1783074168.510480:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571456 00000100:00100000:1.0:1783074168.510504:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783074168.510508:0:92372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:1.0:1783074168.510513:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723571456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074168.510520:0:92372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1783074168.510640:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723571456:12345-0@lo:501:mount.lustre.0 Request processed in 130us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.510647:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783074168.510677:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571456:0@lo:501:mount.lustre.0 20000000:01000000:2.0:1783074168.510719:0:92369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:0.0:1783074168.510724:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571584:0@lo:503:mount.lustre.0 20000000:01000000:2.0:1783074168.510732:0:92369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783074168.510748:0:92370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074168.510752:0:92370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074168.510766:0:92370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510778:0:92370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074168.510786:0:92370:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000062791s 00010000:00010000:0.0:1783074168.510790:0:92370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510797:0:92370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510804:0:92370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510811:0:92370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510817:0:92370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074168.510821:0:92370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074168.510831:0:92367:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1783074168.510849:0:92370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510862:0:92370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510873:0:92370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.510881:0:92370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074168.510948:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.510971:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a86f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.511058:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571584 00000100:00100000:1.0:1783074168.511062:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571584 00000100:00100000:1.0:1783074168.511078:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783074168.511082:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723571584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074168.511373:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3660:x1869685723571072:12345-0@lo:253:kworker.0 Request processed in 5247us (10258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.511381:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1783074168.511495:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783074168.511498:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783074168.511499:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074168.511501:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074168.511502:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074168.511503:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074168.511505:0:3660:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074168.511507:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074168.511508:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783074168.511511:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723571072:0@lo:253:kworker.0 00000100:00100000:0.0:1783074168.511883:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723571584:12345-0@lo:503:mount.lustre.0 Request processed in 798us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.511891:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783074168.511982:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723571584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074168.517877:0:92374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92374:1869685723571712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074168.517972:0:92374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.518013:0:92374:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a86900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.518065:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571712 00000100:00100000:3.0:1783074168.518073:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571712 00000100:00100000:3.0:1783074168.518119:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783074168.518131:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92374:x1869685723571712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074168.519421:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92374:x1869685723571712:12345-0@lo:502:llog_process_th.0 Request processed in 1288us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.519440:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783074168.519590:0:92374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92374:1869685723571712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074168.519629:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074168.519639:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074168.519642:0:92374:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783074168.519647:0:92374:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783074168.519650:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074168.519665:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9524e69d0000) 00000020:00000080:0.0:1783074168.519687:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783074168.519700:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783074168.519773:0:92374:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783074168.519782:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfd67 00000020:00000080:0.0:1783074168.520114:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783074168.520119:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074168.520123:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074168.520125:0:92374:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783074168.520128:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074168.520131:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074168.520133:0:92374:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783074168.520136:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074168.520144:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9524f3da3380) 00000020:00000080:0.0:1783074168.520159:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783074168.520164:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783074168.520166:0:92374:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783074168.520169:0:92374:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783074168.520175:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783074168.520259:0:92374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6e2d800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783074168.520270:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9524f3da4d40) 00000020:00000080:0.0:1783074168.520281:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783074168.520358:0:92374:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783074168.520364:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfd7c 00000020:00000080:0.0:1783074168.520467:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783074168.520475:0:92374:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783074168.520479:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb609b3016dfd83 00080000:01000000:0.0:1783074168.520484:0:92374:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783074168.520487:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfd8a 20000000:01000000:3.0:1783074168.520680:0:92367:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783074168.520770:0:92367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783074168.520801:0:92370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074168.520807:0:92370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074168.520828:0:92370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520847:0:92370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074168.520868:0:92370:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000062791s 00010000:00010000:0.0:1783074168.520874:0:92370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520881:0:92370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520888:0:92370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520896:0:92370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520902:0:92370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074168.520907:0:92370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520915:0:92370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520930:0:92370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520949:0:92370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.520956:0:92370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfd91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074168.521032:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3660:x1869685723570944:12345-0@lo:253:kworker.0 Request processed in 14594us (19960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.521041:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1783074168.521257:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783074168.521264:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783074168.521266:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074168.521267:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074168.521268:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074168.521270:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074168.521272:0:3660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783074168.521274:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074168.521275:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783074168.521279:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723570944:0@lo:253:kworker.0 00010000:00010000:0.0:1783074168.566925:0:92374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1783074168.567778:0:92374:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116997 lx: 0 gen 22 00000001:00080000:0.0:1783074168.567821:0:92374:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b idx: 2 lr: 0 srv lr: 115964116997 lx: 0 gen 24 00000001:00000004:0.0:1783074168.567843:0:92374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116997 00000001:00080000:0.0:1783074168.568132:0:92374:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1783074168.568188:0:92374:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524e6a86240: xid 1869685723561600, transno 115964116997, client gen 22, slot idx 1 00000001:00080000:0.0:1783074168.568197:0:92374:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff952502143300: xid 1869685723561344, transno 115964116996, client gen 22, slot idx 2 00000020:00000080:0.0:1783074168.568891:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9524f3da0000) 00000020:00000080:0.0:1783074168.568912:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1783074168.568993:0:92374:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783074168.569002:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfdad 00000020:00000080:1.0:1783074168.569841:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783074168.575588:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb609b3016dfdb4 00000020:00000080:1.0:1783074168.577053:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783074168.577067:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074168.577074:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.577076:0:92374:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783074168.577079:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783074168.577082:0:92374:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783074168.577083:0:92374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074168.577085:0:92374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074168.577086:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783074168.577089:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.577090:0:92374:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783074168.577092:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074168.577096:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.577098:0:92374:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783074168.577102:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783074168.577146:0:92374:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783074168.577163:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074168.577166:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.577168:0:92374:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783074168.577170:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074168.577173:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.577174:0:92374:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783074168.577176:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783074168.577182:0:92374:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:1.0:1783074168.577205:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783074168.577219:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9523c338b380) 00000020:00000080:1.0:1783074168.577239:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783074168.577244:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783074168.577301:0:92374:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783074168.577306:0:92374:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783074168.577340:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfdc2 00010000:00080000:1.0:1783074168.577532:0:92374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523cd170000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1783074168.579184:0:92374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783074168.580612:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074168.580623:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783074168.580657:0:92374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783074168.580679:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfdc9 00000100:00080000:1.0:1783074168.580690:0:92374:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783074168.580819:0:92374:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9523cd170000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074168.580860:0:92374:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4af3800 x1869685723571840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074168.580889:0:92374:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783074168.580990:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723571840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074168.581064:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783074168.581193:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074168.581198:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.581200:0:92374:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783074168.581203:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783074168.581205:0:92374:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1783074168.581207:0:92374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074168.581209:0:92374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783074168.581210:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783074168.581213:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.581214:0:92374:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783074168.581216:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783074168.581221:0:92374:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783074168.581224:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.581226:0:92374:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783074168.581229:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783074168.581238:0:92374:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1783074168.581260:0:92374:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:3.0:1783074168.581264:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571840 00000020:00000080:1.0:1783074168.581264:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1783074168.581273:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571840 00000020:00000080:1.0:1783074168.581278:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9523c338cd40) 00000020:00000080:1.0:1783074168.581295:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783074168.581302:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1783074168.581340:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:3.0:1783074168.581350:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723571840:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783074168.581376:0:8453:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3007 last 0 00000004:00080000:1.0:1783074168.581393:0:92374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783074168.581407:0:92374:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783074168.581417:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfdde 00000020:00000080:3.0:1783074168.581423:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfdd7 00000004:00100000:3.0:1783074168.581440:0:8453:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1783074168.581454:0:92374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524fc3c0000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00080000:3.0:1783074168.581544:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9523c6cad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074168.581626:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723571840:12345-0@lo:38:llog_process_th.0 Request processed in 275us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.581634:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00010000:00010000:1.0:1783074168.581663:0:92374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1783074168.581692:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783074168.581700:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1783074168.581706:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783074168.581711:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783074168.581714:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523cd170000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783074168.581721:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723571840:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783074168.581805:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074168.581811:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074168.581815:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074168.581820:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3006 00000100:00080000:2.0:1783074168.581824:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074168.581831:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074168.581850:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6cf6680 x1869685723572096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074168.581853:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723571968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074168.581884:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074168.581886:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074168.581890:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074168.581893:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074168.581897:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3006 00000100:00080000:2.0:1783074168.581900:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074168.581905:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074168.581917:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723572224:0@lo:400:kworker.0 00000100:00100000:2.0:1783074168.581919:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf6300 x1869685723572352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074168.581930:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723571968 00000100:00100000:1.0:1783074168.581945:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723571968 00000100:00100000:3.0:1783074168.581972:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074168.581973:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074168.581977:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783074168.581981:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723572480:0@lo:400:kworker.0 00000100:00080000:2.0:1783074168.581982:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783074168.581987:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00080000:2.0:1783074168.581991:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3006 00000100:00080000:2.0:1783074168.581996:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783074168.582002:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074168.582003:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723571968:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074168.582021:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf4a80 x1869685723572608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074168.582025:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1783074168.582033:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:3.0:1783074168.582039:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572224 00000100:00080000:2.0:1783074168.582044:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783074168.582045:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572224 00000100:00080000:2.0:1783074168.582050:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074168.582053:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074168.582057:0:53092:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3006 00000100:00080000:2.0:1783074168.582061:0:53092:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1783074168.582073:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572480 00000100:00080000:2.0:1783074168.582077:0:53092:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074168.582085:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723571968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.582086:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572480 00000100:00100000:2.0:1783074168.582096:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c53f9f80 x1869685723572736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074168.582097:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:0.0:1783074168.582128:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1783074168.582137:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723572480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074168.582153:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1783074168.582166:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723572224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074168.582184:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723572096:0@lo:38:kworker.0 00000100:00100000:0.0:1783074168.582195:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723572480:12345-0@lo:400:kworker.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.582201:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1783074168.582220:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723572224:12345-0@lo:400:kworker.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.582222:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.582232:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1783074168.582241:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723571968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074168.582253:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572096 00000100:00100000:3.0:1783074168.582258:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723572352:0@lo:38:kworker.0 00000100:00100000:1.0:1783074168.582259:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572096 00000100:00100000:1.0:1783074168.582287:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1783074168.582290:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.582297:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723572096:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074168.582342:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723572608:0@lo:38:kworker.0 00000100:00100000:0.0:1783074168.582343:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572352 00000100:00100000:0.0:1783074168.582350:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572352 00000100:00100000:1.0:1783074168.582359:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723572096:12345-0@lo:38:kworker.0 Request processed in 61us (136us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783074168.582367:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1783074168.582376:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1783074168.582377:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.582386:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723572352:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074168.582549:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723572736:0@lo:38:kworker.0 00000100:00100000:0.0:1783074168.582738:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723572352:12345-0@lo:38:kworker.0 Request processed in 351us (449us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074168.582739:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.582750:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1783074168.582762:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572736 00000100:00100000:0.0:1783074168.582765:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572736 00000100:00100000:0.0:1783074168.582790:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1783074168.582796:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723572736:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074168.582798:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723572480:0@lo:400:kworker.0 00000100:00100000:0.0:1783074168.582833:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723572736:12345-0@lo:38:kworker.0 Request processed in 35us (96us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783074168.582839:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000040:01000000:1.0:1783074168.583122:0:92374:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783074168.583338:0:92374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:3.0:1783074168.584026:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074168.584032:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783074168.584037:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723572736:0@lo:38:kworker.0 00000100:00080000:3.0:1783074168.584069:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074168.584074:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783074168.584077:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723572096:0@lo:38:kworker.0 00000100:00080000:3.0:1783074168.584088:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074168.584091:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783074168.584096:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723572352:0@lo:38:kworker.0 00000100:00100000:3.0:1783074168.584136:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723572224:0@lo:400:kworker.0 00000100:00100000:3.0:1783074168.584157:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572608 00000100:00100000:3.0:1783074168.584161:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572608 00000100:00100000:3.0:1783074168.584193:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:3.0:1783074168.584199:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723572608:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074168.584258:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723572608:12345-0@lo:38:kworker.0 Request processed in 58us (1884us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074168.584265:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00080000:2.0:1783074168.584353:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074168.584359:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783074168.584362:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723572608:0@lo:38:kworker.0 00000040:00080000:1.0:1783074168.584842:0:92374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783074168.585049:0:92374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:1.0:1783074168.587905:0:92374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:2.0:1783074168.588385:0:92380:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1783074168.588390:0:92380:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783074168.589215:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074168.589226:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783074168.589668:0:92374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783074168.589695:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfde5 00000100:00080000:0.0:1783074168.589706:0:92374:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783074168.589711:0:92374:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9524fc3c0000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074168.589747:0:92374:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df3b8380 x1869685723572864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074168.589812:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723572864:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783074168.589877:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.589916:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572864 00000100:00100000:1.0:1783074168.589924:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572864 00000100:00080000:0.0:1783074168.589944:0:92374:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783074168.589978:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:1.0:1783074168.589986:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1869685723572864:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783074168.590012:0:8444:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3007 last 0 00000020:01000000:0.0:1783074168.590023:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074168.590026:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074168.590028:0:92374:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783074168.590031:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783074168.590033:0:92374:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:00000080:1.0:1783074168.590034:0:8444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfdec 00000020:01000000:0.0:1783074168.590035:0:92374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783074168.590036:0:92374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783074168.590038:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783074168.590040:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074168.590041:0:92374:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783074168.590044:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783074168.590047:0:92374:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00002000:00100000:1.0:1783074168.590049:0:8444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9523c2c2f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:00000080:0.0:1783074168.590050:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074168.590052:0:92374:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00002000:00080000:1.0:1783074168.590053:0:8444:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000020:00000080:0.0:1783074168.590054:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00002000:00100000:1.0:1783074168.590056:0:8444:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:0.0:1783074168.590057:0:92374:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:0.0:1783074168.590076:0:92374:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783074168.590078:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783074168.590090:0:92374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9524c44119c0) 00000020:00000080:0.0:1783074168.590104:0:92374:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1783074168.590109:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00002000:00080000:1.0:1783074168.590117:0:8444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783074168.590141:0:8444:0:(import.c:65:import_set_state_nolock()) ffff9524c6026800 : changing import state from RECOVER to FULL 00000004:00080000:0.0:1783074168.590166:0:92374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783074168.590171:0:92374:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1783074168.590177:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016dfdfa 00010000:00080000:0.0:1783074168.590204:0:92374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524f462d000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1783074168.590441:0:92374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1783074168.590509:0:92374:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783074168.590523:0:92374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1783074168.591348:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723572864:12345-0@lo:8:llog_process_th.0 Request processed in 1358us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.591359:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00000100:00100000:2.0:1783074168.592606:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783074168.592620:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783074168.592687:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783074168.592694:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783074168.592698:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524fc3c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783074168.592721:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783074168.592732:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723572864:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783074168.592783:0:92380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783074168.592995:0:92380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3007810682747ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783074168.593001:0:92380:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783074168.593005:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723572992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783074168.593230:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.593282:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723572992 00000100:00100000:1.0:1783074168.593289:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723572992 00000100:00080000:2.0:1783074168.593355:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074168.593364:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:1.0:1783074168.593374:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723572992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783074168.593407:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074168.593461:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723572992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.593469:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:2.0:1783074168.593793:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723572992:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1783074168.594398:0:92362:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1783074168.595409:0:92374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074168.595913:0:92374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:0.0:1783074168.596083:0:92374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:0.0:1783074168.596568:0:92382:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:0.0:1783074168.596573:0:92382:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783074168.597138:0:92374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074168.597151:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074168.597187:0:92374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074168.597211:0:92374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfe01 00000100:00080000:2.0:1783074168.597220:0:92374:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074168.597226:0:92374:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9524f462d000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074168.597258:0:92374:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c53f8e00 x1869685723573120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074168.597345:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723573120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783074168.597420:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.597533:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573120 00000100:00100000:0.0:1783074168.597540:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573120 00000100:00100000:0.0:1783074168.597580:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922 00000100:00100000:0.0:1783074168.597588:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3657:x1869685723573120:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783074168.597617:0:26174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3007 last 0 00000020:00000080:0.0:1783074168.597642:0:26174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016dfe08 00002000:00100000:0.0:1783074168.597656:0:26174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9524d2470000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783074168.597660:0:26174:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783074168.597663:0:26174:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783074168.597726:0:26174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074168.597749:0:26174:0:(import.c:65:import_set_state_nolock()) ffff9524f0834800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783074168.597825:0:92374:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783074168.597892:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074168.597897:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.597898:0:92374:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783074168.597902:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074168.597905:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.597907:0:92374:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783074168.597910:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783074168.597912:0:92374:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783074168.597914:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074168.597916:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.597917:0:92374:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783074168.597919:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074168.597921:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.597922:0:92374:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783074168.597925:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783074168.597964:0:92374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92374:1869685723573248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074168.598016:0:92374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.598049:0:92374:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.598064:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573248 00000100:00100000:0.0:1783074168.598124:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723573120:12345-0@lo:8:llog_process_th.0 Request processed in 535us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.598131:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922 00000100:00100000:3.0:1783074168.598189:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1783074168.598194:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573248 00000100:00080000:3.0:1783074168.598199:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783074168.598207:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783074168.598213:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783074168.598215:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f462d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783074168.598261:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783074168.598268:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723573120:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783074168.598289:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723573376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074168.598299:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783074168.598344:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:92374:x1869685723573248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074168.598347:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.598384:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573376 00000100:00100000:0.0:1783074168.598389:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573376 00000004:00080000:3.0:1783074168.598409:0:92382:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783074168.598421:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:0.0:1783074168.598428:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723573376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074168.598445:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000004:00080000:3.0:1783074168.598466:0:92382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3007816153751ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783074168.598474:0:92382:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783074168.598483:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:92374:x1869685723573248:12345-0@lo:502:llog_process_th.0 Request processed in 172us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.598491:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723573376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.598500:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00100000:1.0:1783074168.598506:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1783074168.598529:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074168.598556:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723573376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074168.598848:0:92374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92374:1869685723573248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074168.598871:0:92374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074168.598877:0:92374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074168.598879:0:92374:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783074168.598883:0:92374:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783074168.599154:0:92361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783074168.599181:0:92361:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783074168.599199:0:92361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.599210:0:92361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.599218:0:92361:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6e2d800 from 1 10000000:01000000:2.0:1783074168.599222:0:92361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783074168.599252:0:92361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.599260:0:92361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.599269:0:92361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.599284:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074168.599563:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.599602:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659780 going to sleep for 11 seconds 00000004:00080000:3.0:1783074168.599633:0:92362:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783074168.599741:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573504 00000100:00100000:0.0:1783074168.599747:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573504 00000100:00100000:0.0:1783074168.599783:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783074168.599789:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+8:92361:x1869685723573504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074168.599800:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074168.599816:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe0f expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.599841:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 9 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.599852:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 9 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.599863:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299800, rc 0) 00000100:00100000:0.0:1783074168.599903:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723573504:12345-0@lo:101:mount.lustre.0 Request processed in 113us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.599909:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783074168.599987:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074168.600001:0:92361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.600009:0:92361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.601028:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573632:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783074168.601133:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.601227:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659780 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.601278:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573632 00000100:00100000:3.0:1783074168.601284:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573632 00000100:00100000:3.0:1783074168.601385:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783074168.601460:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723573632:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783074168.601480:0:92367:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783074168.601498:0:92367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783074168.601503:0:92367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783074168.601506:0:92367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783074168.601513:0:92367:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 122 00000100:00100000:3.0:1783074168.601774:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723573632:12345-0@lo:256:mount.lustre.0 Request processed in 381us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.601782:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783074168.601869:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573632:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783074168.602811:0:92361:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074168.602831:0:92361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.602847:0:92361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074168.602855:0:92361:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524c6e2d800 from 1 10000000:01000000:2.0:1783074168.602858:0:92361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074168.602890:0:92361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.602899:0:92361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.602908:0:92361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.602924:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074168.602977:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.603015:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659780 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.603145:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573760 00000100:00100000:1.0:1783074168.603152:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573760 00000100:00100000:1.0:1783074168.603198:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783074168.603208:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+9:92361:x1869685723573760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074168.603221:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074168.603235:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28e200/0x5fb609b3016dfe24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe1d expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.603259:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28e200/0x5fb609b3016dfe24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe1d expref: 10 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.603270:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28e200/0x5fb609b3016dfe24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe1d expref: 10 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.603280:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e200, rc 0) 00000100:00100000:1.0:1783074168.603408:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723573760:12345-0@lo:101:mount.lustre.0 Request processed in 200us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.603415:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783074168.603568:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074168.603590:0:92361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.603599:0:92361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.603719:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074168.603747:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.603773:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659780 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.603834:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723573888 00000100:00100000:3.0:1783074168.603839:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723573888 00000100:00100000:3.0:1783074168.603907:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783074168.603915:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723573888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074168.604097:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723573888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074168.604132:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074168.604189:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723573888:12345-0@lo:501:mount.lustre.0 Request processed in 274us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.604202:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783074168.604203:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.604237:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074168.604279:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574016 00000100:00100000:0.0:1783074168.604285:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574016 00000100:00100000:0.0:1783074168.604335:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783074168.604343:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723574016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074168.604451:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723574016:12345-0@lo:503:mount.lustre.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.604458:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783074168.604600:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074168.605446:0:92384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92384:1869685723574144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074168.605492:0:92384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.605530:0:92384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074168.605666:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574144 00000100:00100000:0.0:1783074168.605677:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574144 00000100:00100000:0.0:1783074168.605714:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783074168.605722:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92384:x1869685723574144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074168.607580:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92384:x1869685723574144:12345-0@lo:502:llog_process_th.0 Request processed in 1852us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.607593:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783074168.607624:0:92384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92384:1869685723574144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074168.607668:0:92384:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074168.607678:0:92384:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.607681:0:92384:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783074168.607687:0:92384:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524c6e2d800 00000020:00000080:2.0:1783074168.607690:0:92384:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783074168.607698:0:92384:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074168.607700:0:92384:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.607701:0:92384:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783074168.607703:0:92384:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074168.607706:0:92384:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074168.607707:0:92384:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783074168.607710:0:92384:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524c6e2d800 00000020:00000080:2.0:1783074168.607711:0:92384:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783074168.607797:0:92384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92384:1869685723574272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074168.607843:0:92384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.607869:0:92384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.607975:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574272 00000100:00100000:3.0:1783074168.607981:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574272 00000100:00100000:3.0:1783074168.608024:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783074168.608034:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92384:x1869685723574272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074168.608187:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92384:x1869685723574272:12345-0@lo:502:llog_process_th.0 Request processed in 154us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.608195:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783074168.608237:0:92384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92384:1869685723574272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783074168.608251:0:92384:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074168.608255:0:92384:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074168.608256:0:92384:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783074168.608259:0:92384:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783074168.608361:0:92361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783074168.608476:0:92361:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074168.608496:0:92361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.608508:0:92361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074168.608560:0:92361:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783074168.608564:0:92361:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9524c6e2d800 10000000:01000000:1.0:1783074168.608567:0:92361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9524c6e2d800 10000000:01000000:1.0:1783074168.608570:0:92361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783074168.608575:0:92361:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6e2d800 from 1 10000000:01000000:1.0:1783074168.608578:0:92361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074168.608604:0:92361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.608612:0:92361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.608632:0:92361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074168.608645:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074168.608674:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.608704:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074168.608909:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574400 00000100:00100000:2.0:1783074168.608913:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574400 00000100:00100000:2.0:1783074168.608958:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783074168.608974:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:92361:x1869685723574400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074168.608984:0:92369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074168.608999:0:92369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe2b expref: -99 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.609024:0:92369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 11 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.609034:0:92369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 11 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.609044:0:92369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086d800, rc 0) 00000100:00100000:2.0:1783074168.609097:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723574400:12345-0@lo:101:mount.lustre.0 Request processed in 125us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074168.609104:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783074168.609695:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074168.609708:0:92361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.609716:0:92361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074168.609777:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074168.609812:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.609870:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074168.610005:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574528 00000100:00100000:2.0:1783074168.610010:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574528 00000100:00100000:2.0:1783074168.610084:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783074168.610092:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723574528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074168.610194:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723574528:12345-0@lo:501:mount.lustre.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074168.610202:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783074168.611139:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074168.611183:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074168.611231:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074168.611258:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb7e5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074168.611288:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574656 00000100:00100000:2.0:1783074168.611294:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574656 00000100:00100000:2.0:1783074168.611491:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783074168.611500:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723574656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074168.611616:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723574656:12345-0@lo:503:mount.lustre.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074168.611634:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783074168.611638:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723574656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074168.612184:0:92386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92386:1869685723574784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074168.612233:0:92386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.612270:0:92386:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074168.612291:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574784 00000100:00100000:0.0:1783074168.612297:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574784 00000100:00100000:0.0:1783074168.612354:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783074168.612363:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92386:x1869685723574784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074168.612454:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92386:x1869685723574784:12345-0@lo:502:llog_process_th.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074168.612461:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783074168.613504:0:92386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92386:1869685723574784:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783074168.613617:0:92386:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783074168.613632:0:92386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9523c2284d40) 00000020:00000080:2.0:1783074168.613657:0:92386:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783074168.614057:0:92386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6e2d800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074168.614062:0:92386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6e2d800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074168.614065:0:92386:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6e2d800 4 00010000:00080000:2.0:1783074168.614965:0:92386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c4b3a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1783074168.617834:0:92386:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783074168.618199:0:92386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783074168.618264:0:92386:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783074168.618281:0:92386:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb609b3016dfe40 00000100:00080000:2.0:1783074168.618293:0:92386:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074168.618300:0:92386:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524c4b3a000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074168.618359:0:92386:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c53faa00 x1869685723574912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074168.618393:0:92386:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783074168.619089:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723574912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783074168.619177:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.619220:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723574912 00000100:00100000:1.0:1783074168.619228:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723574912 00000100:00100000:1.0:1783074168.619263:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1783074168.619269:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723574912:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074168.619339:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723574912:12345-0@lo:38:llog_process_th.0 Request processed in 68us (162us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783074168.619344:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1783074168.619379:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783074168.619385:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074168.619388:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783074168.619397:0:92386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92386:1869685723575040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074168.619399:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723574912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783074168.619460:0:92386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074168.619493:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575040 00000100:00100000:3.0:1783074168.619497:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575040 00000100:00100000:3.0:1783074168.619534:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783074168.619542:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92386:x1869685723575040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074168.619655:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92386:x1869685723575040:12345-0@lo:502:llog_process_th.0 Request processed in 114us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.619662:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783074168.619760:0:92386:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0926600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.619775:0:92386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92386:1869685723575040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074168.619811:0:92386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92386:1869685723575168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074168.619847:0:92386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.621030:0:92386:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0926600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.621108:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575168 00000100:00100000:3.0:1783074168.621115:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575168 00000100:00100000:3.0:1783074168.621159:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783074168.621167:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92386:x1869685723575168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074168.622107:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92386:x1869685723575168:12345-0@lo:502:llog_process_th.0 Request processed in 937us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.622117:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783074168.622190:0:92386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92386:1869685723575168:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074168.622222:0:92386:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783074168.622571:0:92361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783074168.622597:0:92361:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074168.622649:0:92361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.622662:0:92361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783074168.622722:0:92361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783074168.622725:0:92361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074168.622726:0:92361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074168.622727:0:92361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074168.622729:0:92361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074168.622731:0:92361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074168.622732:0:92361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074168.622734:0:92361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074168.622737:0:92361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074168.622739:0:92361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783074168.622743:0:92361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783074168.622745:0:92361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783074168.622746:0:92361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074168.622748:0:92361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074168.622750:0:92361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074168.622752:0:92361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074168.622753:0:92361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074168.622754:0:92361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074168.622756:0:92361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074168.622757:0:92361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074168.622758:0:92361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783074168.622779:0:92361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783074168.622795:0:92361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723575296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783074168.622843:0:92361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.622888:0:92361:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0c1a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.622913:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575296 00000100:00100000:1.0:1783074168.622924:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575296 00000100:00100000:1.0:1783074168.622975:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783074168.622984:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723575296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783074168.623012:0:92367:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783074168.623028:0:92367:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783074168.625817:0:92367:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783074168.625884:0:92367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783074168.626175:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:92361:x1869685723575296:12345-0@lo:253:mount.lustre.0 Request processed in 3187us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.626187:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783074168.626282:0:92361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:92361:1869685723575296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783074168.626295:0:92361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783074168.626298:0:92361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783074168.626300:0:92361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783074168.626301:0:92361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074168.626303:0:92361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074168.626304:0:92361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074168.626340:0:92361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074168.626342:0:92361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783074168.626343:0:92361:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783074168.626345:0:92361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074168.626346:0:92361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783074168.626365:0:92361:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1783074168.627798:0:92370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783074168.627803:0:92370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783074168.627830:0:92370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.627849:0:92370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 10 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.627858:0:92370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.627893:0:92370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 10 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074168.627907:0:92370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 10 pid: 92372 timeout: 3107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074168.627920:0:92370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92370:1869685723575424:0@lo:104: 00000100:00100000:2.0:1783074168.627982:0:92370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.628058:0:92370:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074168.628615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575424 00000100:00100000:1.0:1783074168.628621:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575424 00000100:00100000:1.0:1783074168.628807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783074168.628815:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92370:x1869685723575424:12345-0@lo:104: 00010000:00010000:1.0:1783074168.628827:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.628880:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783074168.628885:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92370:x1869685723575424:12345-0@lo:104: Request processed in 71us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074168.628889:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:1.0:1783074168.628907:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074168.628912:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.628918:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074168.628921:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.628949:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074168.628961:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074168.628968:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074168.629001:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629007:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074168.629030:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629036:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086c800/0x5fb609b3016dfe0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe16 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629053:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074168.629056:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074168.629058:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074168.629081:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723575552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074168.629118:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074168.629197:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575552 00000100:00100000:1.0:1783074168.629201:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575552 00010000:00010000:1.0:1783074168.629221:0:7930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 11 pid: 92372 timeout: 3107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074168.629236:0:92370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92370:1869685723575424:0@lo:104: 00000100:00100000:1.0:1783074168.629252:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00010000:00010000:0.0:1783074168.629261:0:92370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074168.629262:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3659:x1869685723575552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074168.629283:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074168.629290:0:7930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 11 pid: 92372 timeout: 3107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629303:0:7930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 11 pid: 92372 timeout: 3107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629340:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299800/0x5fb609b3016dfe16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfe0f expref: 11 pid: 92372 timeout: 3107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629354:0:7930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629363:0:7930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783074168.629456:0:7930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001653075s 00010000:00010000:1.0:1783074168.629462:0:7930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629470:0:7930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629477:0:7930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629483:0:7930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629490:0:7930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074168.629495:0:7930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629509:0:7930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629526:0:7930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074168.629538:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074168.629556:0:92370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074168.629566:0:92370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074168.629573:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3659:x1869685723575552:12345-0@lo:103:ldlm_bl.0 Request processed in 312us (453us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074168.629590:0:92370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074168.629591:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1783074168.629639:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723575552:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783074168.632817:0:92361:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:0.0:1783074168.633067:0:92361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783074168.633078:0:92392:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:3.0:1783074168.633083:0:92392:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:0.0:1783074168.633633:0:92393:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783074168.633650:0:92361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1783074168.633855:0:92393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783074168.634071:0:92394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92394:1869685723575680:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074168.634142:0:92394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.634214:0:92394:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.634260:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575680 00000100:00100000:3.0:1783074168.634268:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575680 00000100:00100000:3.0:1783074168.634404:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1783074168.634415:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92394:x1869685723575680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074168.634532:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92394:x1869685723575680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 118us (389us total) trans 0 rc 0/0 00000040:01000000:1.0:1783074168.634536:0:92361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:3.0:1783074168.634541:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000040:00080000:1.0:1783074168.634576:0:92361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783074168.634973:0:92394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92394:1869685723575680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783074168.635000:0:92394:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783074168.635028:0:92394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92394:1869685723575808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074168.635059:0:92394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.635081:0:92394:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074168.635115:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575808 00000100:00100000:3.0:1783074168.635119:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575808 00000100:00100000:3.0:1783074168.635181:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:3.0:1783074168.635189:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92394:x1869685723575808:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074168.635294:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92394:x1869685723575808:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074168.635300:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00100000:2.0:1783074168.635451:0:92394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92394:1869685723575808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074168.635497:0:92394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92394:1869685723575936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074168.635532:0:92394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074168.635556:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723575936 00000100:00100000:2.0:1783074168.635559:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723575936 00000100:00100000:2.0:1783074168.635584:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:2.0:1783074168.635590:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92394:x1869685723575936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783074168.635635:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92394:x1869685723575936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074168.635641:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:2.0:1783074168.635658:0:92394:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074168.635671:0:92394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92394:1869685723575936:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783074168.635705:0:92394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783074168.641211:0:92361:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783074168.641231:0:92361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783074168.641342:0:92361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783074168.644929:0:92393:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783074168.645021:0:92393:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783074168.648256:0:92361:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783074168.650770:0:92361:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783074168.650839:0:92361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783074168.650970:0:92361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783074168.651449:0:92361:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00000040:00080000:2.0:1783074168.651522:0:92394:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783074168.651590:0:92394:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783074168.651595:0:92394:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1783074168.653561:0:92361:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116997 00010000:00080000:1.0:1783074168.654956:0:92395:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92395 00010000:02000000:1.0:1783074168.654974:0:92395:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783074168.654978:0:92395:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783074168.654982:0:92395:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1783074168.655429:0:92361:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783074168.655446:0:92361:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783074168.655476:0:92361:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783074168.655490:0:92361:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783074168.656541:0:92361:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783074168.656806:0:92361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783074168.751497:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:2.0:1783074168.814457:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 0 seconds 00010000:00010000:3.0:1783074169.454850:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783074169.651126:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783074169.651138:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6e2d800 from 123 10000000:01000000:3.0:1783074169.651144:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783074169.651202:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.651215:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.651237:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074169.651266:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.651387:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074169.651471:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.651490:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576064 00000100:00100000:2.0:1783074169.651501:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576064 00000100:00100000:2.0:1783074169.651570:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783074169.651583:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:6527:x1869685723576064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.651601:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.651618:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086de00/0x5fb609b3016dfe55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe4e expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.651645:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086de00/0x5fb609b3016dfe55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe4e expref: 11 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.651656:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086de00/0x5fb609b3016dfe55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe4e expref: 11 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.651672:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086de00, rc 0) 00000100:00100000:2.0:1783074169.651727:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723576064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.651734:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783074169.652080:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.652095:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.652104:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074169.652155:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.652189:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074169.652220:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.652262:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576192 00000100:00100000:2.0:1783074169.652269:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576192 00000100:00100000:2.0:1783074169.652398:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783074169.652406:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723576192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074169.652422:0:92372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783074169.652443:0:92372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074169.652446:0:92372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 123 00000100:00100000:2.0:1783074169.652544:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723576192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.652552:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783074169.652729:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783074169.652777:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783074169.652786:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.652794:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074169.652803:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783074169.652806:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 52 10000000:01000000:3.0:1783074169.652814:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074169.652835:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.652842:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.652850:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074169.652863:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.652892:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074169.653928:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074169.654880:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576320 00000100:00100000:0.0:1783074169.654892:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576320 00000100:00100000:0.0:1783074169.654973:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783074169.654987:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723576320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074169.655008:0:92369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074169.655031:0:92369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe5c expref: -99 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.655063:0:92369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 12 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.655076:0:92369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 12 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.656683:0:92369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299600, rc 0) 00000100:00100000:0.0:1783074169.656762:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723576320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1777us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074169.656771:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783074169.657421:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.657446:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.657458:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.662394:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.662478:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.662546:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.664627:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576448 00000100:00100000:3.0:1783074169.664641:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576448 00000100:00100000:3.0:1783074169.664701:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783074169.664718:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723576448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.664955:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723576448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074169.664959:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.664974:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783074169.665023:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.665084:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.665120:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.665155:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576576 00000100:00100000:3.0:1783074169.665159:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576576 00000100:00100000:3.0:1783074169.665200:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783074169.665206:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723576576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.665277:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723576576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.665283:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783074169.665408:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074169.667257:0:92486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783074169.667358:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783074169.667393:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074169.667405:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.667418:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074169.667429:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783074169.667432:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 120 10000000:01000000:1.0:1783074169.667435:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783074169.667469:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.667479:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.667490:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074169.667514:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.667572:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.667662:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.667700:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576704 00000100:00100000:2.0:1783074169.667708:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576704 00000100:00100000:2.0:1783074169.667789:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783074169.667800:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723576704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.667815:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.667829:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086c200/0x5fb609b3016dfe71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe6a expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.667854:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c200/0x5fb609b3016dfe71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe6a expref: 13 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.667864:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086c200/0x5fb609b3016dfe71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe6a expref: 13 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.667885:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c200, rc 0) 00000100:00100000:2.0:1783074169.667936:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723576704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.667943:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783074169.668010:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074169.668031:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.668040:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074169.668084:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.668113:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.668146:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.668299:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576832 00000100:00100000:3.0:1783074169.668305:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576832 00000100:00100000:3.0:1783074169.668362:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783074169.668371:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723576832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783074169.668388:0:92368:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783074169.668404:0:92368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783074169.668408:0:92368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783074169.668412:0:92368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783074169.668414:0:92368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783074169.668417:0:92368:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:3.0:1783074169.668556:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723576832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 187us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.668563:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783074169.668593:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783074169.668664:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074169.668670:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.668679:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074169.668686:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783074169.668689:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783074169.668691:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074169.668710:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.668717:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.668726:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.668739:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.668766:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.668781:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.668800:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723576960 00000100:00100000:2.0:1783074169.668804:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723576960 00000100:00100000:2.0:1783074169.668883:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783074169.668890:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723576960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.668896:0:92373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.668904:0:92373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe78 expref: -99 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.668929:0:92373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 14 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.668939:0:92373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 14 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.668947:0:92373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c400, rc 0) 00000100:00100000:2.0:1783074169.668977:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723576960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.668984:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783074169.669021:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723576960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.669032:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.669039:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.669088:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.669109:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.669128:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.669144:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577088 00000100:00100000:2.0:1783074169.669148:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577088 00000100:00100000:2.0:1783074169.669168:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783074169.669174:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723577088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.669330:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723577088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.669337:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783074169.669368:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.669394:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.669424:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.669439:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.669457:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577216 00000100:00100000:3.0:1783074169.669463:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577216 00000100:00100000:3.0:1783074169.669490:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783074169.669496:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723577216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.671218:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723577216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1714us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.671233:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783074169.671328:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074169.674388:0:92487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1783074169.674480:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1783074169.674515:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783074169.674529:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.674541:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074169.674551:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1783074169.674555:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9523c6b72800 from 1 10000000:01000000:1.0:1783074169.674558:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074169.674604:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.674613:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.674624:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074169.674649:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.674725:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.674761:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577344 00000100:00100000:2.0:1783074169.674770:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577344 00000100:00100000:1.0:1783074169.674779:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.674879:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783074169.674893:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723577344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.674910:0:92369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.674935:0:92369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086c800/0x5fb609b3016dfe8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe86 expref: -99 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.674967:0:92369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c800/0x5fb609b3016dfe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe86 expref: 15 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.674979:0:92369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086c800/0x5fb609b3016dfe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe86 expref: 15 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.674990:0:92369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c800, rc 0) 00000100:00100000:2.0:1783074169.675038:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723577344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.675053:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783074169.675074:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074169.675091:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.675101:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074169.675119:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783074169.675123:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.675129:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074169.675137:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783074169.675139:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c6b72800 from 7 10000000:01000000:1.0:1783074169.675141:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783074169.675155:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.675163:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.675170:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074169.675182:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.675222:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.675243:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.675261:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577472 00000100:00100000:2.0:1783074169.675266:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577472 00000100:00100000:2.0:1783074169.675300:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783074169.675398:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723577472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.675407:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.675416:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086d400/0x5fb609b3016dfe9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfe94 expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.675430:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086d400/0x5fb609b3016dfe9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfe94 expref: 16 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.675439:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086d400/0x5fb609b3016dfe9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe94 expref: 16 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.675447:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086d400, rc 0) 00000100:00100000:2.0:1783074169.675484:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723577472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.675490:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783074169.675557:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.675685:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.675697:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074169.675767:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.675802:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074169.675991:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.676051:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577600 00000100:00100000:2.0:1783074169.676057:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577600 00000100:00100000:2.0:1783074169.676114:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783074169.676122:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723577600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.676248:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723577600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.676255:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783074169.676351:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.676388:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.676427:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074169.676546:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577728 00000100:00100000:3.0:1783074169.676552:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577728 00000100:00100000:1.0:1783074169.676554:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.676593:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783074169.676602:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723577728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.676710:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723577728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.676718:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783074169.676962:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074169.679058:0:92490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074169.679360:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074169.679389:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074169.679400:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.679411:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074169.679422:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074169.679425:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 52 10000000:01000000:0.0:1783074169.679428:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074169.679468:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.679476:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.679487:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.679519:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.679651:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.679685:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.679721:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577856 00000100:00100000:3.0:1783074169.679727:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577856 00000100:00100000:3.0:1783074169.679769:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783074169.679779:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723577856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.679792:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074169.679809:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfea2 expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.679832:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 17 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.679854:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 17 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.679863:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bdc00, rc 0) 00000100:00100000:3.0:1783074169.679934:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723577856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.679941:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783074169.679970:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074169.679985:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.679994:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.680043:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.680069:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.680088:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.680714:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723577984 00000100:00100000:3.0:1783074169.680718:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723577984 00000100:00100000:3.0:1783074169.680748:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783074169.680755:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723577984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.680859:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723577984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.680865:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783074169.680906:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723577984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.681162:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.681211:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.681245:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.681821:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578112 00000100:00100000:3.0:1783074169.681827:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578112 00000100:00100000:3.0:1783074169.681861:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783074169.681868:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723578112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.681968:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723578112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.681979:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783074169.681979:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074169.683907:0:92492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783074169.684597:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783074169.684628:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074169.684640:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.684650:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074169.684667:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783074169.684669:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783074169.684672:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783074169.684702:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.684709:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.684719:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.684737:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.684783:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.684823:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68dfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.685201:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578240 00000100:00100000:2.0:1783074169.685213:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578240 00000100:00100000:2.0:1783074169.685258:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783074169.685267:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723578240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.685280:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.685294:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfeb0 expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.685420:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 18 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.685434:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 18 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.685443:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086dc00, rc 0) 00000100:00100000:2.0:1783074169.685487:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723578240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.685494:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783074169.685503:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074169.685519:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.685528:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.685575:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.685600:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.685623:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578368 00000100:00100000:1.0:1783074169.685628:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578368 00000100:00100000:0.0:1783074169.685632:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68dfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074169.685659:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783074169.685667:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723578368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.685821:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723578368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074169.685827:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783074169.685888:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.685925:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.685958:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.685980:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074169.686026:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578496 00000100:00100000:1.0:1783074169.686029:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578496 00000100:00100000:1.0:1783074169.686051:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783074169.686057:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723578496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.688011:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723578496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1950us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074169.688030:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783074169.689429:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074169.690085:0:92496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783074169.690204:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783074169.690224:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783074169.690233:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.690249:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074169.690255:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783074169.690257:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49f9000 from 7 10000000:01000000:2.0:1783074169.690259:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074169.690287:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.690295:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.690305:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.690518:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.690556:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.690608:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.690632:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578624 00000100:00100000:3.0:1783074169.690636:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578624 00000100:00100000:3.0:1783074169.690667:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783074169.690673:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723578624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.690689:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074169.690701:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bca00/0x5fb609b3016dfec5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfebe expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.690720:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bca00/0x5fb609b3016dfec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfebe expref: 19 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.690728:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bca00/0x5fb609b3016dfec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfebe expref: 19 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.690736:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bca00, rc 0) 00000100:00100000:3.0:1783074169.690810:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723578624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.690815:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783074169.690872:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.690881:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.690887:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.690937:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.690965:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.691023:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074169.691052:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578752 00000100:00100000:1.0:1783074169.691057:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578752 00000100:00100000:1.0:1783074169.691112:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783074169.691119:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723578752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.691208:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723578752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074169.691212:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783074169.691258:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.691279:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.691334:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074169.691478:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.691503:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723578880 00000100:00100000:2.0:1783074169.691506:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723578880 00000100:00100000:2.0:1783074169.691558:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783074169.691564:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723578880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.691645:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723578880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.691652:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783074169.691685:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723578880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074169.692492:0:92497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783074169.692555:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783074169.692574:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074169.692581:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.692591:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074169.692600:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074169.692602:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 52 10000000:01000000:1.0:1783074169.692605:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074169.692683:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.692691:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.692699:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074169.692714:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.692743:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.692772:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.692777:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579008 00000100:00100000:2.0:1783074169.692782:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579008 00000100:00100000:2.0:1783074169.692844:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783074169.692853:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723579008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.692861:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.692871:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfecc expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.692889:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 20 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.692900:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 20 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.692909:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f086c600, rc 0) 00000100:00100000:2.0:1783074169.692962:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723579008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.692969:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783074169.693031:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074169.693043:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.693050:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074169.693106:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.693134:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.693155:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.693198:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579136 00000100:00100000:3.0:1783074169.693202:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579136 00000100:00100000:3.0:1783074169.693232:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783074169.693240:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723579136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.693428:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.693429:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723579136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.693436:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783074169.693452:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.693495:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074169.693520:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.693548:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579264 00000100:00100000:2.0:1783074169.693552:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579264 00000100:00100000:2.0:1783074169.693581:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783074169.693588:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723579264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.693662:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723579264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.693668:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783074169.693689:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074169.694483:0:92498:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783074169.694594:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783074169.694610:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074169.694617:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.694625:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074169.694633:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783074169.694636:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783074169.694639:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783074169.694659:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.694667:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.694673:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.694683:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.694708:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.694730:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074169.694739:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579392 00000100:00100000:1.0:1783074169.694744:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579392 00000100:00100000:1.0:1783074169.694778:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783074169.694786:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723579392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074169.694795:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074169.694804:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfeda expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.694820:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 21 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.694829:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 21 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074169.694836:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28f000, rc 0) 00000100:00100000:1.0:1783074169.694869:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723579392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074169.694886:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783074169.694896:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.694925:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.694934:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.694973:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.694996:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.695010:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074169.695016:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579520 00000100:00100000:1.0:1783074169.695020:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579520 00000100:00100000:1.0:1783074169.695042:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783074169.695049:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723579520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.695150:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723579520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074169.695157:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783074169.695159:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.695184:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.695218:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.695238:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde240 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.695272:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579648 00000100:00100000:3.0:1783074169.695282:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579648 00000100:00100000:1.0:1783074169.695413:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783074169.695422:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723579648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074169.696200:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723579648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 778us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074169.696208:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783074169.696222:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074169.697156:0:92499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783074169.697305:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783074169.697345:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783074169.697354:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.697365:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074169.697374:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783074169.697377:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f4a91000 from 7 10000000:01000000:2.0:1783074169.697380:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074169.697402:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.697420:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.697429:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.697445:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.697476:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.697502:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f0fde240 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.697555:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579776 00000100:00100000:3.0:1783074169.697561:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579776 00000100:00100000:3.0:1783074169.697677:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783074169.697686:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723579776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.697696:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074169.697708:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd800/0x5fb609b3016dfeef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfee8 expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.697727:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd800/0x5fb609b3016dfeef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfee8 expref: 22 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.697738:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd800/0x5fb609b3016dfeef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfee8 expref: 22 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.697747:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd800, rc 0) 00000100:00100000:3.0:1783074169.697808:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723579776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.697815:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783074169.697830:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074169.697847:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.697858:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.697911:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.697958:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.697982:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.698418:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723579904 00000100:00100000:3.0:1783074169.698423:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723579904 00000100:00100000:3.0:1783074169.698481:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783074169.698488:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723579904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074169.698583:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723579904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074169.698590:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783074169.698652:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723579904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.698682:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.698718:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074169.701335:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580032 00000100:00100000:2.0:1783074169.701349:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580032 00000100:00100000:0.0:1783074169.701393:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.701398:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783074169.701409:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723580032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.701530:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723580032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074169.701545:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.701552:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:2.0:1783074169.703680:0:92500:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074169.703814:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074169.703838:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074169.703850:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.703862:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074169.703871:0:6527:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783074169.703880:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074169.703883:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783074169.703930:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.703940:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.703950:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.703970:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.704014:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.704048:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074169.704195:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580160 00000100:00100000:3.0:1783074169.704202:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580160 00000100:00100000:3.0:1783074169.704252:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783074169.704260:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723580160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074169.704272:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074169.704285:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd400/0x5fb609b3016dfefd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dfef6 expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.704372:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd400/0x5fb609b3016dfefd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dfef6 expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.704386:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd400/0x5fb609b3016dfefd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfef6 expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.704396:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd400, rc 0) 00000100:00100000:2.0:1783074169.704969:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723580160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 709us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.704977:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783074169.705278:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074169.705292:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.705302:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074169.705338:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783074169.705343:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.705350:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074169.705356:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783074169.705358:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074169.705368:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783074169.705383:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.705390:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.705398:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.705411:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.705439:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.705463:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.705476:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580288 00000100:00100000:2.0:1783074169.705483:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580288 00000100:00100000:2.0:1783074169.705513:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783074169.705521:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723580288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074169.705529:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074169.705538:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dff04 expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.705560:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 24 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.705568:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 24 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074169.705575:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7c00, rc 0) 00000100:00100000:2.0:1783074169.705611:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723580288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074169.705618:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783074169.705690:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074169.705701:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074169.705709:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074169.705752:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074169.705778:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074169.705800:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c68df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074169.705859:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580416 00000100:00100000:2.0:1783074169.705863:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580416 00000100:00100000:2.0:1783074169.705934:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783074169.705941:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723580416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074169.706017:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723580416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (237us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074169.706023:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783074169.706083:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723580416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783074169.706160:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783074169.706167:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074169.706177:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074169.774573:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:2.0:1783074169.838376:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 0 seconds 00010000:00010000:1.0:1783074170.478932:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074170.734500:0:92645:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783074170.798400:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:2.0:1783074170.863377:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 0 seconds 00000100:00100000:1.0:1783074170.864185:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074170.864228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074170.864233:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076160 00000100:00100000:2.0:1783074170.864244:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076160 00000100:00100000:1.0:1783074170.864266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074170.864298:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074170.864331:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:2.0:1783074170.864343:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524ee03c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1869685708076160:12345-192.168.204.26@tcp:250:kworker.0 00010000:00080000:2.0:1783074170.864375:0:92367:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp t0 exp 0000000000000000 cur 3010 last 0 00000100:00100000:0.0:1783074170.864376:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076416 00000100:00100000:1.0:1783074170.864383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074170.864384:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076416 00000100:00100000:1.0:1783074170.864418:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076288 00000020:00000080:2.0:1783074170.864419:0:92367:0:(genops.c:1406:class_connect()) connect: client f1623620-a4b0-4769-84e0-0d08c968afe8, cookie 0x5fb609b3016dff12 00000100:00100000:1.0:1783074170.864424:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076288 00000100:00100000:1.0:1783074170.864457:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 849 00000100:00100000:1.0:1783074170.864468:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2403:x1869685708076416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074170.864510:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1274 00000100:00100000:0.0:1783074170.864518:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869685708076288:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:1.0:1783074170.864543:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2403:x1869685708076416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 76us (313us total) trans 0 rc 0/0 00010000:00080000:0.0:1783074170.864548:0:67186:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b' at ffff9523c316e000, cookie 0x5fb609b3016dfd9f 00010000:00080000:0.0:1783074170.864557:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp recovering/t0 exp ffff9523c316e000 cur 3010 last 1783074168 00000100:00100000:1.0:1783074170.864565:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 849 00010000:02000400:0.0:1783074170.864569:0:67186:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1783074170.864580:0:67186:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00080000:2.0:1783074170.864589:0:92367:0:(import.c:65:import_set_state_nolock()) ffff9523c32cb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074170.864601:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076672 00000004:00100000:0.0:1783074170.864606:0:67186:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1783074170.864607:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076672 00000100:00100000:2.0:1783074170.864630:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524ee03c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+5:2401:x1869685708076160:12345-192.168.204.26@tcp:250:kworker.0 Request processed in 287us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074170.864638:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1783074170.864645:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076544 00000100:00100000:1.0:1783074170.864650:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076544 00000100:00100000:1.0:1783074170.864678:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2167 00000100:00100000:1.0:1783074170.864685:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708076672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074170.864715:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708076672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 30us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074170.864721:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2167 00000100:00080000:0.0:1783074170.864883:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074170.864930:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708076288:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 410us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074170.864938:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1274 00000100:00100000:1.0:1783074170.864952:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2168 00000100:00100000:1.0:1783074170.864962:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708076544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:0.0:1783074170.864962:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074170.864969:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074170.864973:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074170.864996:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708076544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 36us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074170.865003:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2168 00000100:00100000:1.0:1783074170.871515:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074170.871813:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076800 00000100:00100000:0.0:1783074170.871823:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076800 00000100:00100000:0.0:1783074170.871932:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1275 00000100:00100000:0.0:1783074170.871944:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708076800:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1783074170.871969:0:66200:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9523c4af1180 x1869685708076800/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:496/0 lens 328/0 e 0 to 0 dl 1783074181 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074170.871995:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708076800:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 54us (489us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074170.872002:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1275 00010000:00080000:3.0:1783074170.872036:0:92395:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:1.0:1783074171.260072:0:92697:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783074171.260297:0:92697:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783074171.504585:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783074171.712276:0:92747:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783074171.712679:0:92747:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783074171.822777:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:2.0:1783074171.886578:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 0 seconds 00000100:00100000:3.0:1783074172.339057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.339219:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708076928 00000100:00100000:2.0:1783074172.339231:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708076928 00000100:00100000:2.0:1783074172.339291:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1783074172.339301:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524ee03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+5:70871:x1869685708076928:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074172.339339:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074172.339357:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7400/0x5fb609b3016dff19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1ee expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.339388:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7400/0x5fb609b3016dff19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1ee expref: 6 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.339401:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7400/0x5fb609b3016dff19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1ee expref: 6 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.339411:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7400, rc 0) 00000100:00100000:2.0:1783074172.339493:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524ee03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708076928:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 194us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.339501:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:1.0:1783074172.342213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.342994:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077056 00000100:00100000:2.0:1783074172.343008:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077056 00000100:00100000:2.0:1783074172.343085:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:2.0:1783074172.343117:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb7ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708077056:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074172.343153:0:92369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1783074172.343176:0:92369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074172.343181:0:92369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783074172.343186:0:92369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783074172.343189:0:92369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783074172.343191:0:92369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:2.0:1783074172.346499:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb7ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708077056:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 3303us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.346517:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:1.0:1783074172.350509:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.350657:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077184 00000100:00100000:2.0:1783074172.350671:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077184 00000100:00100000:2.0:1783074172.350743:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1783074172.350756:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708077184:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074172.350778:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074172.350798:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1f5 expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.350831:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 7 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.350922:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 7 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.350933:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7e00, rc 0) 00000100:00100000:2.0:1783074172.351061:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+7:70871:x1869685708077184:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 307us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.351069:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:1.0:1783074172.357203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.357420:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077312 00000100:00100000:2.0:1783074172.357434:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077312 00000100:00100000:2.0:1783074172.357616:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:2.0:1783074172.357628:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+7:70871:x1869685708077312:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074172.358007:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708077312:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 380us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.358017:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1783074172.363452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.363683:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077440 00000100:00100000:2.0:1783074172.363696:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077440 00000100:00100000:2.0:1783074172.363806:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:2.0:1783074172.363820:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708077440:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074172.364028:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708077440:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 211us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.364037:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:1.0:1783074172.368551:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.368761:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077568 00000100:00100000:2.0:1783074172.368774:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077568 00000100:00100000:2.0:1783074172.368852:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:2.0:1783074172.368878:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708077568:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074172.368901:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074172.368921:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7200/0x5fb609b3016dff27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1fc expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.368957:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7200/0x5fb609b3016dff27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1fc expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.368969:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7200/0x5fb609b3016dff27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1fc expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074172.369003:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7200, rc 0) 00000100:00100000:2.0:1783074172.369138:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708077568:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 276us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.369147:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:1.0:1783074172.377722:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.379676:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077696 00000100:00100000:2.0:1783074172.379696:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077696 00000100:00100000:2.0:1783074172.380967:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1783074172.380993:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708077696:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074172.382033:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708077696:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 1044us (4321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.382046:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1783074172.384300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.384414:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077824 00000100:00100000:2.0:1783074172.384426:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077824 00000100:00100000:2.0:1783074172.384497:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:2.0:1783074172.384509:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708077824:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074172.384740:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708077824:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 233us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074172.384750:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1783074172.393094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074172.393211:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708077952 00000100:00100000:3.0:1783074172.393224:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708077952 00000100:00100000:3.0:1783074172.393294:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1783074172.393305:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708077952:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074172.393370:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074172.393405:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b203 expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074172.393439:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 10 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074172.393451:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 10 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074172.393462:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd600, rc 0) 00000100:00100000:3.0:1783074172.393535:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708077952:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 232us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074172.393542:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1783074172.395924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074172.396132:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708078080 00000100:00100000:2.0:1783074172.396145:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708078080 00000100:00100000:2.0:1783074172.396219:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1783074172.396231:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708078080:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074172.396412:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708078080:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 183us (502us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074172.396507:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00010000:00010000:1.0:1783074172.531088:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074172.847004:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:2.0:1783074172.911260:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 0 seconds 00000100:00100000:0.0:1783074173.358701:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723580672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074173.358718:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723580544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074173.358982:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.359034:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580544 00000100:00100000:1.0:1783074173.359044:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580544 00000100:00100000:1.0:1783074173.359122:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:1.0:1783074173.359134:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723580544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074173.359172:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074173.359304:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723580544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074173.359336:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:3.0:1783074173.359411:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723580544:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783074173.359512:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783074173.360098:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074173.360212:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580672 00000100:00100000:2.0:1783074173.360218:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580672 00000100:00100000:2.0:1783074173.360334:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:2.0:1783074173.360347:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723580672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783074173.360373:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074173.360429:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723580672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.360436:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1783074173.360486:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723580672:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783074173.360501:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783074173.552163:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074173.871043:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074173.871052:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074173.871056:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074173.871071:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074173.871101:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df3b9c00 x1869685723580928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074173.871127:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074173.871130:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074173.871132:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074173.871136:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074173.871146:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df3bad80 x1869685723581184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074173.871170:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074173.871173:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074173.871174:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074173.871179:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074173.871192:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4679c00 x1869685723581440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074173.871213:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074173.871216:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074173.871218:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074173.871240:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074173.871253:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f4679880 x1869685723581824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783074173.871279:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783074173.871282:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783074173.871284:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074173.871288:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524c4b3a000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074173.871298:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f467b480 x1869685723582336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074173.871368:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723581056:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.871456:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.871499:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723581952:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.871526:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.871554:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783074173.871560:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723580800:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.871593:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.871621:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723581696:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.871645:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.871678:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581056 00000100:00100000:0.0:1783074173.871688:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581056 00000100:00100000:2.0:1783074173.871745:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580800 00000100:00100000:2.0:1783074173.871751:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580800 00000100:00100000:0.0:1783074173.871756:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1783074173.871769:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723581056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074173.871783:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783074173.871791:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723580800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.871834:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723581056:12345-0@lo:400:kworker.0 Request processed in 67us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.871853:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723580800:12345-0@lo:400:kworker.0 Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.871857:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1783074173.871863:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783074173.871900:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581952 00000100:00100000:0.0:1783074173.871905:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581952 00000100:00100000:0.0:1783074173.871937:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:0.0:1783074173.871946:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.871986:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723581952:12345-0@lo:400:kworker.0 Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.871992:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:0.0:1783074173.872041:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723580800:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.872055:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723581056:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.872065:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723581952:0@lo:400:kworker.0 00000100:00100000:2.0:1783074173.872127:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581696 00000100:00100000:2.0:1783074173.872131:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581696 00000100:00100000:2.0:1783074173.872207:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:2.0:1783074173.872213:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723581696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783074173.872247:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074173.872302:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723581696:12345-0@lo:400:kworker.0 Request processed in 89us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.872307:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1783074173.872621:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723581312:0@lo:400:kworker.0 00000100:00100000:3.0:1783074173.872659:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074173.872701:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723582080:0@lo:400:kworker.0 00000100:00100000:3.0:1783074173.872734:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074173.872759:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783074173.872765:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723581568:0@lo:400:kworker.0 00000100:00100000:3.0:1783074173.872788:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074173.872810:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723582208:0@lo:400:kworker.0 00000100:00100000:3.0:1783074173.872861:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074173.872896:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582080 00000100:00100000:3.0:1783074173.872900:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582080 00000100:00100000:3.0:1783074173.872940:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581568 00000100:00100000:3.0:1783074173.872944:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581568 00000100:00100000:3.0:1783074173.872965:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582208 00000100:00100000:3.0:1783074173.872968:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582208 00000100:00100000:1.0:1783074173.873198:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723580928:0@lo:38:kworker.0 00000100:00100000:1.0:1783074173.873238:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.873260:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723581184:0@lo:38:kworker.0 00000100:00100000:3.0:1783074173.873263:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1783074173.873277:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723582080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074173.873291:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.873336:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723581440:0@lo:38:kworker.0 00000100:00100000:3.0:1783074173.873347:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723582080:12345-0@lo:400:kworker.0 Request processed in 73us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074173.873367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.873419:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723581696:0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.873437:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074173.873443:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723582464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074173.873492:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581312 00000100:00100000:0.0:1783074173.873496:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581312 00000100:00100000:0.0:1783074173.873523:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723580928 00000100:00100000:0.0:1783074173.873526:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723580928 00000100:00100000:0.0:1783074173.873537:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581184 00000100:00100000:0.0:1783074173.873540:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581184 00000100:00100000:0.0:1783074173.873549:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1783074173.873555:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074173.873587:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723581312:12345-0@lo:400:kworker.0 Request processed in 32us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.873593:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1783074173.873607:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1783074173.873620:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723580928:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074173.873650:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00010000:00080000:0.0:1783074173.873651:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3013 last 0 00000100:00100000:2.0:1783074173.873670:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723581568:12345-0@lo:400:kworker.0 00000020:00000080:0.0:1783074173.873702:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016dff35 00000100:00100000:2.0:1783074173.873712:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723581568:12345-0@lo:400:kworker.0 Request processed in 45us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.873720:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000004:00100000:0.0:1783074173.873720:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783074173.873731:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723581824:0@lo:38:kworker.0 00000100:00100000:2.0:1783074173.873742:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:2.0:1783074173.873752:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723582208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074173.873762:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.873776:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723582336:0@lo:38:kworker.0 00000100:00100000:2.0:1783074173.873796:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723582208:12345-0@lo:400:kworker.0 Request processed in 46us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.873807:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:1.0:1783074173.873807:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074173.873831:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074173.873848:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074173.873850:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074173.873912:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9523c6cab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074173.874208:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581824 00000100:00100000:1.0:1783074173.874213:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581824 00000100:00100000:1.0:1783074173.874228:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582336 00000100:00100000:1.0:1783074173.874230:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582336 00000100:00100000:1.0:1783074173.874240:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:1.0:1783074173.874245:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723581184:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783074173.874260:0:68632:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3013 last 0 00000020:00000080:1.0:1783074173.874298:0:68632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb609b3016dff3c 00000100:00100000:2.0:1783074173.874380:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723581568:0@lo:400:kworker.0 00000100:00100000:2.0:1783074173.874410:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723582208:0@lo:400:kworker.0 00000100:00100000:2.0:1783074173.874424:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723581312:0@lo:400:kworker.0 00000100:00100000:2.0:1783074173.874437:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723582080:0@lo:400:kworker.0 00000100:00100000:2.0:1783074173.874511:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723581440 00000100:00100000:2.0:1783074173.874519:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723581440 00000100:00100000:2.0:1783074173.874564:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:2.0:1783074173.874572:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723581440:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783074173.874601:0:8454:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9523c6942000, cookie 0x5fb609b3016dfd98 00010000:00080000:2.0:1783074173.874607:0:8454:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9523c6942000 cur 3013 last 1783074168 00000004:00100000:2.0:1783074173.874626:0:8454:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783074173.874660:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9523cd177000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074173.874757:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00010000:00080000:3.0:1783074173.874790:0:92395:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1783074173.874797:0:92395:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 115964116998 00000020:00080000:3.0:1783074173.874801:0:92395:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074173.874805:0:92395:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116998 00000020:00080000:3.0:1783074173.874809:0:92395:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074173.874810:0:92395:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116998 00000100:00100000:3.0:1783074173.874876:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 0 seconds 00000100:00100000:2.0:1783074173.874963:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723581440:12345-0@lo:38:kworker.0 Request processed in 388us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074173.874987:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1783074173.874987:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723580928:12345-0@lo:38:kworker.0 Request processed in 1359us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074173.874999:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723581824:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074173.875002:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00010000:00080000:3.0:1783074173.875024:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3013 last 0 00000100:00100000:0.0:1783074173.875026:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1783074173.875035:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723582336:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783074173.875053:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3013 last 0 00000020:00000080:3.0:1783074173.875060:0:67186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb609b3016dff43 00000004:00100000:3.0:1783074173.875071:0:67186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783074173.875077:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000020:00000080:0.0:1783074173.875086:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb609b3016dff4a 00000004:00100000:0.0:1783074173.875098:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783074173.875102:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524f7804800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783074173.875125:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9523c6ca9800 : changing import state from RECOVER to FULL 00000004:00100000:1.0:1783074173.875162:0:68632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783074173.875163:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074173.875175:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869685723581824:12345-0@lo:38:kworker.0 Request processed in 171us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.875195:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723582336:12345-0@lo:38:kworker.0 Request processed in 155us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074173.875200:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1783074173.875212:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1783074173.875217:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582464 00000100:00100000:2.0:1783074173.875222:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582464 00000100:00080000:1.0:1783074173.875272:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524de7c6800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1783074173.875285:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524df3b9c00 x1869685723580928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074173.875301:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:1.0:1783074173.875322:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869685723581184:12345-0@lo:38:kworker.0 Request processed in 1062us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074173.875329:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1783074173.875424:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:2.0:1783074173.875437:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723582464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783074173.875470:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:2.0:1783074173.875530:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723582464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.875538:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:3.0:1783074173.875659:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723582464:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783074173.876121:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9524df3b9c00 x1869685723580928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074198 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074173.876131:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074173.876136:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074173.876140:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074173.876154:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723580928:0@lo:38:kworker.0 00010000:00080000:0.0:1783074173.876176:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524df3bad80 x1869685723581184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074173.876188:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:0.0:1783074173.879712:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9524df3bad80 x1869685723581184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074198 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074173.879727:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783074173.879733:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783074173.879738:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783074173.879744:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723581184:0@lo:38:kworker.0 00000100:00080000:0.0:1783074173.879798:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:0.0:1783074173.879814:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783074173.879818:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783074173.879821:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116997 gen 3 00000100:00080000:0.0:1783074173.879825:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9524f0d24800 from lustre-MDT0000_UUID committed 115964116997 last 0 00000100:00080000:0.0:1783074173.879827:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1783074173.880773:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723581440:0@lo:38:kworker.0 00010000:00080000:1.0:1783074173.880800:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f4679880 x1869685723581824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074173.880815:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:1.0:1783074173.881709:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9524f4679880 x1869685723581824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074198 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074173.881720:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783074173.881724:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783074173.881728:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783074173.881735:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001a72bffa): req@ffff9524c6cf5c00 x1869685723570176/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074173.881766:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723581824:0@lo:38:kworker.0 00010000:00080000:1.0:1783074173.881790:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524f467b480 x1869685723582336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074173.881801:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:1.0:1783074173.881807:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783074173.881811:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783074173.881813:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783074173.881850:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723582336:0@lo:38:kworker.0 00010000:00080000:0.0:1783074173.883432:0:92760:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1783074173.883439:0:92760:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1783074173.883446:0:92760:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1783074173.883897:0:92760:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1783074173.883974:0:66209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074173.884018:0:66209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074173.884075:0:66207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723570176 00000100:00100000:2.0:1783074173.884083:0:66207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723570176 00000100:00100000:2.0:1783074173.884140:0:66207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783074173.884149:0:66207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66209:x1869685723570176:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:2.0:1783074173.884169:0:66207:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff9523c53f9500 x1869685723570176/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:499/0 lens 264/0 e 0 to 0 dl 1783074184 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074173.885000:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723582592:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783074173.885052:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074173.885135:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582592 00000100:00100000:2.0:1783074173.885140:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582592 00000100:00100000:2.0:1783074173.885180:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:2.0:1783074173.885188:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723582592:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783074173.885210:0:8454:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524fc494380 x1869685723582592/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:499/0 lens 224/0 e 0 to 0 dl 1783074184 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074173.885231:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723582592:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 44us (179us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074173.885247:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000020:00080000:3.0:1783074173.885326:0:92395:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074173.885332:0:92395:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116998 00010000:00080000:3.0:1783074173.885336:0:92395:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1783074173.885341:0:92395:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783074173.885351:0:92395:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783074173.885354:0:92395:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783074173.885365:0:92395:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9523c4af1180 x1869685708076800/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:496/0 lens 328/0 e 0 to 0 dl 1783074181 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783074173.885382:0:92395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074173.885415:0:92395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b1c4 expref: -99 pid: 92395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.885442:0:92395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 92395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.885460:0:92395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 92395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.885469:0:92395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc600, rc 0) 00010000:00080000:3.0:1783074173.885583:0:92395:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1783074173.885599:0:92395:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 40000000:02000000:2.0:1783074173.891995:0:66207:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:3.0:1783074173.892995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074173.893710:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708078208 00000100:00100000:0.0:1783074173.893725:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708078208 00000100:00100000:0.0:1783074173.893802:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 852 00000100:00100000:0.0:1783074173.893813:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2401:x1869685708078208:12345-192.168.204.26@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1783074173.893869:0:66202:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9523c47b5880 x1869685708078208/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:499/0 lens 224/0 e 0 to 0 dl 1783074184 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074173.893904:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2401:x1869685708078208:12345-192.168.204.26@tcp:400:ptlrpcd_rcv.0 Request processed in 92us (917us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074173.893912:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 852 00010000:00080000:1.0:1783074173.894017:0:92395:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1783074173.894174:0:92395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000100:00100000:2.0:1783074173.901162:0:66207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66209:x1869685723570176:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 17005us (17182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.901177:0:66207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783074173.901335:0:66209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf5c00 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:66209:1869685723570176:0@lo:700:mdt_seqm_0000.0 40000000:02000000:3.0:1783074173.901350:0:66209:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:1.0:1783074173.906777:0:92362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:1.0:1783074173.906787:0:92362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783074173.907080:0:92395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1783074173.907125:0:92395:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00000100:00100000:3.0:1783074173.907128:0:66209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708073216:12345-192.168.204.26@tcp:700:cp.0 Request processed in 6101517us (6101649us total) trans 0 rc 0/0 00010000:00080000:2.0:1783074173.907137:0:92395:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9524fc494380 x1869685723582592/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:499/0 lens 224/0 e 0 to 0 dl 1783074184 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074173.907146:0:66209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00010000:00080000:2.0:1783074173.907308:0:92395:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.26@tcp: req@ffff9523c47b5880 x1869685708078208/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:499/0 lens 224/0 e 0 to 0 dl 1783074184 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074173.907488:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1783074173.907496:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9524df769180 x1869685723582592/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074189 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074173.907506:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9524df769180 x1869685723582592/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074189 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074173.907522:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783074173.907534:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1783074173.907539:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004d630abb): req@ffff9524fc494a80 x1869685723565568/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074172 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074173.907553:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000090a74ac8): req@ffff9524c6cf7480 x1869685723567488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074173.907567:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723582592:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783074173.907622:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723582720:0@lo:41:osp-pre-0-1.0 00010000:02000000:2.0:1783074173.907703:0:92395:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:1.0:1783074173.907712:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.907749:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723565568 00000100:00100000:1.0:1783074173.907756:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723565568 00000100:00100000:1.0:1783074173.907790:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1783074173.907799:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723565568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074173.907895:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444708352 avail 1298468864 00000100:00100000:1.0:1783074173.907941:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1869685723565568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074173.907947:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1783074173.907974:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723565568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074173.908894:0:75614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.909088:0:75614:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cab240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074173.909103:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.909377:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723567488 00000100:00100000:1.0:1783074173.909382:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723567488 00000100:00100000:1.0:1783074173.909464:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582720 00000100:00100000:1.0:1783074173.909468:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582720 00000100:00100000:0.0:1783074173.909505:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:0.0:1783074173.909523:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75614:x1869685723567488:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:0.0:1783074173.909601:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75614:x1869685723567488:12345-0@lo:1000:dist_txn-1.0 Request processed in 89us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.909607:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:0.0:1783074173.909622:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1783074173.909629:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723582720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783074173.909643:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444708352 avail 1298468864 00000100:00100000:0.0:1783074173.909675:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869685723582720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.909681:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1783074173.909716:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723582720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074173.909743:0:75614:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:75614:1869685723567488:0@lo:1000:dist_txn-1.0 00000004:00080000:0.0:1783074173.909778:0:75614:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9524d2cab480 with version 8 00000020:00080000:0.0:1783074173.909790:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444082 cancel update log [0x20000cf21:0x1:0x0].1: rc = 0 00000020:00080000:0.0:1783074173.909887:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444082 cancel update log [0x2400088d4:0x1:0x0].1: rc = 0 00000020:00080000:0.0:1783074173.909908:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444082 00000004:00080000:0.0:1783074173.909917:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 8 rpc_version 8 00000020:00100000:0.0:1783074173.909938:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783074173.909945:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9524df768e00 x1869685723582976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074173.909962:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723582976:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783074173.909988:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.910002:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074173.910014:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723582976 00000100:00100000:0.0:1783074173.910017:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723582976 00000100:00100000:0.0:1783074173.910034:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:0.0:1783074173.910040:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75600:x1869685723582976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783074173.910405:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074173.910593:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75600:x1869685723582976:12345-0@lo:1000:osp_up0-1.0 Request processed in 552us (604us total) trans 120259084289 rc 0/0 00000100:00100000:0.0:1783074173.910599:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:0.0:1783074173.910619:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708078464 00000100:00100000:0.0:1783074173.910622:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708078464 00000100:00100000:0.0:1783074173.910657:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1280 00000100:00100000:0.0:1783074173.910663:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708078464:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:0.0:1783074173.910674:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074173.910695:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299a00/0x5fb609b3016dff58 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b20a expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.910776:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.910785:0:66201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.910801:0:66201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.910813:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66201:1869685723583104:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1783074173.910855:0:66201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.910871:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1783074173.910888:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074173.910897:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723583104 00000100:00100000:0.0:1783074173.910901:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723583104 00000100:00100000:0.0:1783074173.910924:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1783074173.910930:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66201:x1869685723583104:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783074173.910937:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074173.910950:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016dff66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dff5f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.910972:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016dff66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dff5f expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.910988:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016dff66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dff5f expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.910996:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:0.0:1783074173.910999:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074173.911003:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299400, rc 0) 00000100:00100000:0.0:1783074173.911029:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66201:x1869685723583104:12345-0@lo:101:mdt00_001.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.911034:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1783074173.911069:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66201:1869685723583104:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783074173.911082:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dff66 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911092:0:66201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dff66 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074173.911107:0:66201:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783074173.911114:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dff66 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911121:0:66201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dff66 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911165:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911174:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911183:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911195:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911203:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.911210:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.911350:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66201:1869685723583232:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783074173.911375:0:66201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074173.911388:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074173.911402:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723583232 00000100:00100000:0.0:1783074173.911405:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723583232 00000100:00100000:0.0:1783074173.911425:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:0.0:1783074173.911431:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66201:x1869685723583232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783074173.911485:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66201:x1869685723583232:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.911493:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:0.0:1783074173.911517:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66201:1869685723583232:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783074173.911885:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723582976:0@lo:1000:osp_up0-1.0 00000001:00100000:3.0:1783074173.912488:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:0.0:1783074173.912718:0:66201:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x89:0x0], count =409 00000004:00080000:0.0:1783074173.912726:0:66201:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x89:0x0]+409 in llog 00000004:00080000:0.0:1783074173.912744:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x222:0x0], index 0: 0 00010000:00010000:0.0:1783074173.912914:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dff7b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.912927:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dff7b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.912935:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dff7b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.912963:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.912969:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.912984:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.912991:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074173.912995:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913003:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913015:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:0.0:1783074173.913017:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074173.913020:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913025:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299800/0x5fb609b3016dff6d lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074173.913036:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030e81ea3 reply state 00000000864a9dca transno 77309411448 ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913044:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913047:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9524c8cd5600) 00010000:00010000:0.0:1783074173.913049:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074173.913051:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074173.913075:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299a00/0x5fb609b3016dff58 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b20a expref: 10 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913084:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dff7b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b20a expref: 9 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.913093:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9524c8cd5500) 00010000:00010000:0.0:1783074173.913095:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074173.913096:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299000, rc 0) 00000100:00100000:0.0:1783074173.913343:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:70957:x1869685708078464:12345-192.168.204.26@tcp:101:cp.0 Request processed in 2679us (2940us total) trans 77309411448 rc 0/0 00000100:00100000:0.0:1783074173.913349:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1280 00000100:00100000:3.0:1783074173.919374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074173.919437:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708078592 00000100:00100000:1.0:1783074173.919456:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708078592 00000100:00100000:1.0:1783074173.919522:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4923 00000100:00100000:1.0:1783074173.919530:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708078592:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:1.0:1783074173.919547:0:8487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074173.919575:0:8487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b211 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.919593:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.919610:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.919613:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.919622:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 6 pid: 8487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.919638:0:8487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 6 pid: 8487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.919649:0:8487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28ee00, rc 0) 00000100:00100000:1.0:1783074173.919722:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708078592:12345-192.168.204.26@tcp:101:cp.0 Request processed in 191us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074173.919728:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4923 00000100:00080000:0.0:1783074173.919791:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074173.923069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074173.923188:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708078720 00000100:00100000:3.0:1783074173.923204:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708078720 00000100:00100000:3.0:1783074173.923271:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4924 00000100:00100000:3.0:1783074173.923280:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:70957:x1869685708078720:12345-192.168.204.26@tcp:101:cp.0 00010000:00010000:3.0:1783074173.923424:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074173.923442:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b218 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.923474:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.923483:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.923487:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.923491:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.923581:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.923592:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074173.923604:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1869685723583360:192.168.204.26@tcp:104: 00000100:00100000:3.0:1783074173.923738:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074173.926076:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8445:1869685723583360:192.168.204.26@tcp:104: 00000100:00100000:3.0:1783074173.926077:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1783074173.926126:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.926150:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc800, rc 0) 00000100:00100000:0.0:1783074173.926269:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:70957:x1869685708078720:12345-192.168.204.26@tcp:101:cp.0 Request processed in 2989us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.926278:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4924 00000100:00100000:1.0:1783074173.926974:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708078848 00000100:00100000:1.0:1783074173.926981:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708078848 00010000:00010000:1.0:1783074173.927083:0:19658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074173.927110:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2584 00000100:00100000:1.0:1783074173.927118:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2404:x1869685708078848:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074173.927132:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074173.927153:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.927176:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.927195:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd4b52e/0x5fb609b3016dff89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b211 expref: 7 pid: 8487 timeout: 3113 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.927208:0:19658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.927212:0:19658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.927220:0:19658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.927231:0:19658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.927267:0:19658:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074173.927279:0:19658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:19658:1869685723583488:192.168.204.26@tcp:105: 00000100:00100000:1.0:1783074173.927366:0:19658:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9cc0 going to sleep for 11 seconds 00000004:00000080:3.0:1783074173.930662:0:92395:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc8083e10 00100000:10000000:3.0:1783074173.930677:0:92395:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1783074173.931559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074173.931588:0:19658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:19658:1869685723583488:192.168.204.26@tcp:105: 00000100:00100000:0.0:1783074173.931616:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708079104 00010000:00010000:2.0:1783074173.931621:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074173.931685:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708078848:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 4566us (5618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074173.931697:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2584 00000004:00080000:2.0:1783074173.931737:0:92381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:2.0:1783074173.931777:0:92381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92381:1869685723583616:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783074173.931847:0:92381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074173.931892:0:92381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109eb40 going to sleep for 11 seconds 00000004:00080000:2.0:1783074173.931917:0:92383:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:2.0:1783074173.931940:0:92383:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92383:1869685723583744:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783074173.931987:0:92383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074173.932007:0:92383:0:(client.c:2701:ptlrpc_set_wait()) set ffff952502143300 going to sleep for 11 seconds 00000100:00100000:2.0:1783074173.932025:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723583616 00000100:00100000:2.0:1783074173.932031:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723583616 00000100:00100000:0.0:1783074173.932037:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708079104 00000100:00100000:2.0:1783074173.932074:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723583744 00000100:00100000:2.0:1783074173.932079:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723583744 00000100:00100000:2.0:1783074173.932108:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925 00000100:00100000:2.0:1783074173.932133:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:92381:x1869685723583616:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783074173.932158:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 231 00002000:00080000:2.0:1783074173.932170:0:26178:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -62 00000100:00100000:0.0:1783074173.932173:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4207c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:70957:x1869685708079104:12345-192.168.204.26@tcp:35:cp.0 00002000:02000040:2.0:1783074173.932179:0:26178:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1889) 00000001:00080000:0.0:1783074173.932519:0:80537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411449 00000100:00100000:0.0:1783074173.932624:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4207c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:70957:x1869685708079104:12345-192.168.204.26@tcp:35:cp.0 Request processed in 456us (1073us total) trans 77309411450 rc 0/0 00000100:00100000:0.0:1783074173.932633:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 231 00000020:00080000:0.0:1783074173.932649:0:80537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783074173.932725:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926 00000100:00100000:1.0:1783074173.932741:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:92383:x1869685723583744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783074173.932759:0:26174:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -63 00002000:02000040:1.0:1783074173.932763:0:26174:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1889) 00002000:00010000:0.0:1783074173.938335:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.938350:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938370:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.938375:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.938382:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938398:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938410:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938419:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938440:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783074173.938552:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.938557:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938565:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.938568:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.938572:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938609:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938617:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938626:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938646:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783074173.938688:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.938692:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938701:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.938704:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.938708:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938717:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938725:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938745:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938759:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783074173.938815:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.938821:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938829:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.938832:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.938848:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938857:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938865:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938872:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938885:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783074173.938924:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.938930:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938943:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.938946:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.938950:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938959:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938968:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938976:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.938985:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783074173.939023:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.939028:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939036:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.939039:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.939043:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939052:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939072:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939080:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939089:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1783074173.939131:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.939136:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939144:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.939147:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.939151:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939160:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939168:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939175:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939195:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1783074173.939233:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.939238:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939246:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.939248:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.939252:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939261:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939269:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939277:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.939286:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1783074173.940089:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783074173.940105:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940138:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940143:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940154:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940176:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940184:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bbfac54/0x5fb609b3016dff97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940217:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783074173.940221:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940228:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940232:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940240:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940249:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940262:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea1e31c/0x5fb609b3016dff9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940278:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074173.940282:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940289:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbe00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940292:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940301:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940330:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940338:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016dffa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940352:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783074173.940356:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940362:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940372:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940381:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940391:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940399:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016dffac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940414:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783074173.940418:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940425:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dae00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940428:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940436:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940446:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940455:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016dffb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940477:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783074173.940481:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940488:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dba00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940492:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940500:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940511:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940518:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016dffba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940531:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074173.940535:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940542:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940546:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940565:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940576:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940584:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016dffc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940599:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074173.940603:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940610:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.940613:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940620:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940645:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940653:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016dffc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.940678:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.940680:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.940682:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.940744:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.940751:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.941042:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783074173.941194:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.941203:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.941218:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.941231:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.941238:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.941250:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.941260:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.941268:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.941282:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074173.941398:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074173.941406:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.941416:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.941421:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.941430:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.941445:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.941454:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016dffcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.941485:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.941491:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.941495:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783074173.942139:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074173.942152:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942164:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.942167:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074173.942172:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942184:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942194:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942205:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942286:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074173.942458:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.942466:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942472:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074173.942481:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.942482:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942492:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074173.942507:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.942508:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942517:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942527:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942533:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942552:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942564:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942566:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942596:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c3b393/0x5fb609b3016dffd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942613:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074173.942617:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074173.942623:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942630:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.942633:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942654:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942666:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942674:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008872f5b0/0x5fb609b3016dffdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942688:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.942690:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.942692:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074173.942756:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.942763:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942772:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.942775:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.942779:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942800:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942808:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942816:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942844:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074173.942884:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.942890:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942898:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.942901:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.942905:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942915:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942916:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074173.942927:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942931:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942954:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.942960:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.942993:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.942996:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943041:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943042:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783074173.943060:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074173.943068:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943076:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016dffe4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943084:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.943091:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943104:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943105:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.943110:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.943115:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.943127:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943136:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f50317f/0x5fb609b3016dffeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943155:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.943157:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.943159:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074173.943216:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.943227:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943235:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.943238:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.943242:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943251:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943259:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943267:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943283:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074173.943341:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1783074173.943347:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074173.943348:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943359:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943367:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.943377:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943379:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.943393:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.943408:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943410:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943444:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943450:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943468:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943477:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943492:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074173.943518:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016dfff2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.943530:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.943539:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943541:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074173.943550:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943555:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.943561:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.943575:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943581:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.943588:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943594:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943610:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943615:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943633:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943641:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016dfff9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.943656:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.943657:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.943659:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.943666:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.943850:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.943911:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.943944:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074173.944042:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074173.944049:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.944058:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bda00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.944063:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.944084:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.944095:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.944103:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e6c1112/0x5fb609b3016e0000 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.944121:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.944124:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.944125:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074173.944130:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.944138:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944147:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.944150:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.944155:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944164:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944172:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944181:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944203:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074173.944251:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1783074173.944264:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.944269:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944272:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944307:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.944348:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.944353:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944361:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.944368:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944369:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.944383:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944388:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944410:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944414:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944427:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944435:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944536:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783074173.944544:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783074173.944592:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.944601:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944611:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.944615:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.944620:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944629:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074173.944637:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.944645:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.944662:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944669:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944669:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.944671:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.944675:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944684:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.944700:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944730:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944730:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944731:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944742:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944776:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944788:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.944788:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944788:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0007 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944851:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783074173.944855:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074173.944860:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944868:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.944871:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944879:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944894:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944901:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e0015 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.944913:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.944918:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074173.944922:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944924:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.944955:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.944956:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ec00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.944960:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.944966:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.944970:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945000:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945001:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945033:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945044:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945054:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783074173.945093:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.945098:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945113:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.945116:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.945120:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945130:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945138:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945145:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945153:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783074173.945189:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.945194:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945201:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.945203:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.945208:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945216:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945235:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945243:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945252:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783074173.945287:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.945292:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945300:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.945303:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.945307:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945363:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945379:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bec9c230/0x5fb609b3016e000e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945392:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945401:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783074173.945411:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945429:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1783074173.945444:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945445:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.945451:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945471:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945477:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945494:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945503:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1783074173.945506:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e001c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.945575:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1783074173.945581:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.945584:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945592:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945597:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.945597:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783074173.945613:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074173.945615:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945618:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.945622:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945628:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783074173.945634:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.945644:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945653:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.945663:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.945677:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945681:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945686:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.945688:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945699:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.945725:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945733:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945746:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.945773:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945784:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945809:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945810:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.945825:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783074173.945858:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e002a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945858:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945869:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1783074173.945902:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e0031 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.945927:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.945928:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074173.945934:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783074173.945935:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945935:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.945942:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.945969:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.945970:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.945974:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.945976:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.945978:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.945979:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.945987:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946013:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.946015:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.946022:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946027:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946035:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946052:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.946052:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3177393/0x5fb609b3016e0023 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946063:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783074173.946064:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074173.946066:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946072:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946072:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.946084:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946113:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946130:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.946132:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.946134:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946136:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946162:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.946185:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946197:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.946197:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0038 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946229:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e003f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.946237:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946243:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783074173.946277:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783074173.946280:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074173.946286:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946295:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.946299:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946336:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946347:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946355:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e0046 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946378:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074173.946382:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946389:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ee00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.946392:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946401:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946411:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946418:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd4b52e/0x5fb609b3016e004d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946449:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074173.946453:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946461:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.946465:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946514:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.946518:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074173.946528:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946529:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.946544:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.946546:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.946548:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.946563:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074173.946622:0:26178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e005b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.946712:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.946720:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.946731:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.946741:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.946746:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.946758:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.946759:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946774:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.946780:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946795:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.946799:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946801:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.946819:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074173.946841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:3.0:1783074173.946850:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946870:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946879:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074173.946886:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708079232 00000100:00100000:2.0:1783074173.946898:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708079232 00010000:00010000:1.0:1783074173.946913:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783074173.946921:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1783074173.946967:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1281 00002000:00010000:1.0:1783074173.946975:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783074173.946982:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71222:x1869685708079232:12345-192.168.204.26@tcp:101:rm.0 00002000:00010000:3.0:1783074173.946986:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.946988:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.946995:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947004:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074173.947006:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.947011:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.947016:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947024:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016e007e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b21f expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947027:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947046:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947062:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947081:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.947097:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.947112:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783074173.947112:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947132:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947142:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947158:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947170:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783074173.947176:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.947184:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947193:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.947198:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.947203:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947213:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783074173.947216:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947219:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.947226:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.947246:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947252:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.947256:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947259:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947279:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947348:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.947353:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783074173.947354:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.947366:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947378:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947388:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.947411:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074173.947433:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947434:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947466:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.947481:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.947486:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947497:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947505:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947508:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947546:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947547:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783074173.947558:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947574:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1783074173.947574:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085ca0ca2/0x5fb609b3016e0062 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947601:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783074173.947607:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.947613:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074173.947617:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.947624:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947626:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947636:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947656:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.947662:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074173.947663:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947669:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947689:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e0069 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947698:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.947712:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.947718:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947730:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947752:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074173.947762:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947771:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947772:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.947780:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.947789:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947790:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.947808:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947818:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783074173.947828:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947850:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947856:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947864:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947867:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e0077 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947888:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947892:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074173.947899:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947902:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783074173.947911:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.947917:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.947937:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074173.947943:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074173.947951:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.947953:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.947968:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074173.947994:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048154fa0/0x5fb609b3016e0070 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.947995:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948017:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:3.0:1783074173.948020:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074173.948022:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783074173.948025:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948031:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948037:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948055:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948060:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.948066:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948068:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948084:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948089:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783074173.948101:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948110:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6bc60d/0x5fb609b3016e0085 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074173.948131:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074173.948137:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783074173.948139:0:26178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948143:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948162:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fe00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074173.948166:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:2.0:1783074173.948167:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948173:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074173.948182:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948183:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948208:0:26178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948209:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948230:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c598ddd/0x5fb609b3016e008c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948231:0:26178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948248:0:26178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948250:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074173.948256:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.948264:0:26178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783074173.948266:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.948271:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948290:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948301:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948308:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737f9cac/0x5fb609b3016e0093 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948503:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074173.948507:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948513:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.948516:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948524:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948534:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948542:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e009a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948566:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074173.948570:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948577:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.948580:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948587:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948597:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948604:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1995897/0x5fb609b3016e00a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948617:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074173.948621:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948627:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.948631:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948650:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948660:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948668:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e2c8500/0x5fb609b3016e00af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948680:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074173.948683:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948691:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074173.948694:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948702:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948711:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948718:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f89274bb/0x5fb609b3016e00b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.948743:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.948745:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.948747:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074173.948760:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783074173.949414:0:68632:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2218us 00010000:00010000:0.0:1783074173.949900:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.949907:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.949919:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.949941:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.949951:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000871c5b2d/0x5fb609b3016e0054 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.949994:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.949997:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.950000:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783074173.950215:0:26178:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00010000:00010000:0.0:1783074173.950275:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783074173.950359:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783074173.950370:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:92381:x1869685723583616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18248us (18527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074173.950381:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925 00000100:00100000:3.0:1783074173.950437:0:92381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92381:1869685723583616:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783074173.950455:0:92381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x723:0x0] 00010000:00010000:1.0:1783074173.950639:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.950644:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.950651:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950665:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950688:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950696:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950716:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.950727:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.950731:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950738:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.950741:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950750:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950762:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950770:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000628dd99d/0x5fb609b3016e00a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950786:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.950797:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.950800:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.950889:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.950896:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950904:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.950907:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.950911:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950921:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950930:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950938:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950955:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.950964:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.950968:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950975:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.950980:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.950999:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951010:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951016:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000426f50fb/0x5fb609b3016e00bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951029:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951031:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951033:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.951078:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.951083:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951092:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.951096:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.951100:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951109:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951117:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951131:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951145:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074173.951187:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.951192:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951200:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.951203:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.951208:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951216:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951223:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951231:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951245:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783074173.951278:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.951284:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951300:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.951303:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.951327:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951337:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951345:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951352:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951364:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783074173.951371:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783074173.951375:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951382:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.951385:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951392:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951413:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951420:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dae6023/0x5fb609b3016e00c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951433:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074173.951436:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951442:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.951445:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951452:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951461:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951467:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b805ad4/0x5fb609b3016e00cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951478:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.951480:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951491:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.951495:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951502:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951511:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951517:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9ba0869/0x5fb609b3016e00d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951528:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951530:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951532:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.951569:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.951574:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951582:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.951585:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.951589:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951597:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951610:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951617:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951629:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.951636:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.951639:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951646:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.951649:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951657:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951666:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951673:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7df75d3/0x5fb609b3016e00d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951684:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951692:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951694:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.951729:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.951734:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951742:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.951744:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.951748:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951757:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951764:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951772:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951785:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.951793:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.951798:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951804:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.951809:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951827:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951850:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951858:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d574751e/0x5fb609b3016e00e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951874:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951877:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.951878:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.951926:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.951931:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951940:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.951944:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.951948:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951957:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951966:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.951981:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074173.951995:0:92381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92381:1869685723584000:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783074173.951997:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.952010:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.952015:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952022:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.952026:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952035:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952051:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952059:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be103c0f/0x5fb609b3016e00e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952078:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952080:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952082:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.952127:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.952138:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952147:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.952149:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.952153:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952162:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952169:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952176:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952187:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.952193:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.952197:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952203:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.952206:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952214:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952230:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952237:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc5301/0x5fb609b3016e00ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952250:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952252:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952253:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.952292:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.952298:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952305:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.952323:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.952328:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952337:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952346:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952353:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952375:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.952382:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.952387:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952393:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.952397:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952404:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952416:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952424:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005490d1db/0x5fb609b3016e00f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952441:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952443:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952445:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.952484:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.952489:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952496:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.952504:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.952508:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952517:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952525:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952532:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952544:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.952550:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.952553:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952560:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.952564:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952571:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952581:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952600:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec8983d9/0x5fb609b3016e00fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952613:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952615:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952616:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.952652:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.952657:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952664:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.952667:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.952671:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952680:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952687:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952693:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952703:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.952715:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.952722:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952729:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.952733:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952742:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952757:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952764:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000273af7c6/0x5fb609b3016e0103 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.952786:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952791:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.952794:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.953053:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.953059:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953067:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.953070:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.953074:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953095:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953103:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953110:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953122:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.953128:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.953132:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953138:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.953141:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953149:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953159:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953166:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b20d93c/0x5fb609b3016e010a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953185:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953187:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953189:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.953226:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.953231:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953239:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.953241:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.953245:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953254:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953260:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953267:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953278:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.953284:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.953287:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953303:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.953306:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953333:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953343:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953351:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb872f61/0x5fb609b3016e0111 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953364:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953365:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953367:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.953403:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.953409:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953418:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.953421:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.953426:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953435:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953447:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953454:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953466:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.953473:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.953477:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953483:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.953486:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953493:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953503:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953510:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae1d52e/0x5fb609b3016e0118 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953523:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953530:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953532:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.953572:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.953577:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953585:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.953588:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.953592:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953600:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953614:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953621:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953631:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.953636:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.953640:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.953645:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723583872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783074173.953646:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.953649:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953666:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953677:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953683:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a5cc40/0x5fb609b3016e011f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953695:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953697:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953698:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074173.953716:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1783074173.953738:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.953743:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953750:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.953752:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.953756:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953764:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953772:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.953781:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723583872 00010000:00010000:1.0:1783074173.953783:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.953789:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723583872 00010000:00010000:1.0:1783074173.953794:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074173.953800:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.953803:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953809:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.953812:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953819:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953832:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953851:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2abac64/0x5fb609b3016e0126 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.953857:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00010000:00010000:1.0:1783074173.953868:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074173.953868:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723583872:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783074173.953870:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.953873:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:0.0:1783074173.953897:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00010000:1.0:1783074173.953917:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.953930:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953939:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.953941:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.953945:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.953950:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723583872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074173.953955:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.953957:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00010000:00010000:1.0:1783074173.953962:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953969:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.953981:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074173.953982:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.953986:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.953987:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.953994:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.953998:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.954007:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.954034:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.954042:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc885ca3/0x5fb609b3016e012d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.954072:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.954076:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.954080:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783074173.954928:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.954936:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.954946:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.954950:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.954954:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.954979:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.954987:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074173.955804:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723583872:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1783074173.955898:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783074173.955920:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.956091:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956120:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074173.956192:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074173.956198:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956210:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:1.0:1783074173.956213:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074173.956219:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956231:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956239:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956261:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956279:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783074173.956288:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074173.956294:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956303:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.956327:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956337:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956356:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956363:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87b7577/0x5fb609b3016e0134 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956387:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.956390:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956407:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151bc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.956410:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.956417:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.956418:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956429:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956436:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a33744f/0x5fb609b3016e013b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.956451:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.956452:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.956454:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074173.957010:0:92381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074173.957080:0:92381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b000 going to sleep for 11 seconds 00002000:00010000:0.0:1783074173.957138:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.957146:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957156:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.957160:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783074173.957165:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584000 00010000:00010000:0.0:1783074173.957166:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074173.957175:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584000 00010000:00010000:0.0:1783074173.957180:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957209:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957216:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074173.957234:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927 00010000:00010000:0.0:1783074173.957234:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074173.957245:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783074173.957251:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:92381:x1869685723584000:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1783074173.957254:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957264:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.957268:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957275:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957287:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957294:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf7c712/0x5fb609b3016e0142 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957347:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.957358:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.957361:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783074173.957377:0:26178:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00002000:00010000:0.0:1783074173.957418:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.957425:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957436:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.957439:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.957443:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957454:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957463:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957472:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957488:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074173.957498:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074173.957504:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957514:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.957518:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957540:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957549:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957554:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee51c5f/0x5fb609b3016e0149 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957566:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.957567:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.957568:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783074173.957618:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.957624:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957630:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.957633:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.957636:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957644:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957649:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957660:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957672:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074173.957678:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074173.957681:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957686:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074173.957689:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957695:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957703:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957707:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055284de8/0x5fb609b3016e0150 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957717:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.957718:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074173.957720:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783074173.957755:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074173.957763:0:26174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957770:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=3013s v=(0 0) 00010000:00010000:0.0:1783074173.957772:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074173.957775:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957782:0:26174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957788:0:26174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957793:0:26174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.957803:0:26174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783074173.959386:0:26174:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:0.0:1783074173.959499:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:92383:x1869685723583744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 26757us (27507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.959514:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926 00000100:00100000:0.0:1783074173.959600:0:92383:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92383:1869685723583744:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783074173.959630:0:92383:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x722:0x0] 00010000:00010000:1.0:1783074173.959790:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074173.959801:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.959812:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074173.959826:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.959847:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.959883:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.959891:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067ada919/0x5fb609b3016e0157 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074173.959921:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074173.959925:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074173.959925:0:92383:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92383:1869685723584256:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1783074173.959928:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074173.959962:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074173.959973:0:92383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.959977:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723584128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074173.960006:0:92383:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c16630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074173.960287:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074173.960336:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584128 00000100:00100000:1.0:1783074173.960342:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584128 00000100:00100000:1.0:1783074173.960387:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:1.0:1783074173.960400:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723584128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783074173.960429:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074173.960465:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723584128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074173.960471:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:1.0:1783074173.960507:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723584128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074173.960896:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584256 00000100:00100000:0.0:1783074173.960901:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584256 00000100:00100000:0.0:1783074173.960931:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:0.0:1783074173.960939:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:92383:x1869685723584256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783074173.960973:0:26166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00010000:00010000:2.0:1783074173.962162:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.962182:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.962197:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.962211:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.962218:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074173.962224:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074173.962376:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723584384:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783074173.962432:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074173.962455:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074173.963586:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:92383:x1869685723584256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2645us (3611us total) trans 4294968713 rc 0/0 00000100:00100000:0.0:1783074173.963596:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00000100:00100000:0.0:1783074173.963634:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584384 00000100:00100000:0.0:1783074173.963640:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584384 00000100:00100000:0.0:1783074173.963674:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:0.0:1783074173.963682:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723584384:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074173.963757:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723584384:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.963764:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:3.0:1783074173.965209:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:92381:x1869685723584000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7955us (8195us total) trans 4294968717 rc 0/0 00000100:00100000:3.0:1783074173.965220:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927 00000100:00100000:3.0:1783074173.965266:0:92381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92381:1869685723584000:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783074173.965281:0:92381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00000100:00100000:3.0:1783074173.965360:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723584384:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783074173.965419:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e016c lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965434:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e016c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965446:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e016c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074173.965479:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e016c lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965492:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965498:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965504:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965517:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965523:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074173.965527:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965534:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965547:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:3.0:1783074173.965550:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074173.965556:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965562:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e015e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965587:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965593:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965602:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965607:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074173.965610:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965625:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965634:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9523c8d7c400) 00010000:00010000:3.0:1783074173.965636:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074173.965639:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965645:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e0165 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965685:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6000/0x5fb609b3016e007e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b21f expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965698:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e016c lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b21f expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.965705:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3000) 00010000:00010000:3.0:1783074173.965707:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074173.965710:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:3.0:1783074173.965757:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71222:x1869685708079232:12345-192.168.204.26@tcp:101:rm.0 Request processed in 18782us (18934us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074173.965765:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1281 00000100:00100000:3.0:1783074173.966254:0:92383:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92383:1869685723584256:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783074173.966265:0:92383:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00000100:00100000:0.0:1783074173.970142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074173.970226:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708079360 00000100:00100000:3.0:1783074173.970242:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708079360 00000100:00100000:3.0:1783074173.970403:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1282 00000100:00100000:3.0:1783074173.970421:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71222:x1869685708079360:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074173.970464:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074173.970492:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0173 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b226 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.970654:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e017a lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.970671:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e017a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.970688:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e017a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074173.970765:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783074173.970770:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783074173.970828:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0173 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b226 expref: 14 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.970860:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e017a lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b226 expref: 13 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074173.970874:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:3.0:1783074173.970881:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783074173.970885:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671000, rc 0) 00000100:00100000:3.0:1783074173.971057:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71222:x1869685708079360:12345-192.168.204.26@tcp:101:rm.0 Request processed in 642us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074173.971067:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1282 00000100:00100000:3.0:1783074173.975642:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074173.975851:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708079616 00000100:00100000:0.0:1783074173.975866:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708079616 00000100:00100000:0.0:1783074173.975989:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1283 00000100:00100000:0.0:1783074173.976003:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71222:x1869685708079616:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:0.0:1783074173.976030:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074173.976057:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9525021da000/0x5fb609b3016e0181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b22d expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074173.976198:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783074173.976374:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9525021da000/0x5fb609b3016e0181 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b22d expref: 15 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.976412:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524fc2ff300) 00010000:00010000:0.0:1783074173.976415:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074173.976422:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9525021da000/0x5fb609b3016e0181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b22d expref: 15 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074173.976455:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da000, rc 0) 00000100:00100000:0.0:1783074173.976532:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71222:x1869685708079616:12345-192.168.204.26@tcp:101:rm.0 Request processed in 526us (901us total) trans 77309411451 rc 301/301 00000100:00100000:0.0:1783074173.976539:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1283 00000100:00100000:2.0:1783074173.980550:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074173.980661:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708079744 00000100:00100000:0.0:1783074173.980674:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708079744 00000100:00100000:0.0:1783074173.980747:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:0.0:1783074173.980760:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71222:x1869685708079744:12345-192.168.204.26@tcp:37:rm.0 00000100:00100000:0.0:1783074173.987603:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71222:x1869685708079744:12345-192.168.204.26@tcp:37:rm.0 Request processed in 6825us (7048us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074173.987624:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:3.0:1783074173.992120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074173.992305:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708080000 00000100:00100000:0.0:1783074173.992448:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708080000 00000100:00100000:1.0:1783074173.992667:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:1.0:1783074173.992681:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71222:x1869685708080000:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:1.0:1783074173.993039:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:71222:x1869685708080000:12345-192.168.204.26@tcp:35:rm.0 Request processed in 361us (930us total) trans 77309411452 rc 0/0 00000100:00100000:1.0:1783074173.993064:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:2.0:1783074173.999968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074174.000506:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708080256 00000100:00100000:3.0:1783074174.000536:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708080256 00000100:00100000:3.0:1783074174.000621:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1284 00000100:00100000:3.0:1783074174.000635:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:71222:x1869685708080256:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074174.000666:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074174.000696:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671600/0x5fb609b3016e018f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b234 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074174.000861:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0196 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074174.000879:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0196 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074174.000892:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0196 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074174.000906:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783074174.001042:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671600/0x5fb609b3016e018f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b234 expref: 18 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074174.001071:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0196 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b234 expref: 17 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074174.001080:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:3.0:1783074174.001082:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783074174.001085:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00000100:00100000:3.0:1783074174.001173:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:71222:x1869685708080256:12345-192.168.204.26@tcp:101:rm.0 Request processed in 541us (1220us total) trans 77309411453 rc 0/0 00000100:00100000:3.0:1783074174.001201:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1284 00000100:00100000:3.0:1783074174.006503:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074174.006652:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708080384 00000100:00100000:0.0:1783074174.006673:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708080384 00000100:00100000:0.0:1783074174.006808:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1285 00000100:00100000:0.0:1783074174.006821:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:71222:x1869685708080384:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:0.0:1783074174.006859:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074174.006883:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9525021dbc00/0x5fb609b3016e01a4 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b23b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.006983:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9525021db000/0x5fb609b3016e01ab lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.006998:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9525021db000/0x5fb609b3016e01ab lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.007010:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9525021db000/0x5fb609b3016e01ab lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074174.007076:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1783074174.007080:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074174.007107:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9525021db000/0x5fb609b3016e01ab lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.007138:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9525021dbc00/0x5fb609b3016e01a4 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b23b expref: 19 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.007158:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9525021db000/0x5fb609b3016e01ab lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b23b expref: 18 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.007168:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:0.0:1783074174.007170:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074174.007174:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021db000, rc 0) 00000100:00100000:0.0:1783074174.007252:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:71222:x1869685708080384:12345-192.168.204.26@tcp:101:rm.0 Request processed in 433us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074174.007259:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1285 00000100:00100000:0.0:1783074174.012576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074174.013915:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708080640 00000100:00100000:2.0:1783074174.013957:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708080640 00000100:00100000:2.0:1783074174.014042:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1286 00000100:00100000:2.0:1783074174.014054:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:71222:x1869685708080640:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1783074174.014080:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074174.014108:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01b2 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b242 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074174.014258:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1783074174.014424:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01b2 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b242 expref: 20 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.014440:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:2.0:1783074174.014443:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074174.014449:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01b2 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b242 expref: 20 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.014465:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6800, rc 0) 00000100:00100000:2.0:1783074174.014563:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:71222:x1869685708080640:12345-192.168.204.26@tcp:101:rm.0 Request processed in 511us (2004us total) trans 77309411454 rc 301/301 00000100:00100000:2.0:1783074174.014571:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1286 00000100:00100000:3.0:1783074174.021755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074174.021981:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708080768 00000100:00100000:0.0:1783074174.022020:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708080768 00000100:00100000:0.0:1783074174.022102:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:0.0:1783074174.022117:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:71222:x1869685708080768:12345-192.168.204.26@tcp:37:rm.0 00000100:00100000:1.0:1783074174.030965:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:71222:x1869685708080768:12345-192.168.204.26@tcp:37:rm.0 Request processed in 8832us (9211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074174.030987:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:3.0:1783074174.036009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074174.036188:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708081024 00000100:00100000:2.0:1783074174.036202:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708081024 00000100:00100000:2.0:1783074174.036270:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 235 00000100:00100000:2.0:1783074174.036280:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:71222:x1869685708081024:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:2.0:1783074174.036686:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:71222:x1869685708081024:12345-192.168.204.26@tcp:35:rm.0 Request processed in 406us (693us total) trans 77309411455 rc 0/0 00000100:00100000:2.0:1783074174.036693:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 235 00000100:00100000:3.0:1783074174.039905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074174.040193:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708081280 00000100:00100000:2.0:1783074174.040206:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708081280 00000100:00100000:2.0:1783074174.040369:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1287 00000100:00100000:2.0:1783074174.040381:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:71222:x1869685708081280:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1783074174.040408:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074174.040433:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01c0 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b249 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.040598:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e01c7 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.040896:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e01c7 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.040912:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e01c7 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074174.040928:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1783074174.041065:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01c0 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b249 expref: 23 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.041089:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e01c7 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b249 expref: 22 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.041098:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:2.0:1783074174.041101:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783074174.041105:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7800, rc 0) 00000100:00100000:2.0:1783074174.041238:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708081280:12345-192.168.204.26@tcp:101:rm.0 Request processed in 858us (1352us total) trans 77309411456 rc 0/0 00000100:00100000:2.0:1783074174.041267:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1287 00000100:00100000:3.0:1783074174.044283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074174.044855:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708081408 00000100:00100000:1.0:1783074174.044869:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708081408 00000100:00100000:1.0:1783074174.044942:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1288 00000100:00100000:1.0:1783074174.044956:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71222:x1869685708081408:12345-192.168.204.26@tcp:41:rm.0 00000004:00000024:1.0:1783074174.045025:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382966272 00000100:00100000:1.0:1783074174.045128:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71222:x1869685708081408:12345-192.168.204.26@tcp:41:rm.0 Request processed in 175us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074174.045136:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1288 00000100:00100000:3.0:1783074174.049139:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074174.049521:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708081664 00000100:00100000:2.0:1783074174.049701:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708081664 00000100:00100000:2.0:1783074174.049776:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1289 00000100:00100000:2.0:1783074174.049786:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708081664:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1783074174.049953:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783074174.049991:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3299000/0x5fb609b3016dff7b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b20a expref: 22 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050018:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9524c8cd5500) 00010000:00010000:2.0:1783074174.050041:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9525021db000/0x5fb609b3016e01ab lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b23b expref: 21 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050052:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:2.0:1783074174.050056:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074174.050083:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050097:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050107:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050120:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050129:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050155:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050280:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050289:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.050295:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783074174.050913:0:66201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x48:0x0].2, 64 off8320 00000004:00080000:2.0:1783074174.050931:0:66201:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3013268618163ns, next at 3014268615085ns, rc = 0 00010000:00010000:2.0:1783074174.050996:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051007:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051016:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051024:0:66201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051032:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051039:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051134:0:66201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074174.051159:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051166:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051173:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051179:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074174.051185:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051192:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051202:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9523c8d7ce00) 00010000:00010000:2.0:1783074174.051205:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783074174.051209:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051215:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01e3 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051235:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051240:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051256:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051261:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074174.051264:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051270:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051277:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:2.0:1783074174.051280:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074174.051283:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051289:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01d5 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074174.051299:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b34899bb reply state 00000000e8009bd8 transno 77309411457 ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051345:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.051353:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9524c8cd5600) 00010000:00010000:2.0:1783074174.051355:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074174.051359:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074174.051470:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708081664:12345-192.168.204.26@tcp:36:rm.0 Request processed in 1681us (2343us total) trans 77309411457 rc 0/0 00000100:00100000:2.0:1783074174.051481:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1289 00010000:00010000:0.0:1783074174.051786:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074174.051796:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.051803:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074174.051807:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.051816:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.051828:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9523c8d7ce00) 00010000:00010000:0.0:1783074174.051830:0:8460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783074174.051845:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.051851:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e01ea lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.051869:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074174.051871:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074174.051873:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074174.056172:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074174.057485:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708081920 00000100:00100000:1.0:1783074174.057500:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708081920 00000100:00100000:1.0:1783074174.057588:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:1.0:1783074174.057602:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4207850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708081920:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:1.0:1783074174.058295:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4207850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:71222:x1869685708081920:12345-192.168.204.26@tcp:35:rm.0 Request processed in 693us (2131us total) trans 77309411458 rc 0/0 00000100:00100000:1.0:1783074174.058307:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:3.0:1783074174.062304:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074174.062762:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708082176 00000100:00100000:2.0:1783074174.062777:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708082176 00000100:00100000:2.0:1783074174.062869:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1290 00000100:00100000:2.0:1783074174.062882:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:71222:x1869685708082176:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1783074174.063518:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783074174.063557:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e01c7 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b249 expref: 23 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.063587:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524f086da00/0x5fb609b3016dfce2 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1d9 expref: 22 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.063602:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9524d6c55400) 00010000:00010000:2.0:1783074174.063625:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e017a lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b226 expref: 21 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.063635:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:2.0:1783074174.063639:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074174.063799:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.063814:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.063824:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064109:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064119:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064146:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064260:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064269:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064277:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074174.064601:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1783074174.064619:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064627:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064633:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064640:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074174.064708:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064717:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064726:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9523c8d7c900) 00010000:00010000:2.0:1783074174.064729:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783074174.064739:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064745:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e01ff lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064769:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064775:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064781:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064787:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064793:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074174.064795:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064801:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064810:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:2.0:1783074174.064812:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074174.064815:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064821:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6800/0x5fb609b3016e01f1 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074174.064830:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe53dc17 reply state 00000000e9bd6dd3 transno 77309411459 ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064857:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.064864:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9523c8d7c200) 00010000:00010000:2.0:1783074174.064866:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074174.064869:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074174.065030:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708082176:12345-192.168.204.26@tcp:36:rm.0 Request processed in 2149us (2744us total) trans 77309411459 rc 0/0 00000100:00100000:2.0:1783074174.065040:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1290 00000100:00100000:3.0:1783074174.069983:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074174.070183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074174.070250:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708082560 00000100:00100000:2.0:1783074174.070278:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708082560 00000100:00100000:2.0:1783074174.070528:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:2.0:1783074174.070541:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708082560:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:1.0:1783074174.070610:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708082304 00000100:00100000:1.0:1783074174.070620:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708082304 00000100:00100000:1.0:1783074174.070700:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 701 00000100:00100000:1.0:1783074174.070708:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2402:x1869685708082304:12345-192.168.204.26@tcp:103:rm.0 00010000:00010000:1.0:1783074174.070722:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074174.070751:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e016c lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b21f expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.070783:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3000) 00010000:00010000:1.0:1783074174.070793:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074174.070817:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:71222:x1869685708082560:12345-192.168.204.26@tcp:35:rm.0 Request processed in 276us (631us total) trans 77309411460 rc 0/0 00000100:00100000:2.0:1783074174.070828:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:1.0:1783074174.070996:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708082304:12345-192.168.204.26@tcp:103:rm.0 Request processed in 181us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074174.071007:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 701 00000100:00100000:3.0:1783074174.072432:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074174.072485:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708082816 00000100:00100000:1.0:1783074174.072543:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708082816 00000100:00100000:1.0:1783074174.072603:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1291 00000100:00100000:1.0:1783074174.072613:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:71222:x1869685708082816:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:1.0:1783074174.072797:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783074174.072827:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670c00/0x5fb609b3016e0196 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b234 expref: 23 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.072861:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c69bcc00/0x5fb609b3016dfcc6 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1d2 expref: 22 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.072873:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523cadc3200) 00010000:00010000:1.0:1783074174.072886:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074174.073056:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.073066:0:67186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.073076:0:67186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074174.073118:0:67186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723584512:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1783074174.073177:0:67186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074174.074089:0:67186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074174.075361:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584512 00000100:00100000:0.0:1783074174.075373:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584512 00000100:00100000:0.0:1783074174.075495:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:0.0:1783074174.075506:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67186:x1869685723584512:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1783074174.075530:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074174.075568:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0206 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.075602:0:26189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 6 pid: 92395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.075616:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 9 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.075656:0:26189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 6 pid: 92395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.075669:0:26189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 6 pid: 92395 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074174.075685:0:26189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26189:1869685723584640:192.168.204.26@tcp:104: 00000100:00100000:0.0:1783074174.075798:0:26189:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c16636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074174.077658:0:26189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26189:1869685723584640:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074174.077699:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 9 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.077711:0:26189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:0.0:1783074174.077718:0:26189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074174.077720:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1783074174.077724:0:26189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 9 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.077737:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dbc00, rc 0) 00000100:00100000:0.0:1783074174.077817:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67186:x1869685723584512:12345-0@lo:101:mdt00_003.0 Request processed in 2313us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074174.077826:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:1.0:1783074174.077931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708082944 00000100:00100000:1.0:1783074174.077939:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708082944 00010000:00010000:1.0:1783074174.077970:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 92395 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074174.078010:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2585 00000100:00100000:1.0:1783074174.078021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708082944:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074174.078036:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074174.078042:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 92395 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.078054:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 92395 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.078079:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016dff51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1c4 expref: 7 pid: 92395 timeout: 3113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.078095:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:1.0:1783074174.078100:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.078110:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.078126:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.078164:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074174.078175:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1869685723584768:0@lo:105: 00000100:00100000:1.0:1783074174.078204:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074174.078278:0:6515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074174.078363:0:67186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723584512:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1783074174.078394:0:67186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.078408:0:67186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074174.078443:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584768 00000100:00100000:0.0:1783074174.078450:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584768 00000100:00100000:0.0:1783074174.078491:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783074174.078499:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6515:x1869685723584768:12345-0@lo:105: 00010000:00010000:0.0:1783074174.078511:0:10348:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.078522:0:10348:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.078532:0:10348:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.078539:0:10348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.078547:0:10348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.078553:0:10348:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.078566:0:10348:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9524c151bc00) 00000100:00100000:0.0:1783074174.078596:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6515:x1869685723584768:12345-0@lo:105: Request processed in 98us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074174.078612:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783074174.078618:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1869685723584768:0@lo:105: 00010000:00010000:1.0:1783074174.078637:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074174.078649:0:67186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.078682:0:67186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074174.078691:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708082944:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 668us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074174.078708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2585 00000004:00080000:2.0:1783074174.078723:0:67186:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783074174.078776:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.078786:0:67186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.078797:0:67186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074174.078818:0:67186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723584896:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1783074174.078889:0:67186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074174.078925:0:67186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074174.079295:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723584896 00000100:00100000:0.0:1783074174.079301:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723584896 00000100:00100000:0.0:1783074174.079379:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1783074174.079395:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:67186:x1869685723584896:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1783074174.079416:0:23954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074174.079433:0:23954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e021b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0214 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.079457:0:23954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e021b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0214 expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.079470:0:23954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e021b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0214 expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.079479:0:23954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9524fc2ff300) 00010000:00010000:0.0:1783074174.079483:0:23954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074174.079486:0:23954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da400, rc 0) 00000100:00100000:0.0:1783074174.079587:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67186:x1869685723584896:12345-0@lo:101:mdt00_003.0 Request processed in 199us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074174.079594:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1783074174.079695:0:67186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723584896:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1783074174.079706:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.079716:0:67186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783074174.079730:0:67186:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1783074174.079768:0:67186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723585024:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783074174.079795:0:67186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074174.079878:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723585024 00000100:00100000:2.0:1783074174.079881:0:67186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074174.079888:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723585024 00000100:00100000:3.0:1783074174.080004:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:3.0:1783074174.080015:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67186:x1869685723585024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783074174.080167:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67186:x1869685723585024:12345-0@lo:1000:mdt00_003.0 Request processed in 154us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074174.080175:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1783074174.080182:0:67186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723585024:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783074174.080248:0:67186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723585152:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783074174.080279:0:67186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074174.080346:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723585152 00000100:00100000:0.0:1783074174.080351:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723585152 00000100:00100000:0.0:1783074174.080385:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:0.0:1783074174.080394:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67186:x1869685723585152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783074174.080400:0:67186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074174.080505:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67186:x1869685723585152:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (224us total) trans 0 rc 1/1 00000100:00100000:0.0:1783074174.080525:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1783074174.080597:0:67186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723585152:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1783074174.080655:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.080665:0:67186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.080675:0:67186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074174.080687:0:67186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723585280:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1783074174.080710:0:67186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074174.080735:0:67186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074174.080776:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723585280 00000100:00100000:0.0:1783074174.080780:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723585280 00000100:00100000:0.0:1783074174.080816:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:0.0:1783074174.080824:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:67186:x1869685723585280:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1783074174.080844:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074174.080860:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0229 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0222 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.080882:0:26189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0229 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0222 expref: 11 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.080896:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0229 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0222 expref: 11 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.080905:0:26189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff400) 00010000:00010000:0.0:1783074174.080908:0:26189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074174.080911:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dba00, rc 0) 00000100:00100000:0.0:1783074174.080951:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:67186:x1869685723585280:12345-0@lo:101:mdt00_003.0 Request processed in 127us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074174.080957:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1783074174.081058:0:67186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67186:1869685723585280:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1783074174.081070:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.081081:0:67186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.081106:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.081114:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.081134:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783074174.081787:0:67186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].2, 432 off34200 00000040:00080000:2.0:1783074174.081855:0:67186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].2, 512 off34432 00000004:00080000:2.0:1783074174.081863:0:67186:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9524fb394cc0 with version 9 00000004:00080000:3.0:1783074174.082005:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 9 rpc_version 9 00000020:00100000:3.0:1783074174.082031:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783074174.082042:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9524fc25a300 x1869685723585536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074174.082061:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc25a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723585536:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783074174.082106:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074174.082279:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074174.082391:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723585536 00000100:00100000:1.0:1783074174.082397:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723585536 00000100:00100000:1.0:1783074174.082474:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1783074174.082483:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75600:x1869685723585536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783074174.088433:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75600:x1869685723585536:12345-0@lo:1000:osp_up0-1.0 Request processed in 5936us (6311us total) trans 120259084290 rc 0/0 00000100:00100000:1.0:1783074174.088454:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:3.0:1783074174.088905:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc25a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723585536:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1783074174.089332:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783074174.089362:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089374:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089383:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089390:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074174.089395:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089404:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089421:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9523c8d7cc00) 00010000:00010000:2.0:1783074174.089424:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074174.089429:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089435:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0230 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089485:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089494:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089502:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089530:0:67186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783074174.089548:0:67186:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783074174.089555:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089562:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089568:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089588:0:67186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1783074174.089593:0:67186:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783074174.089598:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074174.089606:0:67186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.089706:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074174.089715:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074174.089727:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:71222:x1869685708082816:12345-192.168.204.26@tcp:36:rm.0 Request processed in 17111us (17296us total) trans 77309411461 rc 0/0 00010000:00010000:0.0:1783074174.089728:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7a00 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:0.0:1783074174.089737:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074174.089740:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1291 00000004:00010000:0.0:1783074174.089756:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.089781:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074174.089790:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.089798:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.089801:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151bc00 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:0.0:1783074174.089807:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074174.089815:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074174.089825:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.089855:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.089863:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.089864:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc7a00/0x5fb609b3016e0222 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0229 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074174.089884:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723585664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074174.089885:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074174.089897:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.089905:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151bc00/0x5fb609b3016e0206 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e020d expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.089910:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074174.089913:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074174.089916:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074174.089919:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074174.089922:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074174.089925:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074174.089931:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723585792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074174.089950:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074174.089974:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074174.090010:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723585664 00000100:00100000:1.0:1783074174.090019:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723585664 00000100:00100000:0.0:1783074174.090024:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723585792 00000100:00100000:0.0:1783074174.090029:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723585792 00000100:00100000:1.0:1783074174.090122:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1783074174.090136:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3658:x1869685723585664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074174.090152:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074174.090172:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0229 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0222 expref: 13 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074174.090189:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9524fc2ff400) 00010000:00010000:1.0:1783074174.090200:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074174.090252:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3658:x1869685723585664:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074174.090260:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1783074174.090292:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1783074174.090303:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3659:x1869685723585792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074174.090342:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074174.090357:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e020d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0206 expref: 11 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074174.090368:0:7930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:0.0:1783074174.090377:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074174.090412:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3659:x1869685723585792:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074174.090419:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1783074174.090474:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723585792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074174.090534:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723585664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074174.576180:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074175.598533:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074175.984039:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074175.984149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074175.984182:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074175.984220:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074175.984357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074175.984369:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083584 00000100:00100000:1.0:1783074175.984381:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083584 00000100:00100000:0.0:1783074175.984409:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083456 00000100:00100000:0.0:1783074175.984415:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083456 00000100:00100000:1.0:1783074175.984566:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4929 00000100:00100000:1.0:1783074175.984578:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2401:x1869685708083584:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:1.0:1783074175.984614:0:26176:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfc8e 00000100:00080000:1.0:1783074175.984623:0:26176:0:(import.c:65:import_set_state_nolock()) ffff9524fb549000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783074175.984675:0:26176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968713 00000100:00100000:1.0:1783074175.984849:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+2:2401:x1869685708083584:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 273us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074175.984856:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4929 00000100:00100000:2.0:1783074175.985758:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083200 00000100:00100000:2.0:1783074175.985767:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083200 00000100:00100000:2.0:1783074175.985835:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083328 00000100:00100000:2.0:1783074175.985839:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083328 00000100:00100000:2.0:1783074175.985866:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 853 00000100:00100000:2.0:1783074175.985875:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708083200:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074175.985944:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708083200:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 66us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074175.985951:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 853 00000100:00100000:2.0:1783074175.985969:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 854 00000100:00100000:2.0:1783074175.985975:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2405:x1869685708083328:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074175.986003:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2405:x1869685708083328:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074175.986008:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 854 00000100:00100000:2.0:1783074175.986168:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083072 00000100:00100000:2.0:1783074175.986173:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083072 00000100:00100000:2.0:1783074175.986205:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:2.0:1783074175.986212:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708083072:12345-192.168.204.26@tcp:400:kworker.0 00010000:00010000:3.0:1783074175.986335:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783074175.986352:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783074175.986355:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074175.986358:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074175.986360:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074175.986922:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708083072:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 707us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074175.986932:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1783074175.988477:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2173 00000100:00100000:1.0:1783074175.988495:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708083456:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074175.988569:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708083456:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 80us (4385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074175.988984:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2173 00010000:00010000:1.0:1783074176.623442:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783074177.270623:0:92945:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 06:22:55 (1783074175) 00010000:00010000:2.0:1783074177.646602:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783074177.694455:0:92993:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc8c4856c0 20000000:00000080:3.0:1783074177.694471:0:92993:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9523c467a800 uarg=0000000000000000 00000040:00100000:3.0:1783074177.695246:0:92993:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 00000040:00100000:3.0:1783074177.695254:0:92993:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 00000040:00080000:3.0:1783074177.695428:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:3.0:1783074177.695448:0:92993:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783074177.695463:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:3.0:1783074177.695477:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:3.0:1783074177.695532:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:3.0:1783074177.695538:0:92993:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783074177.695548:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:3.0:1783074177.695725:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:3.0:1783074177.696433:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:3.0:1783074177.696444:0:92993:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783074177.696461:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:3.0:1783074177.696547:0:92993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:3.0:1783074177.696563:0:92993:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783074177.696587:0:92993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696606:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696614:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 23 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696622:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 23 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696629:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 23 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696635:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696641:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696648:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696654:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696661:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696671:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696684:0:92993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 9 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696692:0:92993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696731:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 9 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696745:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 9 pid: 92372 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.696759:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc25b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723585920:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074177.696914:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696923:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 9 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.696931:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586048:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074177.696961:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.696968:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 23 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.696978:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc25bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586176:0@lo:104: 00000100:00100000:3.0:1783074177.697016:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.697061:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586176 00000100:00100000:2.0:1783074177.697069:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586176 00010000:00010000:3.0:1783074177.697098:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00010000:00010000:3.0:1783074177.697120:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 23 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723586176:12345-0@lo:104: 00000100:00100000:3.0:1783074177.697137:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586304:0@lo:104: 00010000:00010000:2.0:1783074177.697138:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.697169:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074177.697192:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783074177.697200:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723586176:12345-0@lo:104: Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074177.697208:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:3.0:1783074177.697215:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.697224:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 23 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.697233:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586432:0@lo:104: 00000100:00100000:2.0:1783074177.697238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586304 00000100:00100000:2.0:1783074177.697243:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586304 00000100:00100000:3.0:1783074177.697256:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.697265:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586432 00000100:00100000:2.0:1783074177.697269:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586432 00010000:00010000:3.0:1783074177.697284:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00010000:00010000:3.0:1783074177.697299:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 23 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697301:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:92993:x1869685723586304:12345-0@lo:104: 00010000:00010000:2.0:1783074177.697333:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.697345:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586560:0@lo:104: 00000100:00100000:1.0:1783074177.697361:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783074177.697375:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:92993:x1869685723586432:12345-0@lo:104: 00000100:00100000:3.0:1783074177.697384:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074177.697386:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1783074177.697386:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:92993:x1869685723586304:12345-0@lo:104: Request processed in 96us (226us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074177.697415:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697421:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:3.0:1783074177.697432:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 23 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.697442:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586688:0@lo:104: 00000100:00100000:2.0:1783074177.697449:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1783074177.697456:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783074177.697462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586560 00000100:00100000:1.0:1783074177.697465:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723586432:12345-0@lo:104: Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074177.697468:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586560 00000100:00100000:3.0:1783074177.697479:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074177.697480:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1783074177.697496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586688 00000100:00100000:2.0:1783074177.697500:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586688 00000100:00100000:1.0:1783074177.697506:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00010000:00010000:3.0:1783074177.697511:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 23 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074177.697520:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524ee003450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:92993:x1869685723586560:12345-0@lo:104: 00010000:00010000:3.0:1783074177.697524:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 23 pid: 92373 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.697524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00010000:00010000:1.0:1783074177.697533:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.697540:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586816:0@lo:104: 00000100:00100000:2.0:1783074177.697540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:92993:x1869685723586688:12345-0@lo:104: 00010000:00010000:2.0:1783074177.697555:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.697579:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074177.697590:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783074177.697597:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524ee003450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:92993:x1869685723586560:12345-0@lo:104: Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.697602:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:2.0:1783074177.697657:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783074177.697662:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586816 00000100:00100000:2.0:1783074177.697665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723586688:12345-0@lo:104: Request processed in 131us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.697668:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586816 00000100:00100000:2.0:1783074177.697675:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783074177.697691:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783074177.697700:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723586816:12345-0@lo:104: 00010000:00010000:1.0:1783074177.697709:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697710:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074177.697719:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697728:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074177.697732:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697741:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697743:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783074177.697752:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723586816:12345-0@lo:104: Request processed in 53us (174us total) trans 0 rc 0/0 10000000:00010000:2.0:1783074177.697753:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074177.697777:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 10000000:01000000:2.0:1783074177.697790:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074177.697796:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783074177.697803:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697818:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d200 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:2.0:1783074177.697821:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074177.697822:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697832:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074177.697847:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697853:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074177.697855:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697872:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3298400/0x5fb609b3016dff04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dff0b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074177.697872:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074177.697888:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074177.697891:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697893:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697900:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074177.697905:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697906:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074177.697917:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697919:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074177.697933:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697935:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d200/0x5fb609b3016dfeda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfee1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074177.697948:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074177.697956:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783074177.697961:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697969:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.697969:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074177.697975:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.697981:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074177.698002:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074177.698009:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698014:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074177.698016:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074177.698026:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28e000/0x5fb609b3016dfecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfed3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698037:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074177.698040:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698041:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698057:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074177.698058:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074177.698064:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698067:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698076:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698080:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299c00/0x5fb609b3016dfeb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfeb7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074177.698089:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698096:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1783074177.698097:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074177.698101:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698108:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086c000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074177.698111:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698115:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698119:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698128:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1783074177.698135:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698138:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698153:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016dfea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfea9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074177.698156:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074177.698170:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.698179:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698180:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074177.698185:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.698190:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074177.698195:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.698197:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698205:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086c000/0x5fb609b3016dfe78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe7f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.698217:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.698219:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.698222:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074177.698222:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723586944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074177.698243:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074177.698381:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723587072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074177.698413:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.698440:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723587584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074177.698460:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.698490:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723587200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074177.698512:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.698533:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783074177.698539:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723587328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074177.698560:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.698598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587072 00000100:00100000:2.0:1783074177.698602:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587072 00010000:00010000:2.0:1783074177.698623:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 24 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.698647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587584 00000100:00100000:2.0:1783074177.698650:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587584 00010000:00010000:2.0:1783074177.698664:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 25 pid: 92373 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.698685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587200 00000100:00100000:2.0:1783074177.698688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587200 00010000:00010000:2.0:1783074177.698699:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 26 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.698715:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587328 00000100:00100000:2.0:1783074177.698718:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587328 00010000:00010000:3.0:1783074177.698719:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 26 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.698727:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 27 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.698732:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 27 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.698737:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723587712:0@lo:104: 00000100:00100000:3.0:1783074177.698758:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074177.698837:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074177.698849:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723587456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074177.698871:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074177.698904:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723586944 00000100:00100000:1.0:1783074177.698909:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723586944 00010000:00010000:1.0:1783074177.698924:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 28 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074177.699024:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587456 00000100:00100000:0.0:1783074177.699029:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587456 00010000:00010000:0.0:1783074177.699045:0:7930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 29 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.699994:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:2.0:1783074177.700009:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+29:3661:x1869685723587072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074177.700015:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00010000:00010000:2.0:1783074177.700022:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783074177.700024:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+29:3661:x1869685723587584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074177.700032:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 29 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.700034:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074177.700041:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 29 pid: 92373 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.700050:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 29 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.700061:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 29 pid: 92373 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.700191:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074177.700192:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074177.700505:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1783074177.700514:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+29:3658:x1869685723587200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074177.700522:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074177.700526:0:7930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 29 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.700534:0:7930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 29 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.700543:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074177.700720:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 29 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.700730:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 29 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.700740:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723587840:0@lo:104: 00000100:00100000:1.0:1783074177.701461:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+29:3661:x1869685723587584:12345-0@lo:103:ldlm_bl.0 Request processed in 1437us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.701468:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1783074177.701497:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1783074177.701498:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+28:3661:x1869685723587072:12345-0@lo:103:ldlm_bl.0 Request processed in 1490us (3079us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074177.701499:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+28:3658:x1869685723587200:12345-0@lo:103:ldlm_bl.0 Request processed in 983us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.701511:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+28:3658:x1869685723587328:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074177.701516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1783074177.701525:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00010000:00010000:1.0:1783074177.701527:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074177.701535:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 28 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.701545:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 26 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.701546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1783074177.701556:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3660:x1869685723586944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074177.701562:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074177.701563:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074177.701569:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 26 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.701576:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 26 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.701586:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074177.701595:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3658:x1869685723587328:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.701603:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1783074177.701617:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1783074177.701622:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3660:x1869685723587456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074177.701629:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074177.701632:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 25 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.701638:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 25 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.701646:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074177.701672:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723587328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074177.701695:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723587200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074177.701737:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723586944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074177.701822:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723587072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074177.701830:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723587584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074177.701850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587712 00000100:00100000:0.0:1783074177.701854:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587712 00000100:00100000:0.0:1783074177.701881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783074177.701887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723587712:12345-0@lo:104: 00010000:00010000:0.0:1783074177.701898:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.702836:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074177.702906:0:92993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 25 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.702918:0:92993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 25 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.702941:0:92993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723587968:0@lo:104: 00010000:00010000:0.0:1783074177.702998:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783074177.703004:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723587712:12345-0@lo:104: Request processed in 1117us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074177.703011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783074177.703023:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587840 00000100:00100000:0.0:1783074177.703027:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587840 00000100:00100000:0.0:1783074177.703041:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1783074177.703046:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723587840:12345-0@lo:104: 00010000:00010000:0.0:1783074177.703054:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.703085:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783074177.703090:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723587840:12345-0@lo:104: Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074177.703117:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1783074177.703184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074177.703252:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074177.703269:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083712 00000100:00100000:0.0:1783074177.703272:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083712 00010000:00010000:0.0:1783074177.703286:0:19658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 10 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074177.703302:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083840 00000100:00100000:0.0:1783074177.703305:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083840 00010000:00010000:0.0:1783074177.703330:0:19658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 11 pid: 92372 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074177.703344:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2592 00000100:00100000:0.0:1783074177.703350:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1623620-a4b0-4769-84e0-0d08c968afe8+11:2405:x1869685708083712:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783074177.703360:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074177.703365:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 11 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.703373:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 11 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.703386:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074177.703417:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1623620-a4b0-4769-84e0-0d08c968afe8+11:2405:x1869685708083712:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074177.703424:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2592 00000100:00100000:0.0:1783074177.703435:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2593 00000100:00100000:0.0:1783074177.703441:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708083840:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783074177.703454:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074177.703459:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 10 pid: 92372 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.703468:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 10 pid: 92372 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.703476:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074177.703493:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708083840:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074177.703500:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2593 00000100:00100000:2.0:1783074177.703560:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3660:x1869685723586944:12345-0@lo:103:ldlm_bl.0 Request processed in 2003us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074177.703569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00010000:00010000:2.0:1783074177.703593:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074177.703603:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703608:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074177.703611:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703618:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074177.703623:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074177.703627:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074177.703651:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703656:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783074177.703660:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723587456:12345-0@lo:103:ldlm_bl.0 Request processed in 2036us (4787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.703667:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00010000:00010000:2.0:1783074177.703672:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703678:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c69bd200/0x5fb609b3016dfe5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe63 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703687:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074177.703688:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703692:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074177.703694:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703706:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074177.703711:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074177.703715:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074177.703721:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074177.703725:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703729:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074177.703734:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074177.703739:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016dfe2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfe32 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074177.703745:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723587456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074177.703746:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074177.703749:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074177.703752:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074177.703774:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d2328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723588224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074177.703959:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074177.703999:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783074177.704000:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588224 00000100:00100000:1.0:1783074177.704006:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588224 00000100:00100000:2.0:1783074177.704007:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723588096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074177.704031:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 24 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074177.704033:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074177.704058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588096 00000100:00100000:1.0:1783074177.704061:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588096 00000100:00100000:0.0:1783074177.704070:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00010000:00010000:1.0:1783074177.704075:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 25 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704077:0:92993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074177.704090:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3659:x1869685723588224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074177.704097:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00010000:00010000:0.0:1783074177.704100:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783074177.704105:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3659:x1869685723588096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074177.704107:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 25 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704114:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074177.704119:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 25 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704120:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 25 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704144:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 25 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074177.704152:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074177.704159:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074177.704160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723587968 00000100:00100000:2.0:1783074177.704164:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723587968 00000100:00100000:3.0:1783074177.704174:0:92993:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074177.704189:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1783074177.704200:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723587968:12345-0@lo:104: 00010000:00010000:3.0:1783074177.704201:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd600/0x5fb609b3016dff2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b203 expref: 9 pid: 92372 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074177.704203:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3659:x1869685723588224:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.704207:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3659:x1869685723588096:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074177.704223:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00010000:00010000:2.0:1783074177.704230:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704232:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc25b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723585920:192.168.204.26@tcp:104: 00000100:00100000:1.0:1783074177.704232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00010000:00010000:3.0:1783074177.704255:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016dff20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1f5 expref: 8 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704267:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586048:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074177.704279:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016dff0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dff04 expref: 23 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704287:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc25bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586176:0@lo:104: 00010000:00010000:3.0:1783074177.704297:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28f000/0x5fb609b3016dfee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfeda expref: 22 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704305:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586304:0@lo:104: 00010000:00010000:3.0:1783074177.704340:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c600/0x5fb609b3016dfed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfecc expref: 21 pid: 92367 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704346:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586432:0@lo:104: 00010000:00010000:3.0:1783074177.704352:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086dc00/0x5fb609b3016dfeb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfeb0 expref: 20 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704357:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586560:0@lo:104: 00010000:00010000:3.0:1783074177.704370:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bdc00/0x5fb609b3016dfea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfea2 expref: 19 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704375:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586688:0@lo:104: 00010000:00010000:3.0:1783074177.704381:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c400/0x5fb609b3016dfe7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfe78 expref: 18 pid: 92373 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704385:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723586816:0@lo:104: 00010000:00010000:3.0:1783074177.704390:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299600/0x5fb609b3016dfe63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfe5c expref: 17 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704437:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723587712:0@lo:104: 00010000:00010000:3.0:1783074177.704445:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d800/0x5fb609b3016dfe32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfe2b expref: 16 pid: 92369 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704452:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723587840:0@lo:104: 00000100:00100000:3.0:1783074177.704459:0:92993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92993:1869685723587968:0@lo:104: 00010000:00010000:2.0:1783074177.704466:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1783074177.704485:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074177.704486:0:92993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704497:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704505:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074177.704508:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704517:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074177.704523:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074177.704526:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723588096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074177.704535:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d2328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723588224:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1783074177.704536:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783074177.704543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:92993:x1869685723587968:12345-0@lo:104: Request processed in 279us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074177.704553:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:1.0:1783074177.704563:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704571:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074177.704599:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704606:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d600/0x5fb609b3016dfd4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016dfd52 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704621:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.704623:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074177.704625:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074177.704630:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074177.704640:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723588352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074177.704667:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074177.704696:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588352 00000100:00100000:1.0:1783074177.704701:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588352 00010000:00010000:1.0:1783074177.704717:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 16 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074177.704750:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1783074177.704758:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+16:3661:x1869685723588352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074177.704776:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074177.704782:0:19655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 16 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704791:0:19655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 16 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704800:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28f200/0x5fb609b3016dfd52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016dfd4b expref: 16 pid: 92368 timeout: 3116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704812:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704820:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704845:0:19655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704854:0:19655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704861:0:19655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704867:0:19655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704883:0:19655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074177.704888:0:19655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704896:0:19655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704911:0:19655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074177.704920:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074177.704934:0:92993:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.704948:0:92993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074177.704959:0:92993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0237 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074177.704959:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:522b6a34-04f4-4017-ab45-61a21d19bfef+15:3661:x1869685723588352:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074177.704976:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1783074177.704992:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723588352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074178.478576:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1783074178.478583:0:75603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3017696269826ns, next at 3018696266941ns, rc = 0 00000100:00100000:2.0:1783074178.478596:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723588480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074178.478657:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074178.478664:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.478673:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d2328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723588608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074178.478705:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.478807:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588480 00000100:00100000:3.0:1783074178.478814:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588480 00000100:00080000:0.0:1783074178.478851:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074178.478869:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588608 00000100:00100000:3.0:1783074178.478872:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588608 00000100:00100000:2.0:1783074178.478900:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1783074178.478913:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723588480:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074178.478917:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1783074178.478930:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723588608:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783074178.478931:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783074178.478945:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783074178.478953:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074178.479014:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723588608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074178.479018:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723588480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074178.479027:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:2.0:1783074178.479037:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:0.0:1783074178.479049:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723588480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074178.479074:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d2328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723588608:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074178.670517:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074178.990518:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723588736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074178.990590:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.990685:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588736 00000100:00100000:3.0:1783074178.990692:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588736 00000100:00100000:3.0:1783074178.990774:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1783074178.990785:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723588736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074178.990840:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074178.990896:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723588736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074178.990904:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723588992:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.990906:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:2.0:1783074178.990950:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074178.990970:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074178.990983:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d2328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723589120:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991022:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074178.991037:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723588864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074178.991050:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723589632:0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.991091:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.991094:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723589248:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991113:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.991143:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723589760:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991163:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074178.991187:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588992 00000100:00100000:3.0:1783074178.991188:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723590272:0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.991194:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588992 00000100:00100000:2.0:1783074178.991209:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723589504:0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.991213:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723589376:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991221:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074178.991235:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783074178.991246:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+15:3661:x1869685723588992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.991260:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.991278:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723588736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074178.991294:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723590016:0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.991297:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723588864 00000100:00100000:1.0:1783074178.991300:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+15:3661:x1869685723588992:12345-0@lo:400:kworker.0 Request processed in 54us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074178.991303:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723588864 00000100:00100000:1.0:1783074178.991330:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783074178.991339:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589760 00000100:00100000:3.0:1783074178.991344:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589760 00000100:00100000:2.0:1783074178.991357:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074178.991370:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:0.0:1783074178.991383:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723588864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074178.991384:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590272 00000100:00100000:1.0:1783074178.991384:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074178.991389:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723590528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074178.991390:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590272 00000004:00000024:0.0:1783074178.991415:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445396480 avail 1299156992 00000100:00100000:1.0:1783074178.991416:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723589888:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991431:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1783074178.991433:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074178.991445:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723589760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.991467:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723588992:0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.991476:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723588864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074178.991477:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074178.991490:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1783074178.991498:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723589760:12345-0@lo:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074178.991501:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589120 00000100:00100000:2.0:1783074178.991506:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589120 00000100:00100000:3.0:1783074178.991507:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:1.0:1783074178.991512:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723590400:0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991526:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589888 00000100:00100000:3.0:1783074178.991538:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589888 00000100:00100000:2.0:1783074178.991539:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589248 00000100:00100000:0.0:1783074178.991541:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:2.0:1783074178.991544:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589248 00000100:00100000:2.0:1783074178.991562:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589504 00000100:00100000:2.0:1783074178.991565:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589504 00000100:00100000:1.0:1783074178.991577:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074178.991586:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590016 00000100:00100000:2.0:1783074178.991590:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590016 00000100:00100000:2.0:1783074178.991606:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589376 00000100:00100000:2.0:1783074178.991609:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589376 00000100:00100000:1.0:1783074178.991622:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723588864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074178.991626:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590400 00000100:00100000:2.0:1783074178.991630:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590400 00000100:00100000:2.0:1783074178.991654:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1783074178.991663:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723589120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.991687:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1783074178.991691:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723590272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.991699:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723589120:12345-0@lo:400:kworker.0 Request processed in 37us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074178.991702:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723589888:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783074178.991712:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074178.991712:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00080000:3.0:1783074178.991718:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074178.991724:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074178.991738:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1783074178.991753:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074178.991759:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723590272:12345-0@lo:400:kworker.0 Request processed in 72us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074178.991765:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723589248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.991773:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:1.0:1783074178.991774:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723589888:12345-0@lo:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074178.991785:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:3.0:1783074178.991793:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723590144:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.991805:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723589248:12345-0@lo:400:kworker.0 Request processed in 44us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074178.991824:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074178.991830:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723589888:0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.991854:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723589632 00000100:00100000:3.0:1783074178.991856:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723590656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074178.991859:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723589632 00000100:00100000:3.0:1783074178.991884:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074178.991893:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590144 00000100:00100000:1.0:1783074178.991898:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590144 00000100:00100000:1.0:1783074178.991917:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590656 00000100:00100000:3.0:1783074178.991920:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d2328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723589120:0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.991922:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590656 00000100:00100000:1.0:1783074178.991942:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1783074178.991948:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1783074178.991954:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3658:x1869685723589632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991957:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723589248:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.991961:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1783074178.991968:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723589504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074178.991978:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723589760:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.991993:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1783074178.991994:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723590272:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.992006:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723590016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.992022:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3658:x1869685723589632:12345-0@lo:400:kworker.0 Request processed in 71us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074178.992030:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723589504:12345-0@lo:400:kworker.0 Request processed in 67us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074178.992036:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1783074178.992043:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1783074178.992048:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869685723590016:12345-0@lo:400:kworker.0 Request processed in 44us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074178.992060:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:0.0:1783074178.992064:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1783074178.992074:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1783074178.992079:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723590144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.992079:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723589376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.992097:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1783074178.992108:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723590400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074178.992118:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723589376:12345-0@lo:400:kworker.0 Request processed in 44us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074178.992124:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1783074178.992133:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723590144:12345-0@lo:400:kworker.0 Request processed in 58us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074178.992144:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:2.0:1783074178.992149:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723590400:12345-0@lo:400:kworker.0 Request processed in 44us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074178.992160:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1783074178.992160:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1783074178.992172:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3658:x1869685723590656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783074178.992187:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444679680 avail 1298440192 00000100:00100000:1.0:1783074178.992223:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723589376:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.992224:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590528 00000100:00100000:2.0:1783074178.992229:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590528 00000100:00100000:2.0:1783074178.992253:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1783074178.992260:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723590528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074178.992270:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074178.992392:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3658:x1869685723590656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 221us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074178.992398:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1783074178.992404:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723590400:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.992417:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723590528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074178.992423:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723589632:0@lo:400:kworker.0 00000100:00100000:2.0:1783074178.992427:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:3.0:1783074178.992448:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723590144:0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.992468:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723590528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074178.992472:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723590656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074178.992489:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723589504:0@lo:400:kworker.0 00000100:00100000:1.0:1783074178.992500:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723590016:0@lo:400:kworker.0 10000000:01000000:0.0:1783074179.438421:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074179.438429:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6e2d800 from 52 10000000:01000000:0.0:1783074179.438434:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074179.438483:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.438496:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.438508:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.438533:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723590784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.438604:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.438650:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.438663:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590784 00000100:00100000:2.0:1783074179.438670:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590784 00000100:00100000:2.0:1783074179.438725:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783074179.438744:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723590784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074179.438759:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074179.438772:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e023e expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.438796:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e023e expref: 16 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.438807:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e023e expref: 16 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.438915:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7c00, rc 0) 00000100:00100000:2.0:1783074179.438957:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723590784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.438964:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783074179.439148:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723590784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074179.439163:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.439173:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.439231:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723590912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.439267:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.439289:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.439341:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723590912 00000100:00100000:2.0:1783074179.439346:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723590912 00000100:00100000:2.0:1783074179.439372:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783074179.439378:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723590912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.439491:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723590912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.439498:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783074179.439773:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723590912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.439816:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.439852:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.439879:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.439902:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591040 00000100:00100000:2.0:1783074179.439906:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591040 00000100:00100000:2.0:1783074179.439936:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783074179.439941:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723591040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.440014:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723591040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.440020:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783074179.440140:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.440654:0:92994:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92994:1869685723591168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.440692:0:92994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.440773:0:92994:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c5ff8000 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.440807:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591168 00000100:00100000:2.0:1783074179.440812:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591168 00000100:00100000:2.0:1783074179.440870:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783074179.440878:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:92994:x1869685723591168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074179.440971:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:92994:x1869685723591168:12345-0@lo:502:llog_process_th.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.440977:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783074179.441028:0:92994:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92994:1869685723591168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.441075:0:92994:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92994:1869685723591296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.441109:0:92994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.441166:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591296 00000100:00100000:3.0:1783074179.441172:0:92994:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb394b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.441172:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591296 00000100:00100000:1.0:1783074179.441202:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783074179.441212:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+16:92994:x1869685723591296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.441288:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+16:92994:x1869685723591296:12345-0@lo:502:llog_process_th.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.441295:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783074179.441508:0:92994:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92994:1869685723591296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783074179.441527:0:92994:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1783074179.441609:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1783074179.441635:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074179.441644:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.441654:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074179.441663:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783074179.441665:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:0.0:1783074179.441668:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783074179.441689:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.441698:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.441706:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.441718:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.441761:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.441789:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.441839:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591424 00000100:00100000:3.0:1783074179.441848:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591424 00000100:00100000:3.0:1783074179.441909:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783074179.441916:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723591424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.441925:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074179.441937:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e024c expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.441959:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e024c expref: 17 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.441969:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e024c expref: 17 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.441978:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671c00, rc 0) 00000100:00100000:3.0:1783074179.442132:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723591424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.442138:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783074179.442196:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074179.442208:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.442216:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.442256:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.442278:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.442476:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.442535:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591552 00000100:00100000:1.0:1783074179.442540:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591552 00000100:00100000:1.0:1783074179.442572:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783074179.442579:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723591552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.442663:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723591552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.442670:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783074179.442790:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.442811:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.442841:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.442861:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.442912:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591680 00000100:00100000:1.0:1783074179.442916:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591680 00000100:00100000:1.0:1783074179.442944:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783074179.442956:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723591680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.443182:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723591680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.443188:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783074179.443260:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723591680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.443604:0:92995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92995:1869685723591808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.443638:0:92995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.443665:0:92995:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.443701:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591808 00000100:00100000:3.0:1783074179.443707:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591808 00000100:00100000:3.0:1783074179.443763:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783074179.443771:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:92995:x1869685723591808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.443929:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:92995:x1869685723591808:12345-0@lo:502:llog_process_th.0 Request processed in 157us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.443937:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783074179.443940:0:92995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92995:1869685723591808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074179.443964:0:92995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074179.443973:0:92995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074179.443974:0:92995:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:0.0:1783074179.443978:0:92995:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1783074179.444183:0:92995:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000001:00080000:1.0:1783074179.446584:0:92362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00080000:10000000:0.0:1783074179.447076:0:92995:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:0.0:1783074179.454135:0:92995:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:0.0:1783074179.455726:0:92995:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:0.0:1783074179.457221:0:92995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92995:1869685723591936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.457303:0:92995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.457400:0:92995:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5522cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.457532:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723591936 00000100:00100000:1.0:1783074179.457539:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723591936 00000100:00100000:1.0:1783074179.457618:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783074179.457627:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:92995:x1869685723591936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.457750:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:92995:x1869685723591936:12345-0@lo:502:llog_process_th.0 Request processed in 124us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.457758:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783074179.457835:0:92995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92995:1869685723591936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074179.457874:0:92995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92995:1869685723592064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074179.457908:0:92995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074179.458012:0:92995:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074179.458101:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592064 00000100:00100000:0.0:1783074179.458105:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592064 00000100:00100000:0.0:1783074179.458166:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783074179.458172:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:92995:x1869685723592064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.458241:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:92995:x1869685723592064:12345-0@lo:502:llog_process_th.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074179.458248:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783074179.458341:0:92995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92995:1869685723592064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074179.458360:0:92995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074179.458367:0:92995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074179.458369:0:92995:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:2.0:1783074179.458372:0:92995:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1783074179.458544:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1783074179.458564:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783074179.458573:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.458583:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074179.458593:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074179.458595:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 52 10000000:01000000:0.0:1783074179.458598:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074179.458626:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.458635:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.458652:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.458666:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.458692:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.458754:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.458852:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592192 00000100:00100000:3.0:1783074179.458857:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592192 00000100:00100000:3.0:1783074179.458891:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783074179.458898:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723592192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.458915:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074179.458928:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e025a expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.458953:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e025a expref: 18 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.458964:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e025a expref: 18 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.458974:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671600, rc 0) 00000100:00100000:3.0:1783074179.459048:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723592192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.459054:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783074179.459239:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074179.459252:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.459262:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.459306:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.459344:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.459363:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.459413:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592320 00000100:00100000:1.0:1783074179.459417:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592320 00000100:00100000:1.0:1783074179.459451:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783074179.459457:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723592320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.459551:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723592320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.459557:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783074179.459663:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.459688:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.459720:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.459751:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.459802:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592448 00000100:00100000:3.0:1783074179.459806:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592448 00000100:00100000:3.0:1783074179.459832:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783074179.459839:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723592448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.459916:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723592448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.459923:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783074179.459997:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.460348:0:92996:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92996:1869685723592576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.460379:0:92996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.460399:0:92996:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3c13900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074179.460450:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592576 00000100:00100000:0.0:1783074179.460454:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592576 00000100:00100000:0.0:1783074179.460480:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783074179.460486:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:92996:x1869685723592576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.460567:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:92996:x1869685723592576:12345-0@lo:502:llog_process_th.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074179.460573:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783074179.460684:0:92996:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92996:1869685723592576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.460719:0:92996:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92996:1869685723592704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.460759:0:92996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.460788:0:92996:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3c13900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.460833:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592704 00000100:00100000:3.0:1783074179.460837:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592704 00000100:00100000:3.0:1783074179.460863:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783074179.460870:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:92996:x1869685723592704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.460938:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:92996:x1869685723592704:12345-0@lo:502:llog_process_th.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.460953:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783074179.461024:0:92996:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92996:1869685723592704:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783074179.461043:0:92996:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1783074179.461174:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1783074179.461194:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074179.461202:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.461210:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074179.461218:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783074179.461221:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783074179.461224:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783074179.461243:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.461251:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.461259:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074179.461272:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.461295:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.461350:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c5ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.461430:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592832 00000100:00100000:1.0:1783074179.461435:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592832 00000100:00100000:1.0:1783074179.461456:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783074179.461463:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723592832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074179.461471:0:92373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074179.461482:0:92373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0268 expref: -99 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.461506:0:92373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 19 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.461516:0:92373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 19 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.461525:0:92373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151aa00, rc 0) 00000100:00100000:1.0:1783074179.461558:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723592832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.461565:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783074179.461585:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074179.461599:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.461607:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074179.461650:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.461680:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074179.461706:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.461778:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723592960 00000100:00100000:3.0:1783074179.461782:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723592960 00000100:00100000:3.0:1783074179.461811:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783074179.461818:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723592960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.461907:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723592960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.461920:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783074179.461995:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723592960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.462018:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.462050:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074179.462074:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.462101:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593088 00000100:00100000:3.0:1783074179.462105:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593088 00000100:00100000:3.0:1783074179.462144:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783074179.462151:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723593088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.462239:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.462243:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723593088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.462253:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783074179.462904:0:92997:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92997:1869685723593216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.462938:0:92997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.462971:0:92997:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.462989:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593216 00000100:00100000:2.0:1783074179.463001:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593216 00000100:00100000:2.0:1783074179.463034:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783074179.463040:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:92997:x1869685723593216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074179.463693:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:92997:x1869685723593216:12345-0@lo:502:llog_process_th.0 Request processed in 652us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.463701:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783074179.463766:0:92997:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92997:1869685723593216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783074179.463789:0:92997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074179.463940:0:92997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074179.463943:0:92997:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:3.0:1783074179.463951:0:92997:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1783074179.464003:0:92997:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1783074179.464024:0:92997:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92997:1869685723593344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.464057:0:92997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.464108:0:92997:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074179.464108:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593344 00000100:00100000:0.0:1783074179.464114:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593344 00000100:00100000:0.0:1783074179.464154:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783074179.464162:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:92997:x1869685723593344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.464248:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:92997:x1869685723593344:12345-0@lo:502:llog_process_th.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074179.464254:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783074179.464375:0:92997:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92997:1869685723593344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.464411:0:92997:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92997:1869685723593472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.464442:0:92997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.464477:0:92997:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.464508:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593472 00000100:00100000:1.0:1783074179.464514:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593472 00000100:00100000:1.0:1783074179.464548:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783074179.464556:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:92997:x1869685723593472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.464630:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:92997:x1869685723593472:12345-0@lo:502:llog_process_th.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.464638:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783074179.465464:0:92997:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92997:1869685723593472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783074179.465490:0:92997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074179.465494:0:92997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074179.465496:0:92997:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:3.0:1783074179.465501:0:92997:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:1.0:1783074179.465586:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:1.0:1783074179.465615:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783074179.465626:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.465638:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074179.465648:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074179.465650:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 52 10000000:01000000:1.0:1783074179.465653:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074179.465681:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.465690:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.465700:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074179.465721:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.465766:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.465797:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3c13a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.465826:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593600 00000100:00100000:2.0:1783074179.465831:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593600 00000100:00100000:2.0:1783074179.465858:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783074179.465865:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723593600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074179.465875:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074179.465887:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0276 expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.465911:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 20 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.465921:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 20 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.465930:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7e00, rc 0) 00000100:00100000:2.0:1783074179.465965:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723593600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.465971:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783074179.466609:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074179.466623:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.466634:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074179.466710:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.466757:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.466782:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3c13a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.466793:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593728 00000100:00100000:2.0:1783074179.466798:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593728 00000100:00100000:2.0:1783074179.466827:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783074179.466834:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723593728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.466981:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723593728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.466989:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783074179.467035:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.467064:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.467099:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.467226:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.467297:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593856 00000100:00100000:2.0:1783074179.467301:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593856 00000100:00100000:2.0:1783074179.467537:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783074179.467545:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723593856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.467621:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723593856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.467628:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783074179.467696:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723593856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.468077:0:92998:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92998:1869685723593984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.468111:0:92998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.468167:0:92998:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3c13780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074179.470816:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723593984 00000100:00100000:0.0:1783074179.470825:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723593984 00000100:00100000:0.0:1783074179.470934:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783074179.470945:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:92998:x1869685723593984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.471094:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:92998:x1869685723593984:12345-0@lo:502:llog_process_th.0 Request processed in 150us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074179.471102:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783074179.471123:0:92998:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92998:1869685723593984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.471178:0:92998:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92998:1869685723594112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.471216:0:92998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.471246:0:92998:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f3c13780 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.471328:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594112 00000100:00100000:3.0:1783074179.471333:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594112 00000100:00100000:3.0:1783074179.471366:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783074179.471374:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:92998:x1869685723594112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.471519:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:92998:x1869685723594112:12345-0@lo:502:llog_process_th.0 Request processed in 146us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.471527:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783074179.471581:0:92998:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:92998:1869685723594112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783074179.471600:0:92998:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1783074179.471776:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1783074179.471803:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074179.471812:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.471823:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074179.471832:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783074179.471834:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783074179.471838:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783074179.471862:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.471877:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.471887:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074179.471900:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.471925:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.471960:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.472004:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594240 00000100:00100000:2.0:1783074179.472008:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594240 00000100:00100000:2.0:1783074179.472070:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783074179.472077:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723594240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074179.472085:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074179.472099:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0284 expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.472120:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 21 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.472131:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 21 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.472141:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6c00, rc 0) 00000100:00100000:2.0:1783074179.472176:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723594240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.472192:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783074179.472244:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.472256:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.472265:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074179.472306:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.472397:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.472514:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900480 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.472543:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594368 00000100:00100000:1.0:1783074179.472552:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594368 00000100:00100000:1.0:1783074179.472616:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783074179.472650:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723594368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.472758:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723594368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.472799:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.472827:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.472857:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.472877:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.472887:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594496 00000100:00100000:3.0:1783074179.472890:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594496 00000100:00100000:1.0:1783074179.473135:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783074179.473191:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783074179.473199:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723594496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.473387:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723594496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.473394:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783074179.473497:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074179.474259:0:92999:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783074179.474700:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783074179.474718:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783074179.474725:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.474745:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074179.474754:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783074179.474757:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 52 10000000:01000000:3.0:1783074179.474759:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074179.474783:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.474791:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.474800:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074179.474815:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.474849:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.474916:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.474944:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594624 00000100:00100000:2.0:1783074179.474949:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594624 00000100:00100000:2.0:1783074179.474981:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783074179.474988:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723594624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074179.474999:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074179.475011:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0292 expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.475034:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 22 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.475043:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 22 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.475052:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6600, rc 0) 00000100:00100000:2.0:1783074179.475119:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723594624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.475125:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783074179.475172:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.475192:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.475200:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074179.475238:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.475261:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.475342:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074179.475438:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594752 00000100:00100000:1.0:1783074179.475442:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594752 00000100:00100000:1.0:1783074179.475461:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783074179.475467:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723594752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.475628:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723594752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.475635:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783074179.475679:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.475704:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.475749:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.475787:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074179.475808:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723594880 00000100:00100000:0.0:1783074179.475814:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723594880 00000100:00100000:0.0:1783074179.475848:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783074179.475870:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723594880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.475949:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723594880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074179.475958:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783074179.475972:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723594880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.476193:0:93000:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93000:1869685723595008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074179.476230:0:93000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.476251:0:93000:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.476274:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595008 00000100:00100000:2.0:1783074179.476279:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595008 00000100:00100000:2.0:1783074179.476305:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783074179.476334:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93000:x1869685723595008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074179.476410:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93000:x1869685723595008:12345-0@lo:502:llog_process_th.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.476417:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783074179.476506:0:93000:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93000:1869685723595008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.476541:0:93000:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93000:1869685723595136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074179.476571:0:93000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.476591:0:93000:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fc482600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.476637:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595136 00000100:00100000:3.0:1783074179.476641:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595136 00000100:00100000:3.0:1783074179.476697:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783074179.476704:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93000:x1869685723595136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074179.476787:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93000:x1869685723595136:12345-0@lo:502:llog_process_th.0 Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.476793:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783074179.476847:0:93000:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93000:1869685723595136:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783074179.476875:0:93000:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1783074179.476944:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1783074179.476967:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074179.476974:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.476983:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074179.476991:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783074179.476993:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783074179.476996:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783074179.477015:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.477023:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.477031:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.477044:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.477070:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.477085:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.477092:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595264 00000100:00100000:3.0:1783074179.477097:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595264 00000100:00100000:3.0:1783074179.477160:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783074179.477166:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723595264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.477182:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074179.477192:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e02a0 expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.477212:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.477221:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.477228:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671e00, rc 0) 00000100:00100000:3.0:1783074179.477268:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723595264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.477274:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783074179.477292:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074179.477304:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.477342:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.477381:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.477417:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074179.477441:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595392 00000100:00100000:0.0:1783074179.477444:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.477446:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595392 00000100:00100000:3.0:1783074179.477503:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783074179.477510:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723595392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.477584:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723595392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.477590:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783074179.477634:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.477750:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074179.477783:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.477848:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.477928:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595520 00000100:00100000:3.0:1783074179.477932:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595520 00000100:00100000:3.0:1783074179.477993:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783074179.478000:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723595520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.478074:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723595520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.478089:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783074179.478098:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074179.479028:0:93001:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1783074179.479095:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1783074179.479117:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783074179.479124:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.479132:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074179.479139:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783074179.479142:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:1.0:1783074179.479144:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783074179.479163:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.479181:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.479190:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074179.479202:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.479232:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.479259:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.479304:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595648 00000100:00100000:3.0:1783074179.479536:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595648 00000100:00100000:3.0:1783074179.479598:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783074179.479606:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723595648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.479615:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074179.479624:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e02ae expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.479643:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 24 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.479652:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 24 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.479660:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670800, rc 0) 00000100:00100000:3.0:1783074179.479703:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723595648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.479709:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783074179.479766:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074179.479777:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.479785:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074179.479824:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.479845:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.480037:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074179.480068:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595776 00000100:00100000:2.0:1783074179.480078:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595776 00000100:00100000:2.0:1783074179.480113:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783074179.480119:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723595776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.480173:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723595776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (327us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074179.480180:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783074179.480283:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723595776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783074179.480332:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783074179.480338:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.480350:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1783074179.508495:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000020:00000080:1.0:1783074179.508506:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524fb548000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00080000:1.0:1783074179.508528:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968713 is committed 00000020:00000080:2.0:1783074179.508783:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb548000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b for lustre-OST0001 00000020:00000080:2.0:1783074179.508839:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb549000 for lustre-OST0001 00000004:00080000:3.0:1783074179.509848:0:75594:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:3.0:1783074179.509902:0:75594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074179.509918:0:75594:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.509961:0:75594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.509980:0:75594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074179.510009:0:75594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524edcc6800/0x5fb609b3016e0214 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e021b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074179.510029:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411461 is committed 00000004:00080000:3.0:1783074179.510043:0:75594:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:3.0:1783074179.510065:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074179.510078:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723595904:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1783074179.510078:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723596032:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1783074179.510141:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510151:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510159:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510165:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074179.510169:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510175:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510195:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9524c8cd5600) 00010000:00010000:0.0:1783074179.510198:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074179.510203:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510209:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9523c3298600/0x5fb609b3016dff74 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510223:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510229:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510235:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510239:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074179.510242:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510246:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510253:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9524c8cd5600) 00010000:00010000:0.0:1783074179.510255:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074179.510258:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510263:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6a00/0x5fb609b3016e01dc lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510283:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510289:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510295:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510300:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074179.510303:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510308:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510347:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9523c8d7c200) 00010000:00010000:0.0:1783074179.510350:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074179.510353:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.510359:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6e00/0x5fb609b3016e01f8 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074179.510826:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968717 is committed 00000100:00100000:1.0:1783074179.511454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074179.511568:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723596032 00000100:00100000:0.0:1783074179.511575:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723596032 00000100:00100000:0.0:1783074179.511655:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4930 00000100:00100000:0.0:1783074179.511665:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723596032:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1783074179.511694:0:26171:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:546 count 1 00010000:00010000:0.0:1783074179.511722:0:26171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.511754:0:26171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 5 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.511763:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x222:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1783074179.511767:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783074179.511772:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.511802:0:26171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 5 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074179.511818:0:26171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 5 pid: 8445 timeout: 3118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074179.511833:0:26171:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26171:1869685723596160:192.168.204.26@tcp:104: 00000100:00100000:0.0:1783074179.511899:0:26171:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074179.513095:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074179.514800:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723595904 00000100:00100000:1.0:1783074179.514809:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723595904 00000100:00100000:1.0:1783074179.514871:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1783074179.514880:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3658:x1869685723595904:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1783074179.514896:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074179.514921:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e021b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0214 expref: 8 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.514940:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9524fc2ff300) 00010000:00010000:1.0:1783074179.514952:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074179.515013:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723595904:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 134us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.515021:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1783074179.515094:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723595904:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1783074179.516942:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074179.517032:0:26171:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26171:1869685723596160:192.168.204.26@tcp:104: 00010000:00010000:1.0:1783074179.517054:0:26171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074179.517064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708083968 00000100:00100000:2.0:1783074179.517072:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708083968 00010000:00010000:2.0:1783074179.517114:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 3118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074179.517145:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2597 00000100:00100000:2.0:1783074179.517156:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708083968:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1783074179.517157:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783074179.517173:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074179.517179:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 3118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517193:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 3118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517217:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2c37f01/0x5fb609b3016dff90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b218 expref: 6 pid: 8445 timeout: 3118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517233:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783074179.517249:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783074179.517256:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517269:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517301:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074179.517376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708083968:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 222us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.517386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2597 00010000:00010000:1.0:1783074179.517395:0:26171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.517417:0:26171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.517428:0:26171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.517437:0:26171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074179.517463:0:26171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074179.517484:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074179.517492:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517501:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dba00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074179.517507:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517518:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517531:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517540:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e02bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074179.517571:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074179.517574:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074179.517576:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074179.517641:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3660:x1869685723596032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5976us (6187us total) trans 4294968718 rc 0/0 00000100:00100000:1.0:1783074179.517650:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4930 00000004:00080000:2.0:1783074179.517784:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9524e71ae680/2, rc 0, transno 4294968718 00000100:00100000:2.0:1783074179.517792:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723596032:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1783074179.566797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074179.566891:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084096 00000100:00100000:3.0:1783074179.566901:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084096 00000100:00100000:3.0:1783074179.566959:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:3.0:1783074179.566970:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708084096:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.566990:0:92373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074179.567010:0:92373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b250 expref: -99 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.567044:0:92373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 9 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.567057:0:92373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 9 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.567069:0:92373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671800, rc 0) 00000100:00100000:3.0:1783074179.567131:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708084096:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 162us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.567152:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:0.0:1783074179.575018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074179.575156:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084224 00000100:00100000:1.0:1783074179.575167:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084224 00000100:00100000:1.0:1783074179.575223:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:1.0:1783074179.575845:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708084224:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074179.576001:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708084224:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 160us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074179.577786:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:0.0:1783074179.581881:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074179.581988:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084352 00000100:00100000:3.0:1783074179.581999:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084352 00000100:00100000:3.0:1783074179.582060:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:3.0:1783074179.582070:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708084352:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074179.582214:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708084352:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 144us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.582221:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:2.0:1783074179.588908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074179.589099:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084480 00000100:00100000:0.0:1783074179.589109:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084480 00000100:00100000:0.0:1783074179.589163:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:0.0:1783074179.589173:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71813:x1869685708084480:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783074179.589354:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71813:x1869685708084480:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 181us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074179.589368:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:0.0:1783074179.591817:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074179.591868:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084608 00000100:00100000:2.0:1783074179.591885:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084608 00000100:00100000:2.0:1783074179.591925:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:2.0:1783074179.591934:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71813:x1869685708084608:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783074179.592040:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71813:x1869685708084608:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 107us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074179.592048:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:1.0:1783074179.594720:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074179.594812:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084736 00000100:00100000:3.0:1783074179.594820:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084736 00000100:00100000:3.0:1783074179.594869:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:3.0:1783074179.594877:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708084736:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074179.594891:0:92373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074179.594910:0:92373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b257 expref: -99 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.594937:0:92373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 10 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.594950:0:92373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 10 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074179.595001:0:92373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00000100:00100000:3.0:1783074179.595056:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708084736:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 179us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074179.595063:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:3.0:1783074179.596251:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074179.599559:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084864 00000100:00100000:2.0:1783074179.599572:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084864 00000100:00100000:2.0:1783074179.600526:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:2.0:1783074179.600539:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708084864:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074179.600658:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708084864:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 122us (4408us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074179.600666:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00010000:00010000:2.0:1783074179.694653:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783074180.673481:0:93099:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd7be4a080 20000000:00000080:0.0:1783074180.673497:0:93099:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9523c38bd800 uarg=0000000000000000 00000040:00100000:0.0:1783074180.674101:0:93099:0:(llog.c:1067:llog_reverse_process()) index 54 : idx 49 20000000:01000000:0.0:1783074180.674107:0:93099:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:0.0:1783074180.674182:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:0.0:1783074180.674197:0:93099:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783074180.674207:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:0.0:1783074180.674215:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:0.0:1783074180.674253:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:0.0:1783074180.674258:0:93099:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783074180.674265:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:0.0:1783074180.674273:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:0.0:1783074180.674306:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:0.0:1783074180.674581:0:93099:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783074180.674599:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:0.0:1783074180.674614:0:93099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:0.0:1783074180.674626:0:93099:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783074180.674644:0:93099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674660:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e023e expref: 23 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674666:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e024c expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674669:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e025a expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674681:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 23 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674685:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674689:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 23 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674693:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 23 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674697:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674700:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674706:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 9 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674726:0:93099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 9 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674733:0:93099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674773:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 9 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674792:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 9 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.674804:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596288:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074180.674890:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 9 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674897:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 9 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.674904:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596416:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074180.674932:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.674939:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 23 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.674948:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596544:0@lo:104: 00000100:00100000:0.0:1783074180.674985:0:93099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074180.675076:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675084:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 23 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675092:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596672:0@lo:104: 00000100:00100000:0.0:1783074180.675117:0:93099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074180.675184:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 23 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675193:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 23 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675201:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596800:0@lo:104: 00010000:00010000:0.0:1783074180.675226:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 23 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675233:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 23 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675241:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596928:0@lo:104: 00010000:00010000:0.0:1783074180.675262:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675269:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 23 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675276:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597056:0@lo:104: 00010000:00010000:0.0:1783074180.675298:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 23 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675305:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 23 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675332:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597184:0@lo:104: 00010000:00010000:0.0:1783074180.675363:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e025a expref: 23 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675381:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e025a expref: 23 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675394:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597312:0@lo:104: 00010000:00010000:0.0:1783074180.675421:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e024c expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675429:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e024c expref: 23 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675437:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597440:0@lo:104: 00010000:00010000:0.0:1783074180.675460:0:93099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e023e expref: 23 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675468:0:93099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e023e expref: 23 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675476:0:93099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597568:0@lo:104: 00000100:00100000:0.0:1783074180.675492:0:93099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074180.675554:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723596544 00000100:00100000:2.0:1783074180.675557:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783074180.675562:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723596544 00000100:00100000:2.0:1783074180.675575:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074180.675637:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074180.675679:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074180.675692:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723596672 00000100:00100000:0.0:1783074180.675696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723596672 00000100:00100000:0.0:1783074180.675728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723596800 00000100:00100000:0.0:1783074180.675731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723596800 00000100:00100000:0.0:1783074180.675741:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723596928 00000100:00100000:0.0:1783074180.675743:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723596928 00000100:00100000:0.0:1783074180.675756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1783074180.675764:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c5a56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:93099:x1869685723596672:12345-0@lo:104: 00010000:00010000:0.0:1783074180.675777:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.675833:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1783074180.675841:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:93099:x1869685723596800:12345-0@lo:104: 00010000:00010000:0.0:1783074180.675842:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783074180.675847:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c5a56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:93099:x1869685723596672:12345-0@lo:104: Request processed in 85us (730us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074180.675849:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675854:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1783074180.675870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1783074180.675875:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:93099:x1869685723596928:12345-0@lo:104: 00010000:00010000:0.0:1783074180.675882:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.675926:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074180.675933:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.675938:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783074180.675943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:93099:x1869685723596928:12345-0@lo:104: Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074180.675949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:1.0:1783074180.675950:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbc00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074180.675954:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597056 00000100:00100000:0.0:1783074180.675961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597056 00010000:00010000:1.0:1783074180.675962:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074180.675969:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.675972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 10000000:01000000:1.0:1783074180.675976:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783074180.675977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:93099:x1869685723596544:12345-0@lo:104: 00010000:00010000:0.0:1783074180.675983:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676004:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676011:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074180.676011:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783074180.676015:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:93099:x1869685723596544:12345-0@lo:104: Request processed in 39us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074180.676021:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00010000:1.0:1783074180.676027:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676033:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021dbc00/0x5fb609b3016e02a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e02a7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676044:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074180.676047:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.676049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00010000:00010000:1.0:1783074180.676053:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc125cc20) 00000100:00100000:0.0:1783074180.676055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:93099:x1869685723597056:12345-0@lo:104: 10000000:00010000:1.0:1783074180.676056:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676067:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676070:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074180.676076:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074180.676081:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074180.676094:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1783074180.676095:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.676099:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:93099:x1869685723597056:12345-0@lo:104: Request processed in 45us (421us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074180.676101:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783074180.676105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00010000:1.0:1783074180.676114:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676121:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e028b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676130:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074180.676131:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074180.676133:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676134:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676139:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a600 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074180.676141:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074180.676142:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074180.676144:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676149:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676152:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074180.676158:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074180.676161:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074180.676163:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074180.676171:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074180.676177:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676181:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676183:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074180.676187:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074180.676189:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676192:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676196:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c151a800/0x5fb609b3016e0276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e027d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676198:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c151a600/0x5fb609b3016e02ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e02b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.676209:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074180.676209:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074180.676211:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074180.676211:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074180.676213:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074180.676213:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074180.676238:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074180.676239:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596544:0@lo:104: 00000100:00100000:1.0:1783074180.676248:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723598080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074180.676248:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596672:0@lo:104: 00000100:00100000:0.0:1783074180.676254:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596800:0@lo:104: 00000100:00100000:0.0:1783074180.676260:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596928:0@lo:104: 00000100:00100000:1.0:1783074180.676277:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074180.676283:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723597696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074180.676301:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074180.676304:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074180.676356:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074180.676362:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+3:93099:x1869685723596800:12345-0@lo:104: Request processed in 523us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074180.676368:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1783074180.676372:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074180.676379:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597184 00000100:00100000:3.0:1783074180.676382:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597184 00000100:00100000:2.0:1783074180.676385:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074180.676392:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074180.676401:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074180.676407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597312 00000100:00100000:3.0:1783074180.676410:0:10348:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783074180.676410:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597312 00000100:00100000:3.0:1783074180.676417:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597440 00000100:00100000:3.0:1783074180.676419:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597440 00000100:00100000:2.0:1783074180.676424:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597568 00000100:00100000:2.0:1783074180.676426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597568 00000100:00100000:3.0:1783074180.676430:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783074180.676435:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:93099:x1869685723597184:12345-0@lo:104: 00000100:00100000:2.0:1783074180.676436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1783074180.676440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:93099:x1869685723597312:12345-0@lo:104: 00010000:00010000:3.0:1783074180.676442:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.676446:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.676652:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783074180.676658:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:93099:x1869685723597184:12345-0@lo:104: Request processed in 223us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074180.676664:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783074180.676676:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1783074180.676677:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597056:0@lo:104: 00000100:00100000:3.0:1783074180.676682:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:93099:x1869685723597440:12345-0@lo:104: 00000100:00100000:0.0:1783074180.676685:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597184:0@lo:104: 00000100:00100000:0.0:1783074180.676691:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597312:0@lo:104: 00010000:00010000:3.0:1783074180.676697:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.676726:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598080 00000100:00100000:0.0:1783074180.676730:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598080 00010000:00010000:0.0:1783074180.676748:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 24 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.676756:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783074180.676760:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:93099:x1869685723597440:12345-0@lo:104: Request processed in 80us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074180.676766:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1783074180.676766:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597696 00000100:00100000:0.0:1783074180.676768:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597696 00000100:00100000:3.0:1783074180.676777:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00010000:00010000:0.0:1783074180.676777:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.676782:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c55ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:93099:x1869685723597568:12345-0@lo:104: 00010000:00010000:3.0:1783074180.676788:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.676793:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1783074180.676797:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3660:x1869685723598080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074180.676806:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074180.676818:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.676821:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783074180.676825:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c55ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:93099:x1869685723597568:12345-0@lo:104: Request processed in 44us (424us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074180.676827:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.676831:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:0.0:1783074180.676840:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670800/0x5fb609b3016e02b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e02ae expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.676852:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723597824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074180.676854:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074180.676872:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074180.676878:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723598080:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074180.676884:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:3.0:1783074180.676894:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074180.676894:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597824 00000100:00100000:0.0:1783074180.676897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597824 00000100:00100000:3.0:1783074180.676899:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723597952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074180.676906:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 24 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.676916:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074180.676923:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723597952 00000100:00100000:0.0:1783074180.676925:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723597952 00010000:00010000:0.0:1783074180.676935:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 25 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.676946:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1783074180.676950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:3.0:1783074180.676952:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3661:x1869685723597696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074180.676954:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3658:x1869685723597824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074180.676960:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074180.676960:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074180.676965:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676965:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 25 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.676973:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 25 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677005:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783074180.677008:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1783074180.677009:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+3:93099:x1869685723597312:12345-0@lo:104: Request processed in 569us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.677015:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1783074180.677015:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3658:x1869685723597952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074180.677021:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074180.677025:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 25 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677055:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677062:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783074180.677066:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e02a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e02a0 expref: 25 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677066:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677073:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:3.0:1783074180.677076:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1783074180.677076:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677083:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074180.677090:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074180.677100:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783074180.677109:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723597696:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074180.677115:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00010000:00010000:2.0:1783074180.677119:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677125:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074180.677132:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723598208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.677132:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677139:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0299 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677150:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1783074180.677152:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074180.677153:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677159:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074180.677162:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677168:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074180.677174:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677176:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723597696:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1783074180.677180:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074180.677191:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677197:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074180.677204:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598208 00000100:00100000:3.0:1783074180.677206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598208 00010000:00010000:2.0:1783074180.677214:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677218:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 24 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677221:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671200/0x5fb609b3016e0268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e026f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677231:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074180.677234:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:3.0:1783074180.677240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723598208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.677240:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074180.677243:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677246:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074180.677250:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 24 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677250:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074180.677257:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677258:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 24 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074180.677263:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074180.677274:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677278:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0292 expref: 24 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677279:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074180.677285:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677286:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074180.677291:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e024c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0253 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677300:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074180.677308:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3661:x1869685723598208:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (183us total) trans 0 rc 0/0 00010000:00010000:2.0:1783074180.677339:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074180.677341:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00010000:00010000:2.0:1783074180.677348:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074180.677354:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074180.677360:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783074180.677364:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723598208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.677372:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677377:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074180.677385:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723598464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.677387:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677393:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e023e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0245 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677402:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074180.677405:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677406:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074180.677411:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074180.677414:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677427:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1783074180.677430:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677431:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723598336:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1783074180.677437:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074180.677442:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783074180.677451:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074180.677454:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677459:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074180.677465:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677471:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e025a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0261 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677478:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598464 00000100:00100000:3.0:1783074180.677480:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598464 00010000:00010000:2.0:1783074180.677483:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074180.677485:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074180.677486:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074180.677493:0:19658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e024c expref: 23 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074180.677494:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598336 00000100:00100000:2.0:1783074180.677496:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598336 00010000:00010000:2.0:1783074180.677506:0:7930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 24 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677509:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1783074180.677514:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723598464:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074180.677518:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00010000:00010000:3.0:1783074180.677520:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783074180.677523:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723598336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074180.677524:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e024c expref: 24 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677529:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074180.677532:0:7930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 24 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677533:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e024c expref: 24 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677547:0:7930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 24 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677560:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e026f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0268 expref: 24 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677562:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074180.677569:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074180.677595:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3659:x1869685723598464:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.677595:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3659:x1869685723598336:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.677601:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1783074180.677604:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1783074180.677622:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723598336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074180.677629:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723598464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074180.677632:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723598720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074180.677653:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074180.677662:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598720 00000100:00100000:3.0:1783074180.677664:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598720 00000100:00100000:2.0:1783074180.677666:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783074180.677670:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723598592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074180.677676:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e025a expref: 22 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074180.677688:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074180.677692:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598592 00000100:00100000:3.0:1783074180.677694:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598592 00010000:00010000:3.0:1783074180.677705:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e023e expref: 23 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074180.677706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1783074180.677725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3661:x1869685723598720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.677733:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783074180.677734:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00010000:00010000:2.0:1783074180.677737:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e025a expref: 23 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677739:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3661:x1869685723598592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074180.677746:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074180.677746:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e025a expref: 23 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677750:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e023e expref: 23 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.677756:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e025a expref: 23 pid: 92367 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677757:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e023e expref: 23 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.677766:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074180.677774:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074180.677826:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6c00/0x5fb609b3016e028b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0284 expref: 22 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.677841:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 21 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074180.677864:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723598592:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.677865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723598720:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.677872:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1783074180.677874:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1783074180.677896:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723598592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074180.677898:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074180.677903:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723598720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074180.677933:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074180.677938:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e027d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0276 expref: 19 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.677953:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074180.677969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:3658:x1869685723597824:12345-0@lo:103:ldlm_bl.0 Request processed in 1014us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074180.677974:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+18:3658:x1869685723597952:12345-0@lo:103:ldlm_bl.0 Request processed in 960us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074180.677976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1783074180.677979:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00010000:00010000:0.0:1783074180.678004:0:93099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e024c expref: 16 pid: 92368 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074180.678007:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074180.678010:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074180.678013:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597440:0@lo:104: 00000100:00100000:1.0:1783074180.678022:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723598080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074180.678023:0:93099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7c00/0x5fb609b3016e0245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e023e expref: 15 pid: 92372 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074180.678030:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723597568:0@lo:104: 00000100:00100000:3.0:1783074180.678151:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723597952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074180.678159:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723597824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074180.678245:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596288:192.168.204.26@tcp:104: 00000100:00100000:1.0:1783074180.678578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074180.678605:0:93099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93099:1869685723596416:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074180.678644:0:93099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074180.678652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074180.678723:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708084992 00000100:00100000:2.0:1783074180.678723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085120 00000100:00100000:3.0:1783074180.678728:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708084992 00000100:00100000:2.0:1783074180.678728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085120 00010000:00010000:2.0:1783074180.678745:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 11 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074180.678784:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 11 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074180.678800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2607 00000100:00100000:2.0:1783074180.678810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1623620-a4b0-4769-84e0-0d08c968afe8+11:2405:x1869685708085120:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.678818:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074180.678822:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 11 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678830:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 11 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678843:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671800/0x5fb609b3016e02c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b250 expref: 11 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678852:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074180.678890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708085120:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.678903:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2607 00000100:00100000:2.0:1783074180.678916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2608 00000100:00100000:2.0:1783074180.678920:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:2403:x1869685708084992:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783074180.678927:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074180.678931:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 9 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678939:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 9 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678948:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e02ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b257 expref: 9 pid: 92373 timeout: 3119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678959:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678967:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678978:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678984:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678991:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.678997:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.679006:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dae00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074180.679011:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.679018:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.679029:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.679036:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074180.679051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:2403:x1869685708084992:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 131us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.679056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2608 00010000:00010000:0.0:1783074180.679089:0:93099:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.679097:0:93099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.679102:0:93099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.718757:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074180.855276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074180.855352:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085248 00000100:00100000:0.0:1783074180.855363:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085248 00000100:00100000:0.0:1783074180.855427:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1783074180.855439:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6b92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708085248:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074180.855458:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074180.855480:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b25e expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.855521:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b25e expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.855534:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b25e expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074180.855545:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dae00, rc 0) 00000100:00100000:0.0:1783074180.855613:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6b92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708085248:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 176us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074180.855620:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:1.0:1783074180.857391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074180.858013:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085376 00000100:00100000:0.0:1783074180.858021:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085376 00000100:00100000:0.0:1783074180.858072:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:0.0:1783074180.858080:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708085376:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074180.858231:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708085376:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 150us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074180.858239:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:1.0:1783074180.862942:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074180.863033:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085504 00000100:00100000:2.0:1783074180.863047:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085504 00000100:00100000:2.0:1783074180.863103:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:2.0:1783074180.863113:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708085504:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074180.863259:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c70b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708085504:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.863268:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:2.0:1783074180.868508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074180.868907:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085632 00000100:00100000:3.0:1783074180.868916:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085632 00000100:00100000:3.0:1783074180.869017:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1783074180.869029:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524ee03c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71857:x1869685708085632:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783074180.869282:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524ee03c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71857:x1869685708085632:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 255us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074180.869291:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:1.0:1783074180.871198:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074180.871255:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085760 00000100:00100000:3.0:1783074180.871263:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085760 00000100:00100000:3.0:1783074180.871306:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:3.0:1783074180.871339:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524ee03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71857:x1869685708085760:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783074180.871605:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524ee03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:71857:x1869685708085760:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 267us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.871614:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:1.0:1783074180.873338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074180.873456:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708085888 00000100:00100000:2.0:1783074180.873464:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708085888 00000100:00100000:2.0:1783074180.873595:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:2.0:1783074180.873604:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb7ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708085888:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074180.873619:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074180.873639:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e02df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b265 expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.873667:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e02df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b265 expref: 10 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.873680:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e02df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b265 expref: 10 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074180.873696:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6a00, rc 0) 00000100:00100000:2.0:1783074180.873810:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb7ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708085888:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 206us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074180.873818:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1783074180.876560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074180.876630:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086016 00000100:00100000:1.0:1783074180.876639:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086016 00000100:00100000:1.0:1783074180.876694:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:1.0:1783074180.876714:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708086016:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074180.876825:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708086016:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 122us (273us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074180.876834:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:1.0:1783074181.103239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074181.103371:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074181.103411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074181.103517:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086144 00000100:00100000:3.0:1783074181.103521:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086400 00000100:00100000:3.0:1783074181.103536:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086400 00000100:00100000:0.0:1783074181.103536:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086144 00000100:00100000:0.0:1783074181.103609:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086272 00000100:00100000:0.0:1783074181.103613:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086272 00000100:00100000:2.0:1783074181.103632:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 861 00000100:00100000:2.0:1783074181.103648:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708086144:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074181.103656:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2177 00000100:00100000:0.0:1783074181.103661:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 862 00000100:00100000:0.0:1783074181.103674:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708086272:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074181.103683:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708086400:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074181.103743:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708086272:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 73us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074181.103750:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 862 00000100:00080000:1.0:1783074181.103968:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074181.103974:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783074181.103982:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074181.104065:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708086144:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 421us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.104077:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708086400:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 407us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.104077:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 861 00000100:00100000:3.0:1783074181.104089:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2177 10000000:01000000:1.0:1783074181.142536:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074181.142545:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6e2d800 from 55 10000000:01000000:1.0:1783074181.142550:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074181.142604:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.142617:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.142629:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074181.142658:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723598848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.142748:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.142803:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.142873:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598848 00000100:00100000:2.0:1783074181.142881:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598848 00000100:00100000:2.0:1783074181.142990:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783074181.143002:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723598848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074181.143031:0:92368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074181.143046:0:92368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e02ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e02e6 expref: -99 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.143073:0:92368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e02ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e02e6 expref: 16 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.143085:0:92368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e02ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e02e6 expref: 16 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.143095:0:92368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6000, rc 0) 00000100:00100000:2.0:1783074181.143143:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723598848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.143150:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783074181.143223:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723598848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074181.143238:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.143248:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074181.143337:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723598976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.143363:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.144332:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.144451:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723598976 00000100:00100000:0.0:1783074181.144457:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723598976 00000100:00100000:0.0:1783074181.144504:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783074181.144513:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723598976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.144629:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723598976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074181.144636:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783074181.144674:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723598976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.144722:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.144766:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.144785:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.144797:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599104 00000100:00100000:0.0:1783074181.144801:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599104 00000100:00100000:0.0:1783074181.144822:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783074181.144828:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723599104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.144898:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723599104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074181.144905:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783074181.144946:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.145130:0:93100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93100:1869685723599232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.145161:0:93100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.145178:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599232 00000100:00100000:0.0:1783074181.145181:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599232 00000100:00100000:0.0:1783074181.145200:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783074181.145205:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:93100:x1869685723599232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.145282:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:93100:x1869685723599232:12345-0@lo:502:llog_process_th.0 Request processed in 75us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074181.145288:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783074181.145348:0:93100:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.145359:0:93100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93100:1869685723599232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.145394:0:93100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93100:1869685723599360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.145425:0:93100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.145446:0:93100:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.145483:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599360 00000100:00100000:2.0:1783074181.145489:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599360 00000100:00100000:1.0:1783074181.145523:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783074181.145538:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+16:93100:x1869685723599360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.145616:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+16:93100:x1869685723599360:12345-0@lo:502:llog_process_th.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.145628:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783074181.145648:0:93100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93100:1869685723599360:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074181.145671:0:93100:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1783074181.145843:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1783074181.145864:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074181.145874:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.145885:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074181.145895:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783074181.145898:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:0.0:1783074181.145900:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783074181.145932:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.145941:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.145951:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.145964:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.145991:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074181.146103:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599488 00000100:00100000:2.0:1783074181.146107:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599488 00000100:00100000:0.0:1783074181.146108:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.146129:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783074181.146136:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723599488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074181.146145:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074181.146156:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e02fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e02f4 expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.146181:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e02fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e02f4 expref: 17 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.146197:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e02fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e02f4 expref: 17 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.146204:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6400, rc 0) 00000100:00100000:2.0:1783074181.146245:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723599488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.146252:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783074181.146335:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.146345:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.146351:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.146386:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.146409:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.146437:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.146485:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599616 00000100:00100000:1.0:1783074181.146490:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599616 00000100:00100000:1.0:1783074181.146518:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783074181.146522:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723599616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.146595:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723599616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.146600:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783074181.146619:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.146642:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.146667:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074181.146686:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c481bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.146800:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599744 00000100:00100000:3.0:1783074181.146805:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599744 00000100:00100000:3.0:1783074181.146879:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783074181.146887:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723599744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074181.147196:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723599744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 310us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.147204:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783074181.147279:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723599744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.147593:0:93101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93101:1869685723599872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.147631:0:93101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.147659:0:93101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c538ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.147709:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723599872 00000100:00100000:2.0:1783074181.147714:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723599872 00000100:00100000:2.0:1783074181.147743:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783074181.147749:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:93101:x1869685723599872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.147835:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:93101:x1869685723599872:12345-0@lo:502:llog_process_th.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.147842:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783074181.147906:0:93101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93101:1869685723599872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074181.147927:0:93101:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074181.147937:0:93101:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074181.147939:0:93101:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1783074181.147947:0:93101:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1783074181.147964:0:93101:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1783074181.148536:0:93101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93101:1869685723600000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.148572:0:93101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.148592:0:93101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5757180 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.148603:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600000 00000100:00100000:1.0:1783074181.148606:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600000 00000100:00100000:1.0:1783074181.148627:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783074181.148634:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:93101:x1869685723600000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.148713:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:93101:x1869685723600000:12345-0@lo:502:llog_process_th.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.148727:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783074181.148768:0:93101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93101:1869685723600000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074181.148785:0:93101:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074181.148790:0:93101:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074181.148792:0:93101:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1783074181.148796:0:93101:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000004:1.0:1783074181.148908:0:93102:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6e2d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783074181.148912:0:93102:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6e2d800 4 00000020:01000000:3.0:1783074181.150140:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1783074181.150170:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783074181.150181:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074181.150194:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074181.150206:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783074181.150208:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 55 10000000:01000000:3.0:1783074181.150211:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074181.150245:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074181.150255:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074181.150265:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074181.150290:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074181.150426:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074181.150499:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a86e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.150610:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600128 00000100:00100000:2.0:1783074181.150615:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600128 00000100:00100000:2.0:1783074181.150686:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783074181.150695:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723600128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074181.150802:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074181.150822:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6800/0x5fb609b3016e0309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0302 expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.150848:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6800/0x5fb609b3016e0309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0302 expref: 18 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.150859:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6800/0x5fb609b3016e0309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0302 expref: 18 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.150868:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6800, rc 0) 00000100:00100000:2.0:1783074181.150907:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723600128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.150912:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783074181.150972:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.150996:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.151003:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.151060:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.151079:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.151220:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.151268:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600256 00000100:00100000:3.0:1783074181.151271:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600256 00000100:00100000:3.0:1783074181.151295:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783074181.151299:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723600256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074181.151402:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723600256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.151409:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783074181.151480:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.151507:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.151542:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.151563:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.151602:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600384 00000100:00100000:3.0:1783074181.151605:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600384 00000100:00100000:3.0:1783074181.151626:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783074181.151630:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723600384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074181.151695:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723600384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.151712:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783074181.151781:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.152302:0:93103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93103:1869685723600512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.152362:0:93103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.152377:0:93103:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c33e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.152427:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600512 00000100:00100000:1.0:1783074181.152432:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600512 00000100:00100000:1.0:1783074181.152463:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783074181.152470:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:93103:x1869685723600512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.152561:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:93103:x1869685723600512:12345-0@lo:502:llog_process_th.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.152567:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783074181.152640:0:93103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93103:1869685723600512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.152677:0:93103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93103:1869685723600640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.152718:0:93103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.152744:0:93103:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.152789:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600640 00000100:00100000:3.0:1783074181.152793:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600640 00000100:00100000:3.0:1783074181.152822:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783074181.152828:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:93103:x1869685723600640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.152906:0:93103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93103:1869685723600640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074181.152923:0:93103:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000100:00100000:3.0:1783074181.153132:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:93103:x1869685723600640:12345-0@lo:502:llog_process_th.0 Request processed in 303us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.153140:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000020:01000000:0.0:1783074181.153199:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1783074181.153221:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074181.153230:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.153240:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074181.153259:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783074181.153261:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:0.0:1783074181.153264:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783074181.153285:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.153292:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.153301:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.153380:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.153414:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.153453:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600768 00000100:00100000:1.0:1783074181.153457:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600768 00000100:00100000:1.0:1783074181.153491:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783074181.153500:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723600768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074181.153510:0:92373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074181.153522:0:92373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e0317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0310 expref: -99 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.153545:0:92373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e0317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0310 expref: 19 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.153555:0:92373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e0317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0310 expref: 19 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.153571:0:92373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151aa00, rc 0) 00000100:00100000:1.0:1783074181.153593:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723600768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.153597:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783074181.153736:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.153749:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.153764:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.153773:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.153817:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.153841:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.153858:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.153878:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723600896 00000100:00100000:2.0:1783074181.153884:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723600896 00000100:00100000:2.0:1783074181.153918:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783074181.153926:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723600896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.154032:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723600896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.154039:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783074181.154180:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723600896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.154206:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.154247:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.154268:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.154307:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601024 00000100:00100000:2.0:1783074181.154335:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601024 00000100:00100000:2.0:1783074181.154364:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783074181.154371:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723601024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.154439:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723601024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.154454:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783074181.154624:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.154938:0:93104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93104:1869685723601152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.154972:0:93104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074181.154997:0:93104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.155018:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601152 00000100:00100000:1.0:1783074181.155023:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601152 00000100:00100000:1.0:1783074181.155055:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783074181.155063:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fb6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:93104:x1869685723601152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.155150:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fb6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:93104:x1869685723601152:12345-0@lo:502:llog_process_th.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.155157:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783074181.155229:0:93104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93104:1869685723601152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074181.155250:0:93104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074181.155260:0:93104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074181.155263:0:93104:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783074181.155269:0:93104:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1783074181.155284:0:93104:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1783074181.155301:0:93104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93104:1869685723601280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.155364:0:93104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074181.155396:0:93104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.155410:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601280 00000100:00100000:0.0:1783074181.155415:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601280 00000100:00100000:0.0:1783074181.155447:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783074181.155454:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:93104:x1869685723601280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.155526:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:93104:x1869685723601280:12345-0@lo:502:llog_process_th.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074181.155533:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783074181.155606:0:93104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93104:1869685723601280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074181.155623:0:93104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074181.155627:0:93104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074181.155628:0:93104:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783074181.155631:0:93104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:0.0:1783074181.155727:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:0.0:1783074181.155745:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783074181.155753:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.155762:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074181.155771:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074181.155773:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 55 10000000:01000000:0.0:1783074181.155776:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074181.155795:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.155803:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.155812:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.155840:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.155865:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.155910:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.155981:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601408 00000100:00100000:1.0:1783074181.155985:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601408 00000100:00100000:1.0:1783074181.156009:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783074181.156016:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723601408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074181.156024:0:92367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074181.156036:0:92367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c151a800/0x5fb609b3016e0325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e031e expref: -99 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.156056:0:92367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c151a800/0x5fb609b3016e0325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e031e expref: 20 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.156066:0:92367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c151a800/0x5fb609b3016e0325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e031e expref: 20 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.156075:0:92367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151a800, rc 0) 00000100:00100000:1.0:1783074181.156152:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723601408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.156158:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783074181.156163:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.156175:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.156184:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.156221:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.156238:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.156252:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.156268:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601536 00000100:00100000:1.0:1783074181.156272:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601536 00000100:00100000:1.0:1783074181.156300:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783074181.156306:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723601536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.156410:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723601536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.156417:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783074181.156524:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.156543:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.156567:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.156587:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d109e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.156598:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601664 00000100:00100000:2.0:1783074181.156602:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601664 00000100:00100000:2.0:1783074181.156629:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783074181.156635:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723601664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.156714:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723601664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.156720:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783074181.156737:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723601664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.157159:0:93105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93105:1869685723601792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.157184:0:93105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074181.157199:0:93105:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4491540 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.157217:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601792 00000100:00100000:1.0:1783074181.157221:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601792 00000100:00100000:1.0:1783074181.157275:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783074181.157280:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:93105:x1869685723601792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.157413:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:93105:x1869685723601792:12345-0@lo:502:llog_process_th.0 Request processed in 133us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.157420:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783074181.157428:0:93105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93105:1869685723601792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.157458:0:93105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93105:1869685723601920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.157611:0:93105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074181.157635:0:93105:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4491540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.157680:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723601920 00000100:00100000:3.0:1783074181.157690:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723601920 00000100:00100000:3.0:1783074181.157735:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783074181.157742:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:93105:x1869685723601920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074181.157822:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:93105:x1869685723601920:12345-0@lo:502:llog_process_th.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.157825:0:93105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93105:1869685723601920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074181.157829:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000040:00080000:2.0:1783074181.157843:0:93105:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1783074181.158134:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1783074181.158153:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074181.158162:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.158173:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074181.158187:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783074181.158190:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783074181.158192:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783074181.158212:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.158221:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.158229:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.158241:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.158266:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.158287:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.158358:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602048 00000100:00100000:2.0:1783074181.158362:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602048 00000100:00100000:2.0:1783074181.158385:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783074181.158392:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723602048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074181.158400:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074181.158411:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e0333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e032c expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.158432:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e0333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e032c expref: 21 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.158443:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e0333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e032c expref: 21 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.158452:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6e00, rc 0) 00000100:00100000:2.0:1783074181.158492:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723602048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.158498:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783074181.158603:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.158614:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.158622:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.158661:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.158684:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.158720:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.158761:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602176 00000100:00100000:1.0:1783074181.158765:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602176 00000100:00100000:1.0:1783074181.158794:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783074181.158801:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723602176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.158970:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723602176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.158977:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783074181.159036:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.159060:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.159095:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.159118:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.159218:0:92368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602304 00000100:00100000:3.0:1783074181.159223:0:92368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602304 00000100:00100000:3.0:1783074181.159249:0:92368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783074181.159255:0:92368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723602304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074181.159362:0:92368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723602304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.159369:0:92368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783074181.159493:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074181.160453:0:93106:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783074181.160613:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783074181.160635:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783074181.160643:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.160652:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074181.160660:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074181.160662:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 55 10000000:01000000:0.0:1783074181.160665:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074181.160688:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.160696:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.160715:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.160730:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.160767:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.160844:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.160912:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602432 00000100:00100000:2.0:1783074181.160915:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602432 00000100:00100000:2.0:1783074181.161097:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783074181.161106:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723602432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074181.161117:0:92372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074181.161129:0:92372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e0341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e033a expref: -99 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.161152:0:92372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e0341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e033a expref: 22 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.161162:0:92372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e0341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e033a expref: 22 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074181.161171:0:92372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7e00, rc 0) 00000100:00100000:2.0:1783074181.161238:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723602432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.161245:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783074181.161375:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.161388:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.161406:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.161820:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.161844:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.161901:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.161936:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602560 00000100:00100000:1.0:1783074181.161940:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602560 00000100:00100000:1.0:1783074181.161973:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783074181.161981:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723602560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.162574:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723602560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 591us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.162582:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783074181.162640:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.162670:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.162735:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.162764:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.162810:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602688 00000100:00100000:1.0:1783074181.162813:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602688 00000100:00100000:1.0:1783074181.162846:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783074181.162854:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c8730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723602688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.163025:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c8730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723602688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.163030:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783074181.163073:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723602688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.163388:0:93107:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93107:1869685723602816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.163415:0:93107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.163426:0:93107:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a000 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.163539:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602816 00000100:00100000:2.0:1783074181.163542:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602816 00000100:00100000:2.0:1783074181.163565:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783074181.163576:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93107:x1869685723602816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074181.163659:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93107:x1869685723602816:12345-0@lo:502:llog_process_th.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.163666:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783074181.163674:0:93107:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93107:1869685723602816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.163717:0:93107:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93107:1869685723602944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074181.163749:0:93107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.163774:0:93107:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074181.163807:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723602944 00000100:00100000:1.0:1783074181.163810:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723602944 00000100:00100000:1.0:1783074181.163829:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783074181.163835:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93107:x1869685723602944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074181.163935:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:93107:x1869685723602944:12345-0@lo:502:llog_process_th.0 Request processed in 100us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.163942:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783074181.164034:0:93107:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:93107:1869685723602944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783074181.164047:0:93107:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1783074181.164161:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1783074181.164175:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074181.164181:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.164188:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074181.164199:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783074181.164200:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783074181.164202:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074181.164221:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.164229:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.164238:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074181.164250:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.164275:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.164340:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.164380:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603072 00000100:00100000:0.0:1783074181.164384:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603072 00000100:00100000:0.0:1783074181.164412:0:92369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783074181.164424:0:92369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723603072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.164433:0:92369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074181.164445:0:92369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9525021da400/0x5fb609b3016e034f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0348 expref: -99 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.164466:0:92369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9525021da400/0x5fb609b3016e034f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0348 expref: 23 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.164476:0:92369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9525021da400/0x5fb609b3016e034f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0348 expref: 23 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.164485:0:92369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da400, rc 0) 00000100:00100000:0.0:1783074181.164567:0:92369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723603072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074181.164571:0:92369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783074181.164604:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074181.164614:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.164620:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074181.164651:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.164673:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.164695:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.164720:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603200 00000100:00100000:2.0:1783074181.164724:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603200 00000100:00100000:2.0:1783074181.164746:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783074181.164752:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723603200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.164851:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723603200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074181.164858:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783074181.164872:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.164896:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.164931:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.164993:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64299c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074181.165064:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603328 00000100:00100000:3.0:1783074181.165067:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603328 00000100:00100000:3.0:1783074181.165111:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783074181.165116:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723603328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074181.165190:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723603328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074181.165194:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783074181.165242:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074181.166676:0:93108:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1783074181.167035:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1783074181.167051:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783074181.167058:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.167066:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074181.167073:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783074181.167075:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:1.0:1783074181.167076:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783074181.167099:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.167105:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.167111:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074181.167124:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074181.167159:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074181.167193:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c64299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074181.167278:0:92369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603456 00000100:00100000:0.0:1783074181.167284:0:92369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603456 00000100:00100000:1.0:1783074181.167366:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783074181.167375:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723603456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074181.167401:0:92373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074181.167413:0:92373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c151bc00/0x5fb609b3016e035d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0356 expref: -99 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.167436:0:92373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c151bc00/0x5fb609b3016e035d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0356 expref: 24 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.167447:0:92373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c151bc00/0x5fb609b3016e035d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0356 expref: 24 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.167457:0:92373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151bc00, rc 0) 00000100:00100000:1.0:1783074181.167499:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723603456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074181.167505:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783074181.167528:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074181.167544:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074181.167552:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074181.167597:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074181.167620:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074181.167677:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074181.168537:0:92372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603584 00000100:00100000:2.0:1783074181.168542:0:92372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603584 00000100:00100000:2.0:1783074181.168580:0:92372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783074181.168588:0:92372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723603584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074181.168680:0:92372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723603584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (1058us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074181.168689:0:92372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783074181.168722:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723603584:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783074181.168753:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783074181.168760:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074181.168767:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074181.743514:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074182.143977:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074182.144068:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086528 00000100:00100000:3.0:1783074182.144086:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086528 00000100:00100000:3.0:1783074182.144185:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1292 00000100:00100000:3.0:1783074182.144198:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71877:x1869685708086528:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:3.0:1783074182.144221:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074182.144249:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b26c expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.144336:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016e036b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.144353:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016e036b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.144368:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016e036b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074182.144418:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074182.144421:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074182.144459:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016e036b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.144487:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b26c expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.144506:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016e036b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b26c expref: 7 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.144520:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:3.0:1783074182.144524:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074182.144528:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671000, rc 0) 00000100:00100000:3.0:1783074182.144580:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708086528:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 385us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.144586:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1292 00000100:00100000:0.0:1783074182.147415:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074182.148591:0:66210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086656 00000100:00100000:1.0:1783074182.148600:0:66210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086656 00000100:00100000:1.0:1783074182.148799:0:66210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1783074182.148810:0:66210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708086656:12345-192.168.204.26@tcp:700:mkdir.0 00000100:00100000:1.0:1783074182.148901:0:66210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708086656:12345-192.168.204.26@tcp:700:mkdir.0 Request processed in 92us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.148909:0:66210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:0.0:1783074182.151113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.152566:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708086912 00000100:00100000:2.0:1783074182.152575:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708086912 00000100:00100000:2.0:1783074182.152643:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1293 00000100:00100000:2.0:1783074182.152657:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708086912:12345-192.168.204.26@tcp:36:mkdir.0 00010000:00010000:2.0:1783074182.152720:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074182.152749:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671000/0x5fb609b3016e036b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b26c expref: 7 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.152767:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:2.0:1783074182.152773:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074182.152852:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.152870:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.152881:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.152903:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.152912:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.152919:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.153931:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.153944:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.153952:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074182.153967:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060392561 reply state 00000000225e80ac transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.153977:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.153983:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9523c8d7c100) 00010000:00010000:2.0:1783074182.153986:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074182.153989:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783074182.153994:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783074182.154002:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154009:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154022:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154029:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154035:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074182.154040:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154047:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154056:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:2.0:1783074182.154058:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074182.154062:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154067:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0372 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074182.154077:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060392561 reply state 00000000225e80ac transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154085:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.154090:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9523c8d7c600) 00010000:00010000:2.0:1783074182.154093:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074182.154095:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783074182.154180:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71877:x1869685708086912:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 1527us (3070us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1783074182.154194:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1293 00000100:00100000:2.0:1783074182.158177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074182.158221:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708087040 00000100:00100000:3.0:1783074182.158236:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708087040 00000100:00100000:3.0:1783074182.158281:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1294 00000100:00100000:3.0:1783074182.158287:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71877:x1869685708087040:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:3.0:1783074182.158306:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074182.158338:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b273 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.158388:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016e038e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.158399:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016e038e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.158409:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016e038e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074182.158440:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074182.158443:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074182.158458:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016e038e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.158482:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b273 expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.158499:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016e038e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b273 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.158508:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:3.0:1783074182.158511:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074182.158515:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670600, rc 0) 00000100:00100000:3.0:1783074182.158576:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71877:x1869685708087040:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 288us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.158581:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1294 00000100:00100000:0.0:1783074182.163779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074182.164032:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708087296 00000100:00100000:3.0:1783074182.164041:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708087296 00000100:00100000:3.0:1783074182.164126:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1295 00000100:00100000:3.0:1783074182.164138:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71877:x1869685708087296:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:3.0:1783074182.164158:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074182.164176:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b27a expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164243:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164258:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164269:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164279:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164286:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164291:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074182.164414:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783074182.164588:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164602:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164609:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164616:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164621:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074182.164626:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164634:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164648:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:3.0:1783074182.164651:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074182.164656:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164662:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e039c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164674:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164691:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164697:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164708:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074182.164711:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.164716:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.166531:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9523c8d7c600) 00010000:00010000:3.0:1783074182.166535:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074182.166541:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.166549:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.166592:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0395 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b27a expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.166603:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:3.0:1783074182.166606:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074182.166611:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e0395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b27a expref: 11 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.166620:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:3.0:1783074182.166695:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71877:x1869685708087296:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 2558us (2921us total) trans 120259084292 rc 301/301 00000100:00100000:3.0:1783074182.166704:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1295 00000100:00100000:0.0:1783074182.171379:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074182.171416:0:66211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708087424 00000100:00100000:1.0:1783074182.171425:0:66211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708087424 00000100:00100000:1.0:1783074182.171477:0:66211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1783074182.171490:0:66211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71877:x1869685708087424:12345-192.168.204.26@tcp:900:mkdir.0 00000100:00100000:1.0:1783074182.171573:0:66211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71877:x1869685708087424:12345-192.168.204.26@tcp:900:mkdir.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.171581:0:66211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1783074182.173176:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.173206:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708087680 00000100:00100000:2.0:1783074182.173213:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708087680 00000100:00100000:2.0:1783074182.173258:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:2.0:1783074182.173266:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71877:x1869685708087680:12345-192.168.204.26@tcp:35:mkdir.0 00000100:00100000:2.0:1783074182.173747:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71877:x1869685708087680:12345-192.168.204.26@tcp:35:mkdir.0 Request processed in 480us (573us total) trans 120259084293 rc 0/0 00000100:00100000:2.0:1783074182.173755:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:0.0:1783074182.175546:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.175569:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708087936 00000100:00100000:0.0:1783074182.175574:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708087936 00000100:00100000:0.0:1783074182.175664:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1296 00000100:00100000:0.0:1783074182.175675:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71877:x1869685708087936:12345-192.168.204.26@tcp:36:mkdir.0 00000100:00100000:0.0:1783074182.175798:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723603712:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.175909:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.175928:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.175944:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603712 00000100:00100000:1.0:1783074182.175950:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603712 00000100:00100000:1.0:1783074182.175989:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:1.0:1783074182.175997:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723603712:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.176065:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723603712:12345-0@lo:1000:mdt00_004.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.176072:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1783074182.176073:0:68632:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:0.0:1783074182.176079:0:68632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:0.0:1783074182.176093:0:68632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:0.0:1783074182.176097:0:68632:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9524fb394a80 refcount 2 committed 0 result 0 batchid 73014444083 00000020:00080000:0.0:1783074182.176100:0:68632:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524f3d64800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9524fb394cc0 00000020:00080000:0.0:1783074182.176103:0:68632:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].2 00000020:00080000:0.0:1783074182.176105:0:68632:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524f3d64c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9524fc57be00 00000020:00080000:0.0:1783074182.176106:0:68632:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].2 00000020:00080000:1.0:1783074182.176125:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444083 committed batchid 73014444082 00000100:00100000:0.0:1783074182.176132:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723603712:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.176182:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723603840:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.176200:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.176221:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573bb40 going to sleep for 11 seconds 00000020:00080000:1.0:1783074182.176242:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444082 00000100:00100000:2.0:1783074182.176279:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603840 00000100:00100000:2.0:1783074182.176284:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603840 00000100:00100000:0.0:1783074182.176488:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1783074182.176497:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723603840:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.176579:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723603840:12345-0@lo:1000:mdt00_004.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.176587:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:1.0:1783074182.176824:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723603840:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.176863:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723603968:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.176892:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.176913:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.176971:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723603968 00000100:00100000:0.0:1783074182.176976:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723603968 00000100:00100000:0.0:1783074182.177002:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1783074182.177009:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723603968:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.177225:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723603968:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.177229:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723603968:12345-0@lo:1000:mdt00_004.0 Request processed in 217us (334us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783074182.177240:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00010000:00010000:1.0:1783074182.177287:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.177298:0:68632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.177335:0:68632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.177348:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604096:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1783074182.177372:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.177390:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.177713:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604096 00000100:00100000:0.0:1783074182.177717:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604096 00000100:00100000:0.0:1783074182.177750:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1783074182.177756:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68632:x1869685723604096:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1783074182.177766:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074182.177779:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e03b1 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.177803:0:26189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.177813:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.177828:0:26189:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1783074182.177853:0:26189:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1783074182.177899:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.177909:0:26189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9523c8d7c100) 00010000:00010000:0.0:1783074182.177912:0:26189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.177917:0:26189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.177924:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dbe00, rc 0) 00000100:00100000:0.0:1783074182.177957:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68632:x1869685723604096:12345-0@lo:101:mdt00_004.0 Request processed in 202us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.177964:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1783074182.177990:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604096:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1783074182.178004:0:68632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.178014:0:68632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074182.179922:0:92362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084293 is committed 00010000:00010000:1.0:1783074182.179949:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.179962:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.179970:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.179976:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074182.179981:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.179989:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180006:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9523c8d7c600) 00010000:00010000:1.0:1783074182.180010:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074182.180014:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180028:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0379 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180047:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180055:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180062:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180068:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074182.180070:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180076:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180085:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9523c8d7c100) 00010000:00010000:1.0:1783074182.180088:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074182.180093:0:3645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180104:0:3645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180114:0:3645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180159:0:3645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.180172:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3645:1869685723604224:0@lo:105: 00000100:00100000:1.0:1783074182.180220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.180268:0:3645:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.180525:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604224 00000100:00100000:0.0:1783074182.180533:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604224 00000100:00100000:0.0:1783074182.180577:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783074182.180589:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3645:x1869685723604224:12345-0@lo:105: 00010000:00010000:0.0:1783074182.180599:0:10348:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180619:0:10348:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180636:0:10348:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180645:0:10348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180652:0:10348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180661:0:10348:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180695:0:10348:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9524c151a600) 00010000:00010000:1.0:1783074182.180741:0:68632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074182.180741:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3645:x1869685723604224:12345-0@lo:105: Request processed in 155us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.180749:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783074182.180787:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3645:1869685723604224:0@lo:105: 00010000:00010000:0.0:1783074182.180808:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.180815:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e0380 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180819:0:68632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074182.180840:0:68632:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1783074182.180950:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180956:0:68632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.180964:0:68632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.180975:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604352:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1783074182.181000:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.181022:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.181038:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604352 00000100:00100000:0.0:1783074182.181042:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604352 00000100:00100000:0.0:1783074182.181074:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1783074182.181081:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68632:x1869685723604352:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1783074182.181103:0:23954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074182.181119:0:23954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e03bf expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.181139:0:23954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e03bf expref: 9 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.181151:0:23954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03bf expref: 9 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.181159:0:23954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9524d2de4800) 00010000:00010000:0.0:1783074182.181162:0:23954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.181165:0:23954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dbc00, rc 0) 00000100:00100000:0.0:1783074182.181198:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604352:12345-0@lo:101:mdt00_004.0 Request processed in 117us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.181204:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1783074182.181214:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604352:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1783074182.181227:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.181243:0:68632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074182.181258:0:68632:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:1.0:1783074182.181285:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604480:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.181308:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.181352:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.181370:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604480 00000100:00100000:0.0:1783074182.181427:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604480 00000100:00100000:0.0:1783074182.181473:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:0.0:1783074182.181483:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604480:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.181558:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604480:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.181566:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1783074182.181655:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604480:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.181779:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604608:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.181813:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.181838:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.181905:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604608 00000100:00100000:0.0:1783074182.181910:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604608 00000100:00100000:0.0:1783074182.181949:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:0.0:1783074182.181959:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604608:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.182042:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604608:12345-0@lo:1000:mdt00_004.0 Request processed in 86us (229us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783074182.182048:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:0.0:1783074182.182080:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604608:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.182144:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604736:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.182169:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.182182:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b600 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.182261:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604736 00000100:00100000:1.0:1783074182.182264:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604736 00000100:00100000:1.0:1783074182.182293:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1783074182.182301:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604736:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.182377:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604736:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (206us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074182.182384:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:0.0:1783074182.182490:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604736:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.182531:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604864:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.182550:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.182573:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b600 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.182588:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604864 00000100:00100000:1.0:1783074182.182592:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604864 00000100:00100000:1.0:1783074182.182633:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:1.0:1783074182.182641:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604864:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.182733:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604864:12345-0@lo:1000:mdt00_004.0 Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.182740:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:2.0:1783074182.185898:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604864:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783074182.185976:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604992:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783074182.186023:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074182.186054:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d08d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.186557:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723604992 00000100:00100000:1.0:1783074182.186569:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723604992 00000100:00100000:1.0:1783074182.186621:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:1.0:1783074182.186637:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604992:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.186805:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723604992:12345-0@lo:1000:mdt00_004.0 Request processed in 164us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.186812:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1783074182.186984:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723604992:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783074182.187040:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723605120:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783074182.187063:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074182.187086:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4491d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.187142:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723605120 00000100:00100000:0.0:1783074182.187147:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723605120 00000100:00100000:0.0:1783074182.187226:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:0.0:1783074182.187234:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723605120:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.187351:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68632:x1869685723605120:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.187358:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:2.0:1783074182.187418:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68632:1869685723605120:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1783074182.187949:0:68632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].3, 968 off35168 00000040:00080000:2.0:1783074182.188002:0:68632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].3, 1120 off35552 00000004:00080000:2.0:1783074182.188018:0:68632:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9524d08d4240 with version 10 00000004:00080000:3.0:1783074182.188353:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 10 rpc_version 10 00000020:00100000:3.0:1783074182.188383:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783074182.188392:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9524c4b16a00 x1869685723605376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074182.188411:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723605376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783074182.188450:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.188504:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.188528:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723605376 00000100:00100000:0.0:1783074182.188533:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723605376 00000100:00100000:0.0:1783074182.188607:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1783074182.188621:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75600:x1869685723605376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783074182.188976:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75600:x1869685723605376:12345-0@lo:1000:osp_up0-1.0 Request processed in 361us (524us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1783074182.188983:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:3.0:1783074182.189059:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723605376:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783074182.189142:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189163:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189181:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074182.189202:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df739fe0 reply state 00000000ea6b3a0c transno 77309411462 ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189213:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189227:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:2.0:1783074182.189230:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074182.189234:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783074182.189240:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:2.0:1783074182.189253:0:68632:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1783074182.189261:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189275:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189283:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189336:0:68632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783074182.189342:0:68632:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1783074182.189348:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.189370:0:68632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.189459:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074182.189466:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.189474:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a600 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:1.0:1783074182.189480:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074182.189496:0:8460:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.189529:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.189536:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074182.189571:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074182.189582:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708087936:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 13906us (14035us total) trans 77309411462 rc 0/0 00010000:00010000:1.0:1783074182.189587:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a600/0x5fb609b3016e03b1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e03b8 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074182.189593:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1296 00010000:00010000:1.0:1783074182.189617:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074182.189619:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783074182.189626:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074182.189629:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074182.189632:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723605504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074182.189666:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.189841:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723605504 00000100:00100000:1.0:1783074182.189846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723605504 00000100:00100000:1.0:1783074182.189885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1783074182.189891:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3659:x1869685723605504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074182.189908:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074182.189925:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e03b8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e03b1 expref: 10 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.189936:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9523c8d7c100) 00010000:00010000:1.0:1783074182.189943:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074182.189975:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3659:x1869685723605504:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.189989:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1783074182.189998:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723605504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074182.192736:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074182.192781:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708088192 00000100:00100000:1.0:1783074182.192788:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708088192 00000100:00100000:1.0:1783074182.192836:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1297 00000100:00100000:1.0:1783074182.192845:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708088192:12345-192.168.204.26@tcp:36:mkdir.0 00010000:00010000:1.0:1783074182.192917:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074182.192939:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670600/0x5fb609b3016e038e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b273 expref: 7 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.192956:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:1.0:1783074182.192961:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074182.193103:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71877:x1869685708088192:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 253us (366us total) trans 0 rc -17/-17 00000100:00100000:1.0:1783074182.193111:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1297 00000100:00100000:3.0:1783074182.194672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.194733:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708088320 00000100:00100000:2.0:1783074182.194740:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708088320 00000100:00100000:2.0:1783074182.194797:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1298 00000100:00100000:2.0:1783074182.194806:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71877:x1869685708088320:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:2.0:1783074182.194827:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074182.194856:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e03d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b281 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.194923:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e03db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.194938:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e03db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.194951:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e03db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074182.194992:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074182.194995:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074182.195011:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e03db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.195031:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e03d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b281 expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.195062:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e03db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b281 expref: 7 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.195070:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:2.0:1783074182.195073:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074182.195076:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7c00, rc 0) 00000100:00100000:2.0:1783074182.195122:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708088320:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 318us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.195137:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1298 00000100:00100000:0.0:1783074182.197198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074182.197301:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708088448 00000100:00100000:3.0:1783074182.197308:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708088448 00000100:00100000:3.0:1783074182.197596:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1299 00000100:00100000:3.0:1783074182.197605:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708088448:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:3.0:1783074182.197621:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074182.197652:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e03e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b288 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197721:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197736:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197800:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197818:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197825:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197858:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197924:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197932:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197939:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074182.197967:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074182.197971:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074182.197984:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.197997:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198004:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198028:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198035:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198041:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074182.198050:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198059:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198070:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:3.0:1783074182.198079:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074182.198084:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198090:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e03e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198103:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198114:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198119:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198124:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074182.198131:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198138:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198152:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9524fc299800) 00010000:00010000:3.0:1783074182.198155:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074182.198158:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198164:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670e00/0x5fb609b3016e03f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198194:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670200/0x5fb609b3016e03e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198211:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 8 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.198218:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524fc299600) 00010000:00010000:3.0:1783074182.198220:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074182.198223:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670a00, rc 0) 00000100:00100000:3.0:1783074182.198288:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71877:x1869685708088448:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 684us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.198301:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1299 00000100:00100000:3.0:1783074182.199672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074182.199719:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708088704 00000100:00100000:1.0:1783074182.199726:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708088704 00000100:00100000:1.0:1783074182.199769:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1300 00000100:00100000:1.0:1783074182.199779:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71877:x1869685708088704:12345-192.168.204.26@tcp:36:mkdir.0 00000100:00100000:1.0:1783074182.199895:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723605632:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783074182.199941:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.199974:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429600 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.200320:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723605632 00000100:00100000:0.0:1783074182.200325:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723605632 00000100:00100000:0.0:1783074182.200358:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1783074182.200366:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66202:x1869685723605632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783074182.200459:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66202:x1869685723605632:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.200467:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1783074182.200562:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723605632:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.200630:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723605760:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.200665:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.200702:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.200716:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723605760 00000100:00100000:1.0:1783074182.200721:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723605760 00000100:00100000:1.0:1783074182.200752:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:1.0:1783074182.200760:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66202:x1869685723605760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783074182.200837:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66202:x1869685723605760:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (170us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074182.200844:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1783074182.202783:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723605760:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783074182.202856:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.202867:0:66202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.202878:0:66202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074182.202894:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723605888:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783074182.202937:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.202978:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.204297:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723605888 00000100:00100000:1.0:1783074182.204304:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723605888 00000100:00100000:1.0:1783074182.204388:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1783074182.204399:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66202:x1869685723605888:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1783074182.204416:0:23954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074182.204435:0:23954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e03fe expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.204475:0:23954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 7 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.204486:0:23954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.204531:0:23954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 7 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.204546:0:23954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 7 pid: 68632 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.204559:0:23954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23954:1869685723606016:192.168.204.26@tcp:104: 00000100:00100000:1.0:1783074182.204632:0:23954:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429240 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.206727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.206777:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708088832 00000100:00100000:2.0:1783074182.206784:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708088832 00010000:00010000:2.0:1783074182.206817:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 5/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 8 pid: 68632 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074182.206899:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2609 00000100:00100000:2.0:1783074182.206909:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2405:x1869685708088832:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783074182.206923:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074182.206930:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 5/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 8 pid: 68632 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.206943:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 8 pid: 68632 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.206966:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524fc299600) 00010000:00010000:2.0:1783074182.206973:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.206995:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.207006:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.207038:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074182.207050:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1869685723606144:0@lo:105: 00000100:00100000:2.0:1783074182.207092:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074182.207140:0:6515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074182.207166:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606144 00000100:00100000:3.0:1783074182.207170:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606144 00000100:00100000:3.0:1783074182.207201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1783074182.207206:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6515:x1869685723606144:12345-0@lo:105: 00010000:00010000:3.0:1783074182.207216:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207225:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207232:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207237:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207247:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207253:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207263:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9524fb671400) 00000100:00100000:3.0:1783074182.207334:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6515:x1869685723606144:12345-0@lo:105: Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.207340:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1783074182.207356:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1869685723606144:0@lo:105: 00010000:00010000:2.0:1783074182.207373:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074182.207407:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2405:x1869685708088832:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 500us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.207414:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2609 00010000:00010000:0.0:1783074182.207750:0:23954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670a00/0x5fb609b3016e03f7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b288 expref: 7 pid: 68632 timeout: 3121 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074182.207769:0:23954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23954:1869685723606016:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074182.207786:0:23954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.207792:0:23954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524fc299600) 00010000:00010000:0.0:1783074182.207794:0:23954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.207796:0:23954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151a600, rc 0) 00000100:00100000:0.0:1783074182.207831:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66202:x1869685723605888:12345-0@lo:101:mdt00_002.0 Request processed in 3436us (4895us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.207836:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1783074182.207882:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723605888:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783074182.207895:0:66202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783074182.207910:0:66202:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1783074182.207936:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207941:0:66202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.207946:0:66202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074182.207955:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606272:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783074182.207975:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.207998:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.208221:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606272 00000100:00100000:0.0:1783074182.208226:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606272 00000100:00100000:0.0:1783074182.208264:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1783074182.208271:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66202:x1869685723606272:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1783074182.208287:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074182.208306:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e040c expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.208351:0:26189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e040c expref: 11 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.208362:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e040c expref: 11 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.208369:0:26189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9524d2de4200) 00010000:00010000:0.0:1783074182.208372:0:26189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.208375:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28f400, rc 0) 00000100:00100000:0.0:1783074182.208408:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606272:12345-0@lo:101:mdt00_002.0 Request processed in 138us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.208414:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:3.0:1783074182.208491:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606272:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783074182.208503:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.208512:0:66202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783074182.208524:0:66202:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:3.0:1783074182.208557:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606400:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.208578:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.208600:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.208621:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606400 00000100:00100000:0.0:1783074182.208626:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606400 00000100:00100000:0.0:1783074182.208660:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1783074182.208667:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783074182.208756:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606400:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.208762:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1783074182.208848:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606400:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.208887:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606528:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.208910:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.208938:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.208956:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606528 00000100:00100000:1.0:1783074182.208962:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606528 00000100:00100000:1.0:1783074182.208997:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:1.0:1783074182.209005:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783074182.209080:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606528:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (169us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074182.209087:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1783074182.209121:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606528:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.209182:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606656:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.209204:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.209225:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.209244:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606656 00000100:00100000:1.0:1783074182.209250:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606656 00000100:00100000:1.0:1783074182.209279:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:1.0:1783074182.209507:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783074182.209573:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606656:12345-0@lo:1000:mdt00_002.0 Request processed in 287us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074182.209580:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1783074182.209650:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606656:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.209709:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606784:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.209732:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.209787:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.209823:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606784 00000100:00100000:1.0:1783074182.209827:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606784 00000100:00100000:1.0:1783074182.209864:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:1.0:1783074182.209870:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783074182.209969:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606784:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.209977:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:3.0:1783074182.210027:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606784:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.210065:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606912:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.210094:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.210120:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.210169:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723606912 00000100:00100000:0.0:1783074182.210173:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723606912 00000100:00100000:0.0:1783074182.210233:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:0.0:1783074182.210240:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783074182.210301:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723606912:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.210346:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1783074182.210397:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723606912:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.210437:0:66202:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723607040:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783074182.210459:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.210554:0:66202:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.210589:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607040 00000100:00100000:1.0:1783074182.210593:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607040 00000100:00100000:0.0:1783074182.210663:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1783074182.210671:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723607040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783074182.210728:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66202:x1869685723607040:12345-0@lo:1000:mdt00_002.0 Request processed in 58us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.210734:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1783074182.210929:0:66202:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66202:1869685723607040:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1783074182.211377:0:66202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].4, 968 off36136 00000040:00080000:0.0:1783074182.211429:0:66202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].4, 1120 off36672 00000004:00080000:0.0:1783074182.211434:0:66202:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9523c573bc00 with version 11 00000004:00080000:3.0:1783074182.211496:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 11 rpc_version 11 00000020:00100000:3.0:1783074182.211514:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783074182.211522:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9523c4687480 x1869685723607296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074182.211537:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723607296:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783074182.211568:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074182.211596:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.211638:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607296 00000100:00100000:0.0:1783074182.211642:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607296 00000100:00100000:0.0:1783074182.211675:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:0.0:1783074182.211692:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fdfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75600:x1869685723607296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783074182.211968:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fdfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75600:x1869685723607296:12345-0@lo:1000:osp_up0-1.0 Request processed in 273us (394us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1783074182.211976:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:3.0:1783074182.212051:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723607296:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783074182.212109:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212125:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212136:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074182.212148:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0c13702 reply state 00000000fc4263be transno 77309411463 ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212156:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212162:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40400) 00010000:00010000:1.0:1783074182.212164:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074182.212168:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783074182.212175:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1783074182.212190:0:66202:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1783074182.212199:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212219:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212233:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212254:0:66202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783074182.212260:0:66202:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1783074182.212266:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.212273:0:66202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.212278:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074182.212286:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.212296:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671400 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:2.0:1783074182.212303:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.212458:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71877:x1869685708088704:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 12678us (12786us total) trans 77309411463 rc 0/0 00000100:00100000:1.0:1783074182.212469:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1300 00000004:00010000:2.0:1783074182.212964:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.212999:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.213006:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074182.213033:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.213040:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb671400/0x5fb609b3016e03fe lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0405 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.213060:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074182.213061:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074182.213063:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074182.213150:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723607424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074182.213189:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.213268:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607424 00000100:00100000:0.0:1783074182.213273:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607424 00000100:00100000:0.0:1783074182.213306:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1783074182.213386:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3659:x1869685723607424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074182.213398:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074182.213416:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0405 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e03fe expref: 12 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.213441:0:7930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524fc299600) 00010000:00010000:0.0:1783074182.213449:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074182.213488:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3659:x1869685723607424:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.213494:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1783074182.213611:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723607424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074182.222467:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.222608:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708088960 00000100:00100000:0.0:1783074182.222617:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708088960 00000100:00100000:0.0:1783074182.222759:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1301 00000100:00100000:0.0:1783074182.222781:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71878:x1869685708088960:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074182.222827:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074182.222874:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e0421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b28f expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.222959:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.222975:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.222998:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223023:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223031:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223037:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223208:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016e0436 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223217:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016e0436 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223234:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016e0436 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074182.223277:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074182.223281:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074182.223379:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016e0436 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223403:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223410:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223416:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223453:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223460:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.223464:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223471:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223500:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:0.0:1783074182.223503:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.223516:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223523:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fe00/0x5fb609b3016e0428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223548:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223555:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223561:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223566:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.223569:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223582:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223590:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9524d2de4f00) 00010000:00010000:0.0:1783074182.223592:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.223595:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223600:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fc00/0x5fb609b3016e042f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223658:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e0421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b28f expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223672:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016e0436 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b28f expref: 8 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.223700:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524d2de4100) 00010000:00010000:0.0:1783074182.223703:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783074182.223705:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e600, rc 0) 00000100:00100000:0.0:1783074182.223801:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71878:x1869685708088960:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1024us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.223810:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1301 00000100:00100000:3.0:1783074182.226612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.226656:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708089088 00000100:00100000:0.0:1783074182.226665:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708089088 00000100:00100000:0.0:1783074182.226770:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1302 00000100:00100000:0.0:1783074182.226778:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71878:x1869685708089088:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074182.226794:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074182.226809:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ee00/0x5fb609b3016e043d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b296 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226868:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226884:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226895:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226918:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226930:0:68632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e03bf expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226938:0:68632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.226972:0:68632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e03bf expref: 10 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074182.226988:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68632:1869685723607552:0@lo:104: 00000100:00100000:0.0:1783074182.227034:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.227076:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074182.227099:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607552 00000100:00100000:3.0:1783074182.227104:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607552 00000100:00100000:3.0:1783074182.227138:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783074182.227148:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:68632:x1869685723607552:12345-0@lo:104: 00010000:00010000:3.0:1783074182.227160:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.227241:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074182.227249:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:68632:x1869685723607552:12345-0@lo:104: Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.227256:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1783074182.227260:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68632:1869685723607552:0@lo:104: 00010000:00010000:0.0:1783074182.227280:0:68632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.227338:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074182.227345:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.227351:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a400 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:2.0:1783074182.227355:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074182.227361:0:46245:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.227382:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.227386:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074182.227562:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1783074182.227588:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.227600:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524c151a400/0x5fb609b3016e03bf lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e03c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074182.227612:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723607680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074182.227622:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074182.227624:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074182.227626:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074182.227656:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.227716:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607680 00000100:00100000:1.0:1783074182.227721:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607680 00010000:00010000:1.0:1783074182.227740:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x5fb609b3016e03bf expref: 11 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.227772:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1783074182.227779:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+11:3661:x1869685723607680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074182.227788:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1783074182.230286:0:92362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084295 is committed 00010000:00010000:1.0:1783074182.230481:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e03c6 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e03bf expref: 9 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.230515:0:19655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9524d2de4800) 00010000:00010000:1.0:1783074182.230520:0:19655:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.230530:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.230538:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.230572:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074182.230627:0:68632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.230637:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074182.230649:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3661:x1869685723607680:12345-0@lo:103:ldlm_bl.0 Request processed in 2869us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.230661:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:3.0:1783074182.230739:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723607680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074182.230842:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4679180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723607808:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074182.230881:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.230911:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2be0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.230930:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607808 00000100:00100000:1.0:1783074182.230936:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607808 00000100:00100000:1.0:1783074182.230980:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:1.0:1783074182.230987:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f467a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723607808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783074182.231071:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f467a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723607808:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.231077:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1783074182.231114:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4679180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723607808:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783074182.231159:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0452 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231170:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0452 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231178:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0452 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074182.231448:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0452 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231623:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231631:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231638:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231651:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231657:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074182.231662:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231670:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231692:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524d2de4100) 00010000:00010000:3.0:1783074182.231695:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074182.231700:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231707:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e800/0x5fb609b3016e0444 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231718:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231724:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231730:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231735:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074182.231738:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231753:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231761:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9524d2de4800) 00010000:00010000:3.0:1783074182.231763:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074182.231766:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231771:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e400/0x5fb609b3016e044b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231805:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ee00/0x5fb609b3016e043d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b296 expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231818:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0452 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b296 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.231838:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299200) 00010000:00010000:3.0:1783074182.231840:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074182.231842:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670000, rc 0) 00000100:00100000:3.0:1783074182.231886:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71878:x1869685708089088:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 5109us (5280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.231893:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1302 00000100:00100000:3.0:1783074182.234942:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074182.234984:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708089216 00000100:00100000:1.0:1783074182.234992:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708089216 00000100:00100000:1.0:1783074182.235049:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1303 00000100:00100000:1.0:1783074182.235059:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71878:x1869685708089216:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074182.235081:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074182.235103:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151b400/0x5fb609b3016e0459 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b29d expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.235173:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a400/0x5fb609b3016e0460 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.235185:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a400/0x5fb609b3016e0460 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.235194:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a400/0x5fb609b3016e0460 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074182.235227:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1783074182.235230:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783074182.235251:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151b400/0x5fb609b3016e0459 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b29d expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.235264:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a400/0x5fb609b3016e0460 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b29d expref: 10 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.235271:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:1.0:1783074182.235273:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783074182.235276:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151a400, rc 0) 00000100:00100000:1.0:1783074182.235348:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71878:x1869685708089216:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 290us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.235355:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1303 00000100:00100000:1.0:1783074182.239490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.239755:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708089472 00000100:00100000:0.0:1783074182.239765:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708089472 00000100:00100000:2.0:1783074182.239948:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1304 00000100:00100000:2.0:1783074182.239977:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71878:x1869685708089472:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074182.240004:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074182.240035:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6600/0x5fb609b3016e0467 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2a4 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074182.240158:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783074182.240281:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6600/0x5fb609b3016e0467 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2a4 expref: 12 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.240296:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9523c8d7cb00) 00010000:00010000:2.0:1783074182.240299:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074182.240305:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6600/0x5fb609b3016e0467 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2a4 expref: 12 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.240357:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6600, rc 0) 00000100:00100000:2.0:1783074182.240610:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71878:x1869685708089472:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 647us (1125us total) trans 77309411464 rc 301/301 00000100:00100000:2.0:1783074182.240619:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1304 00000100:00100000:3.0:1783074182.242243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.242356:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708089728 00000100:00100000:0.0:1783074182.242365:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708089728 00000100:00100000:0.0:1783074182.242436:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1305 00000100:00100000:0.0:1783074182.242462:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71878:x1869685708089728:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:0.0:1783074182.242527:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074182.242566:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a400/0x5fb609b3016e0460 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b29d expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.242587:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:0.0:1783074182.242592:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074182.242614:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.242630:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.242640:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074182.242820:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e764dc1f reply state 00000000b02dd08c transno 77309411465 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.242834:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.242841:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:0.0:1783074182.242844:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1783074182.242860:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783074182.242868:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:0.0:1783074182.242950:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71878:x1869685708089728:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 494us (713us total) trans 77309411465 rc 0/0 00000100:00100000:0.0:1783074182.242959:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1305 00000100:00100000:3.0:1783074182.244392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074182.244523:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708089984 00000100:00100000:1.0:1783074182.244532:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708089984 00000100:00100000:1.0:1783074182.244583:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:1.0:1783074182.244593:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71878:x1869685708089984:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1783074182.245214:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71878:x1869685708089984:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 621us (827us total) trans 77309411466 rc 0/0 00000100:00100000:1.0:1783074182.245223:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:1.0:1783074182.257125:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.257231:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708090112 00000100:00100000:2.0:1783074182.257247:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708090112 00000100:00100000:2.0:1783074182.257371:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1306 00000100:00100000:2.0:1783074182.257384:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71879:x1869685708090112:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074182.257409:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074182.257433:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e047c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2ab expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257519:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257534:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257548:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257560:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257572:0:66201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e040c expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257581:0:66201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.257623:0:66201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e040c expref: 7 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074182.257640:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66201:1869685723607936:0@lo:104: 00000100:00100000:2.0:1783074182.257801:0:66201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074182.257934:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2e9a900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074182.260696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723607936 00000100:00100000:3.0:1783074182.260717:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723607936 00000100:00100000:3.0:1783074182.260833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1783074182.260846:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66201:x1869685723607936:12345-0@lo:104: 00010000:00010000:3.0:1783074182.260868:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.261025:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074182.261032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66201:x1869685723607936:12345-0@lo:104: Request processed in 190us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074182.261041:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1783074182.261180:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66201:1869685723607936:0@lo:104: 00010000:00010000:0.0:1783074182.261213:0:66201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.261226:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074182.261244:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.261259:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670e00 already unused, calling callback (ffffffffc1879eb0) 00010000:00010000:1.0:1783074182.261266:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074182.261277:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.261378:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.261385:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074182.261425:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.261434:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9524fb670e00/0x5fb609b3016e040c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0413 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074182.261463:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1783074182.261464:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074182.261469:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074182.261472:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074182.261489:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723608064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074182.261548:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.261870:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723608064 00000100:00100000:0.0:1783074182.261880:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723608064 00010000:00010000:0.0:1783074182.261916:0:19658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x5fb609b3016e040c expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074182.261957:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:0.0:1783074182.261966:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723608064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074182.261980:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074182.262734:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f400/0x5fb609b3016e0413 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e040c expref: 8 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.262749:0:19658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9524d2de4200) 00010000:00010000:0.0:1783074182.262754:0:19658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.262763:0:19658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.262771:0:19658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.262816:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074182.262879:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723608064:12345-0@lo:103:ldlm_bl.0 Request processed in 913us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.262886:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00010000:00010000:1.0:1783074182.263362:0:66201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.263374:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074182.263409:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723608064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074182.263568:0:66201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66201:1869685723608192:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783074182.263616:0:66201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074182.263655:0:66201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c6429780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.263796:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723608192 00000100:00100000:0.0:1783074182.263802:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723608192 00000100:00100000:0.0:1783074182.263906:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:0.0:1783074182.263915:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66201:x1869685723608192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783074182.263998:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66201:x1869685723608192:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.264005:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:1.0:1783074182.264064:0:66201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66201:1869685723608192:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783074182.264127:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e0491 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264141:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e0491 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264150:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e0491 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074182.264174:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e0491 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264187:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264195:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264202:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264208:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074182.264219:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264228:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264239:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524d2de4100) 00010000:00010000:1.0:1783074182.264242:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074182.264246:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264252:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e0483 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264264:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264270:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264276:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264281:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074182.264284:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264290:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264298:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9524d2de4200) 00010000:00010000:1.0:1783074182.264300:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074182.264330:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264338:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e048a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264378:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e047c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ab expref: 11 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264395:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e0491 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ab expref: 10 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.264404:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40900) 00010000:00010000:1.0:1783074182.264407:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783074182.264409:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151b400, rc 0) 00000100:00100000:1.0:1783074182.264457:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71879:x1869685708090112:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 7078us (7339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074182.264465:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1306 00000100:00100000:3.0:1783074182.266107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.266945:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708090240 00000100:00100000:2.0:1783074182.266967:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708090240 00000100:00100000:2.0:1783074182.267036:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1307 00000100:00100000:2.0:1783074182.267048:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71879:x1869685708090240:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074182.267075:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074182.267100:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e0498 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2b2 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.267172:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e049f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.267187:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e049f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.267199:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e049f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074182.267254:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783074182.267258:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783074182.267295:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7000/0x5fb609b3016e0498 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2b2 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.267333:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e049f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2b2 expref: 14 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.267357:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40400) 00010000:00010000:2.0:1783074182.267361:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783074182.267364:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7a00, rc 0) 00000100:00100000:2.0:1783074182.267440:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71879:x1869685708090240:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 395us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.267448:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1307 00000100:00100000:0.0:1783074182.275668:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074182.275772:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708090496 00000100:00100000:3.0:1783074182.275783:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708090496 00000100:00100000:3.0:1783074182.275839:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1308 00000100:00100000:3.0:1783074182.275848:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71879:x1869685708090496:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1783074182.275869:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074182.275894:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e04a6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2b9 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074182.275993:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783074182.276099:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e04a6 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2b9 expref: 16 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.276125:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524fc299000) 00010000:00010000:3.0:1783074182.276128:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074182.276133:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e04a6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2b9 expref: 16 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074182.276153:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:3.0:1783074182.276228:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:71879:x1869685708090496:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 380us (568us total) trans 77309411467 rc 301/301 00000100:00100000:3.0:1783074182.276235:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1308 00000100:00100000:1.0:1783074182.282541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.282689:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708090752 00000100:00100000:0.0:1783074182.282703:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708090752 00000100:00100000:0.0:1783074182.282835:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1309 00000100:00100000:0.0:1783074182.282853:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:71879:x1869685708090752:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:0.0:1783074182.282944:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074182.282992:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7a00/0x5fb609b3016e049f lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2b2 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.283018:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40400) 00010000:00010000:0.0:1783074182.283023:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074182.283047:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.283060:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.283092:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074182.283294:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9908449 reply state 00000000988cb23d transno 77309411468 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.283308:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.283373:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40400) 00010000:00010000:0.0:1783074182.283376:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1783074182.283379:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783074182.283390:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1783074182.283486:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:71879:x1869685708090752:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 635us (960us total) trans 77309411468 rc 0/0 00000100:00100000:0.0:1783074182.283494:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1309 00000100:00100000:1.0:1783074182.286243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.286366:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091008 00000100:00100000:2.0:1783074182.286381:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091008 00000100:00100000:2.0:1783074182.286454:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 240 00000100:00100000:2.0:1783074182.286467:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:71879:x1869685708091008:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1783074182.286740:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:71879:x1869685708091008:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 276us (505us total) trans 77309411469 rc 0/0 00000100:00100000:2.0:1783074182.286749:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 240 00000001:00080000:1.0:1783074182.667945:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411469 is committed 00000020:00080000:1.0:1783074182.667972:0:75594:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444083 batchid updated 00010000:00010000:0.0:1783074182.668026:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074182.668028:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444083 00010000:00010000:0.0:1783074182.668043:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668053:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668059:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.668065:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668076:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783074182.668090:0:75614:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9523c4659c00 with version 12 00010000:00010000:0.0:1783074182.668102:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:0.0:1783074182.668106:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.668112:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668120:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc6c00/0x5fb609b3016e03cd lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074182.668136:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444083 cancel update log [0x20000cf21:0x1:0x0].2: rc = 0 00010000:00010000:0.0:1783074182.668143:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668151:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668156:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668162:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.668165:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668173:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668181:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40400) 00010000:00010000:0.0:1783074182.668184:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.668187:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668192:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524c151a200/0x5fb609b3016e041a lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074182.668209:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444083 cancel update log [0x2400088d4:0x1:0x0].2: rc = 0 00010000:00010000:0.0:1783074182.668216:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074182.668219:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444083 00010000:00010000:0.0:1783074182.668227:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668233:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668240:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.668243:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668249:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783074182.668260:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 12 rpc_version 12 00010000:00010000:0.0:1783074182.668274:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9523c8d7cf00) 00010000:00010000:0.0:1783074182.668277:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074182.668280:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668286:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28e000/0x5fb609b3016e0475 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1783074182.668295:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1783074182.668337:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668345:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668352:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668363:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.668366:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668373:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668382:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40400) 00010000:00010000:0.0:1783074182.668384:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1783074182.668387:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9523c4684380 x1869685723608448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783074182.668387:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.668404:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f400/0x5fb609b3016e04b4 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074182.668426:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723608448:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783074182.668494:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1783074182.668571:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968718 is committed 00000100:00100000:3.0:1783074182.668597:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074182.668756:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723608448 00000100:00100000:1.0:1783074182.668764:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723608448 00000100:00100000:1.0:1783074182.668807:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1783074182.668818:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75600:x1869685723608448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783074182.669041:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723608448:12345-0@lo:1000:osp_up0-1.0 Request processed in 224us (546us total) trans 120259084296 rc 0/0 00000100:00100000:1.0:1783074182.669048:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:3.0:1783074182.669108:0:75600:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084295 gen 3 00000004:00080000:3.0:1783074182.669114:0:75600:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084294 committed transno 120259084295 00000020:00080000:3.0:1783074182.669117:0:75600:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9524d109e3c0 refcount 2 committed 0 result 0 batchid 73014444084 00000020:00080000:3.0:1783074182.669121:0:75600:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524fc5d8300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9524d08d4240 00000020:00080000:3.0:1783074182.669124:0:75600:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].3 00000020:00080000:3.0:1783074182.669126:0:75600:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524fc5d8000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9524e3c47000 00000020:00080000:3.0:1783074182.669129:0:75600:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].3 00000020:00080000:2.0:1783074182.669157:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444084 committed batchid 73014444083 00000020:00080000:2.0:1783074182.669182:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444083 00000004:00080000:3.0:1783074182.669221:0:75600:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084295 00000020:00080000:3.0:1783074182.669224:0:75600:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9523c573b600 refcount 2 committed 0 result 0 batchid 73014444085 00000020:00080000:3.0:1783074182.669227:0:75600:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524fc261f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9523c573bc00 00000020:00080000:3.0:1783074182.669229:0:75600:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].4 00000020:00080000:3.0:1783074182.669231:0:75600:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9524f3d74100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9524f08f3800 00000020:00080000:3.0:1783074182.669233:0:75600:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].4 00000020:00080000:2.0:1783074182.669256:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444085 committed batchid 73014444083 00000020:00080000:2.0:1783074182.669268:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444083 00000100:00100000:3.0:1783074182.669304:0:75600:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9523c4684380 x1869685723608448/t120259084296(120259084296) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783074198 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074182.669374:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723608448:0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1783074182.673021:0:92362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00000020:00080000:1.0:1783074182.679687:0:75594:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444085 batchid updated 00000020:00080000:1.0:1783074182.679699:0:75594:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444084 batchid updated 00000020:00080000:2.0:1783074182.679802:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444085 00000004:00080000:2.0:1783074182.679919:0:75614:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9523c4659780 with version 13 00000020:00080000:2.0:1783074182.679947:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444084 cancel update log [0x20000cf21:0x1:0x0].3: rc = 0 00000020:00080000:2.0:1783074182.680019:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444084 cancel update log [0x2400088d4:0x1:0x0].3: rc = 0 00000004:00080000:0.0:1783074182.680044:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 13 rpc_version 13 00000004:00080000:2.0:1783074182.680064:0:75614:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9523c4659f00 with version 14 00000020:00080000:2.0:1783074182.680068:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444085 cancel update log [0x20000cf21:0x1:0x0].4: rc = 0 00000020:00080000:2.0:1783074182.680092:0:75614:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444085 cancel update log [0x2400088d4:0x1:0x0].4: rc = 0 00000020:00080000:2.0:1783074182.680106:0:75614:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444085 00000020:00100000:0.0:1783074182.680211:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783074182.680247:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9524f467aa00 x1869685723608704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074182.680308:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723608704:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783074182.680481:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.680515:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783074182.680706:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723608704 00000100:00100000:2.0:1783074182.680713:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723608704 00000100:00100000:2.0:1783074182.680768:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1783074182.680778:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75600:x1869685723608704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783074182.680941:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723608704:12345-0@lo:1000:osp_up0-1.0 Request processed in 164us (460us total) trans 120259084297 rc 0/0 00000100:00100000:2.0:1783074182.680949:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1783074182.681304:0:75600:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:3.0:1783074182.681329:0:75600:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000100:00100000:3.0:1783074182.681351:0:75600:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9524f467aa00 x1869685723608704/t120259084297(120259084297) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783074198 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074182.681433:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f467aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723608704:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1783074182.681444:0:75600:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9524f454e480 version 14 rpc_version 14 00000020:00100000:3.0:1783074182.681457:0:75600:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783074182.681463:0:75600:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9523c4684380 x1869685723608960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074182.681479:0:75600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723608960:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783074182.681509:0:75600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074182.681554:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723608960 00000100:00100000:0.0:1783074182.681559:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723608960 00000100:00100000:3.0:1783074182.681561:0:75600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c6767c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783074182.681606:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:0.0:1783074182.681614:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75600:x1869685723608960:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783074182.681943:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75600:x1869685723608960:12345-0@lo:1000:osp_up0-1.0 Request processed in 329us (432us total) trans 120259084298 rc 0/0 00000100:00100000:0.0:1783074182.681950:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:3.0:1783074182.681955:0:75600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4684380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75600:1869685723608960:0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1783074182.688059:0:92362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00000100:00100000:3.0:1783074182.712390:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.712450:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091136 00000100:00100000:2.0:1783074182.712458:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091136 00000100:00100000:2.0:1783074182.712504:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1310 00000100:00100000:2.0:1783074182.712514:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71888:x1869685708091136:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074182.712553:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444638720 avail 1298399232 00000100:00100000:2.0:1783074182.712653:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71888:x1869685708091136:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 140us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.712662:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1310 00000100:00100000:3.0:1783074182.714423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.714451:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091264 00000100:00100000:0.0:1783074182.714458:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091264 00000100:00100000:0.0:1783074182.714574:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1311 00000100:00100000:0.0:1783074182.714584:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71888:x1869685708091264:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074182.714617:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:0.0:1783074182.714685:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71888:x1869685708091264:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.714693:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1311 00000100:00100000:0.0:1783074182.717532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.717666:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091392 00000100:00100000:2.0:1783074182.717686:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091392 00000100:00100000:2.0:1783074182.717737:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1741 00000100:00100000:2.0:1783074182.717748:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71888:x1869685708091392:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074182.717787:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074182.718022:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71888:x1869685708091392:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 274us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.718031:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1741 00000100:00100000:3.0:1783074182.721261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.721336:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091520 00000100:00100000:0.0:1783074182.721346:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091520 00000100:00100000:0.0:1783074182.721393:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4931 00000100:00100000:0.0:1783074182.721403:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2401:x1869685708091520:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:0.0:1783074182.721438:0:26174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 3021 last 0 00000020:00000080:0.0:1783074182.721489:0:26174:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016e04bb 00002000:00100000:0.0:1783074182.721504:0:26174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b/ffff9524fb6b5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783074182.721523:0:26174:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783074182.721603:0:26174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074182.721634:0:26174:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074182.721734:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708091520:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 330us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074182.721753:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4931 00000100:00100000:1.0:1783074182.727002:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.727056:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091648 00000100:00100000:2.0:1783074182.727066:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091648 00000100:00080000:1.0:1783074182.727134:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074182.727144:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1742 00000100:00100000:2.0:1783074182.727158:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71888:x1869685708091648:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:2.0:1783074182.727184:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074182.727255:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71888:x1869685708091648:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.727262:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1742 00000100:00100000:2.0:1783074182.750199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.750245:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091904 00000100:00100000:0.0:1783074182.750258:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091904 00000100:00100000:0.0:1783074182.750335:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1312 00000100:00100000:0.0:1783074182.750344:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71895:x1869685708091904:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00010000:0.0:1783074182.750399:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074182.750427:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e03db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b281 expref: 10 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750451:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:0.0:1783074182.750456:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074182.750513:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750525:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750533:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750542:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750547:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750550:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750927:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750941:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750948:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750954:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074182.750958:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.750967:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.751047:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:0.0:1783074182.751050:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074182.751055:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.751061:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e04c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074182.751074:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005bcd16ec reply state 00000000a270e714 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.751083:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074182.751088:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524ca7b9700) 00010000:00010000:0.0:1783074182.751089:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074182.751091:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074182.751189:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71895:x1869685708091904:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 845us (998us total) trans 120259084299 rc 0/0 00000100:00100000:0.0:1783074182.751204:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1312 00000100:00100000:3.0:1783074182.761743:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.761835:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092032 00000100:00100000:2.0:1783074182.761845:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092032 00000100:00100000:2.0:1783074182.761898:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1313 00000100:00100000:2.0:1783074182.761909:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71898:x1869685708092032:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1783074182.761934:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074182.761958:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e04d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2c0 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.762021:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e04d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.762041:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e04d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.762068:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e04d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074182.762112:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074182.762116:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074182.762138:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e04d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.762164:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e04d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2c0 expref: 13 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.762180:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e04d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2c0 expref: 12 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.762190:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:2.0:1783074182.762193:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074182.762198:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7000, rc 0) 00000100:00100000:2.0:1783074182.762252:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71898:x1869685708092032:12345-192.168.204.26@tcp:101:rm.0 Request processed in 345us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.762259:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1313 00000100:00100000:2.0:1783074182.763581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074182.763608:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092160 00000100:00100000:2.0:1783074182.763615:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092160 00000100:00100000:2.0:1783074182.763651:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1314 00000100:00100000:2.0:1783074182.763659:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71898:x1869685708092160:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1783074182.763687:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074182.763702:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e04de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2c7 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763754:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763765:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763776:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763787:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763795:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763803:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763877:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763885:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763892:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074182.763927:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:2.0:1783074182.763931:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074182.763944:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763965:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763976:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763991:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.763997:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764004:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764010:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074182.764014:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764022:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764033:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:2.0:1783074182.764036:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074182.764249:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764259:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e04e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764270:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764281:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764287:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764292:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074182.764296:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764302:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764328:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524ca7b9700) 00010000:00010000:2.0:1783074182.764331:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074182.764335:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764341:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6200/0x5fb609b3016e04ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764429:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e04de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2c7 expref: 14 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764442:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2c7 expref: 13 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.764451:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9523c8d7cb00) 00010000:00010000:2.0:1783074182.764453:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074182.764460:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7a00, rc 0) 00000100:00100000:2.0:1783074182.764503:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71898:x1869685708092160:12345-192.168.204.26@tcp:101:rm.0 Request processed in 845us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074182.764516:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1314 00000100:00100000:0.0:1783074182.766160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074182.766212:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092416 00000100:00100000:0.0:1783074182.766219:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092416 00000100:00100000:1.0:1783074182.766406:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1315 00000100:00100000:1.0:1783074182.766419:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71898:x1869685708092416:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:0.0:1783074182.766439:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074182.766468:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783074182.766490:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e04f3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2c7 expref: 13 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766506:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9523c8d7cb00) 00010000:00010000:1.0:1783074182.766527:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e04d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2c0 expref: 12 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766536:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:1.0:1783074182.766539:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074182.766557:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766568:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766574:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766581:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766585:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766609:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766704:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766711:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766716:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766891:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766900:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766907:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766914:0:66201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766921:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766927:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766945:0:66201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074182.766960:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.766971:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074182.766971:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766979:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.766982:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.766984:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074182.766990:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.766996:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074182.766998:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.767001:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767005:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9524faa40300) 00010000:00010000:1.0:1783074182.767009:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783074182.767014:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767014:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767024:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0508 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.767033:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9524faa40300) 00010000:00010000:2.0:1783074182.767038:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783074182.767038:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.767041:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767045:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767051:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767054:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074182.767061:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.767067:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e050f lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767072:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767084:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:1.0:1783074182.767087:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074182.767088:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074182.767091:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074182.767092:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074182.767096:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074182.767102:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e04fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074182.767111:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000663296ae reply state 00000000690bf060 transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767119:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074182.767123:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524ca7b9700) 00010000:00010000:1.0:1783074182.767124:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074182.767126:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074182.767184:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71898:x1869685708092416:12345-192.168.204.26@tcp:36:rm.0 Request processed in 768us (1032us total) trans 120259084300 rc 0/0 00000100:00100000:1.0:1783074182.767192:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1315 00000100:00100000:2.0:1783074183.599635:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723609088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074183.599720:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074183.600150:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609088 00000100:00100000:0.0:1783074183.600158:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609088 00000100:00100000:0.0:1783074183.600215:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1783074183.600227:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723609088:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074183.600231:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723609216:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074183.600256:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074183.600260:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074183.600306:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609216 00000100:00100000:0.0:1783074183.600324:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723609088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074183.600332:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:2.0:1783074183.600366:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609216 00000100:00080000:0.0:1783074183.600393:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074183.600398:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074183.600403:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:2.0:1783074183.600412:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723609216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074183.600427:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074183.600468:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723609216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074183.600475:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:0.0:1783074183.600487:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968718 gen 2 00000004:00080000:0.0:1783074183.600494:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9524e71ae680, transno 4294968718 00000100:00100000:0.0:1783074183.600511:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723609216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074183.600583:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723609088:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783074183.790514:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074184.110605:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723609344:0@lo:400:kworker.0 00000100:00100000:0.0:1783074184.110605:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723609472:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.110628:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723609600:0@lo:400:kworker.0 00000100:00100000:1.0:1783074184.110840:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723609728:0@lo:400:kworker.0 00000100:00100000:2.0:1783074184.112291:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.112528:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.112562:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723609984:0@lo:400:kworker.0 00000100:00100000:0.0:1783074184.112591:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.112607:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723610496:0@lo:400:kworker.0 00000100:00100000:0.0:1783074184.112628:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.112670:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723611008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074184.112708:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.112728:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783074184.112735:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723610880:0@lo:400:kworker.0 00000100:00100000:0.0:1783074184.112762:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.112797:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609984 00000100:00100000:0.0:1783074184.112804:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609984 00000100:00100000:0.0:1783074184.112841:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610496 00000100:00100000:0.0:1783074184.112843:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610496 00000100:00100000:0.0:1783074184.112853:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611008 00000100:00100000:0.0:1783074184.112855:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611008 00000100:00100000:0.0:1783074184.112867:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:0.0:1783074184.112874:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723609984:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783074184.112909:0:8453:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524e71ace00 x1869685723609984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:510/0 lens 224/224 e 0 to 0 dl 1783074195 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074184.112947:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723609984:12345-0@lo:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074184.112954:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:0.0:1783074184.112971:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1783074184.112976:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723610496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.113166:0:92367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609344 00000100:00100000:3.0:1783074184.113170:0:92367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609344 00000100:00100000:3.0:1783074184.113200:0:92367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783074184.113208:0:92367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723609344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.113277:0:92367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723609344:12345-0@lo:400:kworker.0 Request processed in 70us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.113284:0:92367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783074184.113491:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.113521:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723610112:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.113546:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.113570:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723610624:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.113590:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.113615:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723611136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074184.113639:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.113677:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074184.113683:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723611264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074184.113707:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.113735:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610112 00000100:00100000:3.0:1783074184.113739:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610112 00000100:00100000:3.0:1783074184.113764:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610624 00000100:00100000:3.0:1783074184.113766:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610624 00000100:00100000:3.0:1783074184.113795:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:3.0:1783074184.113801:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723610112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.113846:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723610112:12345-0@lo:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.113853:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:3.0:1783074184.113869:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:3.0:1783074184.113876:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723610624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074184.114305:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.114361:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723610624:12345-0@lo:400:kworker.0 Request processed in 484us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074184.114368:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723610240:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.114376:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:1.0:1783074184.114399:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.114420:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723610112:0@lo:400:kworker.0 00000100:00100000:1.0:1783074184.114431:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723610752:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.114436:0:3658:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968717 gen 2 00000100:00100000:1.0:1783074184.114455:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.114461:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723610624:0@lo:400:kworker.0 00000100:00100000:1.0:1783074184.114492:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609472 00000100:00100000:1.0:1783074184.114498:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609472 00000100:00100000:3.0:1783074184.114517:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610880 00000100:00100000:3.0:1783074184.114523:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610880 00000100:00100000:1.0:1783074184.114530:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609600 00000100:00100000:1.0:1783074184.114535:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609600 00000100:00100000:3.0:1783074184.114547:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609728 00000100:00100000:3.0:1783074184.114552:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609728 00000100:00100000:1.0:1783074184.114559:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1783074184.114570:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723609472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.114577:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00010000:00000080:1.0:1783074184.114586:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524e71ae680 x1869685723609472/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:510/0 lens 224/224 e 0 to 0 dl 1783074195 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074184.114587:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723610880:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783074184.114606:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b8e00 x1869685723610880/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:510/0 lens 224/224 e 0 to 0 dl 1783074195 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074184.114624:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723609472:12345-0@lo:400:kworker.0 Request processed in 57us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074184.114632:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1783074184.114662:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1783074184.114668:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723610880:12345-0@lo:400:kworker.0 Request processed in 83us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074184.114673:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723609600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.114681:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1783074184.114701:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:3.0:1783074184.114711:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723609728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074184.114715:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723609600:12345-0@lo:400:kworker.0 Request processed in 45us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074184.114723:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00010000:00000080:3.0:1783074184.114727:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c1f80 x1869685723609728/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:510/0 lens 224/224 e 0 to 0 dl 1783074195 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074184.114741:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610240 00000100:00100000:1.0:1783074184.114746:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610240 00000100:00100000:1.0:1783074184.114771:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610752 00000100:00100000:1.0:1783074184.114774:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610752 00000100:00100000:3.0:1783074184.114779:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723609728:12345-0@lo:400:kworker.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.114787:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1783074184.114800:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:1.0:1783074184.114809:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723610240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.114813:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611264 00000100:00100000:3.0:1783074184.114818:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611264 00000100:00100000:1.0:1783074184.114845:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723610240:12345-0@lo:400:kworker.0 Request processed in 36us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.114846:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:3.0:1783074184.114859:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723611008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074184.114859:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:1.0:1783074184.114880:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1783074184.114888:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723610752:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1783074184.114889:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:1.0:1783074184.114924:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723610752:12345-0@lo:400:kworker.0 Request processed in 37us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074184.114931:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:3.0:1783074184.114948:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723611008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.114965:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:1.0:1783074184.115073:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723609728:0@lo:400:kworker.0 00000100:00100000:1.0:1783074184.115087:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723610240:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.115090:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1783074184.115096:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968713 gen 2 00000100:00100000:3.0:1783074184.115103:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723611264:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074184.115110:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723610752:0@lo:400:kworker.0 00000004:00000024:3.0:1783074184.115123:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444638720 avail 1298399232 00010000:00000080:3.0:1783074184.115136:0:26189:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c557dc00 x1869685723611264/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:510/0 lens 224/368 e 0 to 0 dl 1783074195 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074184.115142:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723609600:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.115191:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723611264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.115199:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:3.0:1783074184.115262:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611136 00000100:00100000:3.0:1783074184.115266:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611136 00000100:00100000:3.0:1783074184.115293:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:3.0:1783074184.115300:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723611136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783074184.115367:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074184.115407:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723611136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.115413:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00080000:3.0:1783074184.115448:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074184.115454:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783074184.115457:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074184.115459:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074184.115490:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723610880:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.115507:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723611008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074184.115518:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723609472:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.115531:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723609984:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.115559:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783074184.115569:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723611392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074184.115599:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074184.115653:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611392 00000100:00100000:3.0:1783074184.115658:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611392 00000100:00100000:3.0:1783074184.115685:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:3.0:1783074184.115692:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723611392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074184.115707:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074184.115746:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723611392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.115751:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:3.0:1783074184.115778:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723611392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783074184.116085:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723611264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074184.116100:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723611136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074184.116627:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723609344:0@lo:400:kworker.0 00000100:00100000:2.0:1783074184.116638:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723609856:0@lo:400:kworker.0 00000100:00100000:0.0:1783074184.116690:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723610496:12345-0@lo:400:kworker.0 Request processed in 3710us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074184.116691:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074184.116703:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1783074184.116725:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723610368:0@lo:400:kworker.0 00000100:00100000:2.0:1783074184.116754:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074184.116808:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723609856 00000100:00100000:2.0:1783074184.116813:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723609856 00000100:00100000:2.0:1783074184.116982:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723610368 00000100:00100000:2.0:1783074184.116986:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723610368 00000100:00100000:2.0:1783074184.117011:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1783074184.117019:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723609856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074184.117068:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723609856:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074184.117075:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1783074184.117088:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1783074184.117098:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723610368:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074184.117110:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000080:3.0:1783074184.117115:0:68632:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc496a00 x1869685723610368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:510/0 lens 224/224 e 0 to 0 dl 1783074195 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074184.117135:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723609856:0@lo:400:kworker.0 00000100:00100000:2.0:1783074184.117157:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723610368:0@lo:400:kworker.0 00000100:00100000:3.0:1783074184.117170:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723610368:12345-0@lo:400:kworker.0 Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074184.117179:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1783074184.117366:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723610496:0@lo:400:kworker.0 00010000:00010000:1.0:1783074184.817239:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074185.838621:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074185.977593:0:93554:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1783074186.018666:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.018744:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092544 00000100:00100000:1.0:1783074186.018754:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092544 00000100:00100000:1.0:1783074186.018816:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1316 00000100:00100000:1.0:1783074186.018826:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71965:x1869685708092544:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074186.018851:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074186.018871:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2ce expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.018931:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e051d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.018947:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e051d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.018967:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e051d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074186.019007:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783074186.019011:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074186.019039:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e051d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.019059:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ce expref: 15 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.019074:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e051d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ce expref: 14 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.019083:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524ca7b9900) 00010000:00010000:1.0:1783074186.019086:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783074186.019090:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dbc00, rc 0) 00010000:00000080:1.0:1783074186.019098:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc494e00 x1869685708092544/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:512/0 lens 576/688 e 0 to 0 dl 1783074197 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074186.019153:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71965:x1869685708092544:12345-192.168.204.26@tcp:101:touch.0 Request processed in 329us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074186.019160:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1316 00000100:00080000:2.0:1783074186.019304:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074186.023482:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.024698:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092672 00000100:00100000:1.0:1783074186.024710:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092672 00000100:00100000:1.0:1783074186.024773:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1317 00000100:00100000:1.0:1783074186.024783:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71965:x1869685708092672:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074186.024806:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074186.024833:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0524 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2d5 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.024899:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.024916:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.024929:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.024943:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.024950:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.024957:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025005:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9400/0x5fb609b3016e0539 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025014:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9400/0x5fb609b3016e0539 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025020:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9400/0x5fb609b3016e0539 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074186.025046:0:66202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9400/0x5fb609b3016e0539 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025059:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025072:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025078:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025084:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025090:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074186.025095:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025103:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025115:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524d2de4100) 00010000:00010000:1.0:1783074186.025118:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074186.025124:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025130:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e052b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025141:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025147:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025153:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025163:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074186.025166:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025173:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025181:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9524f4710a00) 00010000:00010000:1.0:1783074186.025183:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074186.025186:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025192:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0532 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025221:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e0524 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2d5 expref: 16 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025236:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9400/0x5fb609b3016e0539 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2d5 expref: 15 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.025242:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299200) 00010000:00010000:1.0:1783074186.025245:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783074186.025247:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9400, rc 0) 00010000:00000080:1.0:1783074186.025255:0:66202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc494380 x1869685708092672/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:512/0 lens 576/584 e 0 to 0 dl 1783074197 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074186.025343:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:71965:x1869685708092672:12345-192.168.204.26@tcp:101:touch.0 Request processed in 561us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074186.025359:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1317 00000100:00100000:0.0:1783074186.033277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074186.033345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074186.033360:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092800 00000100:00100000:3.0:1783074186.033371:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092800 00000100:00100000:2.0:1783074186.033410:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092928 00000100:00100000:2.0:1783074186.033424:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092928 00000100:00100000:3.0:1783074186.033448:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1318 00000100:00100000:3.0:1783074186.033463:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:71965:x1869685708092800:12345-192.168.204.26@tcp:101:touch.0 00000100:00100000:2.0:1783074186.033473:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 707 00000100:00100000:2.0:1783074186.033483:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2404:x1869685708092928:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074186.033485:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074186.033499:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074186.033512:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670e00/0x5fb609b3016e0540 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2dc expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.033524:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9400/0x5fb609b3016e0539 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2d5 expref: 15 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.033543:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299200) 00010000:00010000:2.0:1783074186.033549:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074186.033585:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e0547 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.033602:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e0547 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074186.033604:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2404:x1869685708092928:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074186.033630:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 707 00010000:00010000:3.0:1783074186.033633:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e0547 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074186.033678:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1783074186.033682:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:0.0:1783074186.033721:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783074186.033734:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670e00/0x5fb609b3016e0540 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2dc expref: 7 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.033752:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670200/0x5fb609b3016e0547 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2dc expref: 6 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.033760:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299300) 00010000:00010000:3.0:1783074186.033764:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783074186.033767:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670200, rc 0) 00000100:00100000:3.0:1783074186.033810:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71965:x1869685708092800:12345-192.168.204.26@tcp:101:touch.0 Request processed in 352us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074186.033817:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1318 00000100:00100000:0.0:1783074186.041811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.042392:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708093184 00000100:00100000:1.0:1783074186.042401:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708093184 00000100:00100000:1.0:1783074186.042541:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1319 00000100:00100000:1.0:1783074186.042553:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:71965:x1869685708093184:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074186.042578:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074186.042598:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9200/0x5fb609b3016e054e lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2e3 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.042711:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.042727:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.042739:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.042753:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.042759:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.042766:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074186.042978:0:66200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723611520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783074186.043032:0:66200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074186.043069:0:66200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4659840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074186.043085:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611520 00000100:00100000:0.0:1783074186.043091:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611520 00000100:00100000:1.0:1783074186.043218:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:1.0:1783074186.043227:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66200:x1869685723611520:12345-0@lo:1000:mdt00_000.0 00010000:00000080:1.0:1783074186.043265:0:8454:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c1880 x1869685723611520/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:512/0 lens 328/4320 e 0 to 0 dl 1783074197 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074186.043334:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66200:x1869685723611520:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074186.043342:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:0.0:1783074186.043911:0:66200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66200:1869685723611520:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1783074186.044239:0:66200:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x89:0x0], count =409 00000004:00080000:1.0:1783074186.044248:0:66200:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x89:0x0]+409 in llog 00000004:00080000:1.0:1783074186.044263:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x222:0x0], index 1: 0 00010000:00010000:1.0:1783074186.044443:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8600/0x5fb609b3016e0563 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044458:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8600/0x5fb609b3016e0563 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044469:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8600/0x5fb609b3016e0563 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044502:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044510:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044516:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044522:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044538:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074186.044542:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044550:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044564:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299300) 00010000:00010000:1.0:1783074186.044566:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074186.044571:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044577:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0555 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074186.044589:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f97d49b4 reply state 0000000011dff78a transno 77309411470 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044598:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044603:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff9524f4710a00) 00010000:00010000:1.0:1783074186.044605:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074186.044619:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074186.044651:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9200/0x5fb609b3016e054e lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2e3 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044665:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8600/0x5fb609b3016e0563 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2e3 expref: 8 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.044683:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9524f4710e00) 00010000:00010000:1.0:1783074186.044685:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074186.044688:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c8600, rc 0) 00000100:00100000:1.0:1783074186.044740:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71965:x1869685708093184:12345-192.168.204.26@tcp:101:touch.0 Request processed in 2190us (2950us total) trans 77309411470 rc 0/0 00000100:00100000:1.0:1783074186.044748:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1319 00000100:00100000:0.0:1783074186.048774:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.048854:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708093440 00000100:00100000:1.0:1783074186.048922:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708093440 00000100:00100000:1.0:1783074186.048987:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1320 00000100:00100000:1.0:1783074186.048999:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71965:x1869685708093440:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:1.0:1783074186.049061:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074186.049090:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8600/0x5fb609b3016e0563 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2e3 expref: 9 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.049110:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9524f4710e00) 00010000:00010000:1.0:1783074186.049123:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074186.049173:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.049187:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.049198:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074186.049305:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2e3dde1 reply state 00000000f610ccd9 transno 77309411471 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.049436:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.049444:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9524f4710700) 00010000:00010000:1.0:1783074186.049446:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074186.049449:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074186.049533:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71965:x1869685708093440:12345-192.168.204.26@tcp:36:touch.0 Request processed in 535us (762us total) trans 77309411471 rc 0/0 00000100:00100000:1.0:1783074186.049541:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1320 00000100:00100000:2.0:1783074186.053801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074186.053905:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708093568 00000100:00100000:3.0:1783074186.053915:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708093568 00000100:00100000:3.0:1783074186.054014:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1321 00000100:00100000:3.0:1783074186.054026:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71965:x1869685708093568:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:3.0:1783074186.054064:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074186.054086:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670e00/0x5fb609b3016e0578 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2ea expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.054145:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670e00/0x5fb609b3016e0578 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ea expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.054162:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670e00/0x5fb609b3016e0578 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ea expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.054183:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9524f4710700) 00010000:00010000:3.0:1783074186.054186:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783074186.054190:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670e00, rc 0) 00000100:00100000:3.0:1783074186.054254:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71965:x1869685708093568:12345-192.168.204.26@tcp:101:touch.0 Request processed in 231us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074186.054261:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1321 00000100:00100000:0.0:1783074186.057189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074186.057243:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708093696 00000100:00100000:3.0:1783074186.057251:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708093696 00000100:00080000:0.0:1783074186.057361:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074186.057711:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4932 00000100:00100000:3.0:1783074186.057725:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708093696:12345-192.168.204.26@tcp:2:touch.0 00000001:00080000:3.0:1783074186.060123:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968714 is committed 00000001:00100000:3.0:1783074186.060135:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000100:00100000:0.0:1783074186.060280:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708093696:12345-192.168.204.26@tcp:2:touch.0 Request processed in 2555us (3095us total) trans 4294968714 rc 0/0 00000100:00100000:0.0:1783074186.060291:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4932 00000100:00100000:2.0:1783074186.063772:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.066021:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708093952 00000100:00100000:1.0:1783074186.066034:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708093952 00000100:00100000:1.0:1783074186.066095:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 241 00000100:00100000:1.0:1783074186.066107:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71965:x1869685708093952:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074186.066430:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71965:x1869685708093952:12345-192.168.204.26@tcp:35:touch.0 Request processed in 325us (2665us total) trans 77309411472 rc 0/0 00000100:00100000:1.0:1783074186.066438:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 241 00000100:00100000:1.0:1783074186.084518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074186.084626:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708094080 00000100:00100000:2.0:1783074186.084636:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708094080 00000100:00100000:2.0:1783074186.084696:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1322 00000100:00100000:2.0:1783074186.084709:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:71966:x1869685708094080:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:2.0:1783074186.084752:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074186.084777:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e057f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2f1 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084845:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084860:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084874:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084889:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084895:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084901:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084954:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e0594 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084962:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e0594 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.084968:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e0594 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074186.084990:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e0594 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085011:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085018:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085024:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085031:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085037:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074186.085042:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085050:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085063:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524d2de4100) 00010000:00010000:2.0:1783074186.085066:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074186.085071:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085077:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e0586 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085091:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085098:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085110:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085116:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074186.085119:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085125:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085133:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9523c8d7c000) 00010000:00010000:2.0:1783074186.085135:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074186.085138:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085144:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e058d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085176:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e057f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2f1 expref: 16 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085191:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e0594 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2f1 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074186.085198:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40900) 00010000:00010000:2.0:1783074186.085201:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783074186.085204:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6600, rc 0) 00010000:00000080:2.0:1783074186.085221:0:66200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c3100 x1869685708094080/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:512/0 lens 576/584 e 0 to 0 dl 1783074197 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074186.085297:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:71966:x1869685708094080:12345-192.168.204.26@tcp:101:touch.0 Request processed in 591us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074186.085304:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1322 00000100:00100000:1.0:1783074186.092701:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074186.092792:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708094208 00000100:00100000:0.0:1783074186.092812:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708094208 00000100:00100000:0.0:1783074186.092873:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1323 00000100:00100000:0.0:1783074186.092883:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71966:x1869685708094208:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074186.092911:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074186.092935:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016e059b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2f8 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074186.092996:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f200/0x5fb609b3016e05a2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074186.093010:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f200/0x5fb609b3016e05a2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074186.093022:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f200/0x5fb609b3016e05a2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074186.093066:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783074186.093070:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783074186.093120:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f000/0x5fb609b3016e059b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2f8 expref: 14 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074186.093138:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df28f200/0x5fb609b3016e05a2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2f8 expref: 13 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074186.093148:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524ca7b9a00) 00010000:00010000:0.0:1783074186.093151:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783074186.093155:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28f200, rc 0) 00000100:00100000:0.0:1783074186.093211:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71966:x1869685708094208:12345-192.168.204.26@tcp:101:touch.0 Request processed in 329us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074186.093218:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1323 00000100:00100000:2.0:1783074186.093362:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.093430:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708094336 00000100:00100000:1.0:1783074186.093435:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708094336 00000100:00100000:1.0:1783074186.093467:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 708 00000100:00100000:1.0:1783074186.093474:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2405:x1869685708094336:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074186.093486:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074186.093504:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6600/0x5fb609b3016e0594 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2f1 expref: 15 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.093527:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40900) 00010000:00010000:1.0:1783074186.093531:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074186.093565:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2405:x1869685708094336:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074186.093573:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 708 00000100:00100000:2.0:1783074186.095260:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074186.095420:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708094592 00000100:00100000:3.0:1783074186.095428:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708094592 00000100:00100000:3.0:1783074186.095477:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1324 00000100:00100000:3.0:1783074186.095486:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:71966:x1869685708094592:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:3.0:1783074186.095516:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074186.095534:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670a00/0x5fb609b3016e05a9 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b2ff expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.095642:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.095657:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.095667:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.095676:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.095680:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.095684:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783074186.097079:0:67186:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x223:0x0], index 1: 0 00010000:00010000:3.0:1783074186.097492:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671a00/0x5fb609b3016e05be lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097694:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671a00/0x5fb609b3016e05be lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097706:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671a00/0x5fb609b3016e05be lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097760:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097768:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097774:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097780:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097786:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074186.097790:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097798:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097968:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524ca7b9a00) 00010000:00010000:3.0:1783074186.097972:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074186.097977:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.097984:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670600/0x5fb609b3016e05b0 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074186.097997:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ece754b reply state 00000000dc34b607 transno 77309411473 ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.098007:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.098020:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff9524fc299d00) 00010000:00010000:3.0:1783074186.098023:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074186.098026:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783074186.098061:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670a00/0x5fb609b3016e05a9 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ff expref: 16 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.098076:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671a00/0x5fb609b3016e05be lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ff expref: 15 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074186.098137:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9524fc299b00) 00010000:00010000:3.0:1783074186.098139:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783074186.098142:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671a00, rc 0) 00000100:00100000:3.0:1783074186.098598:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:71966:x1869685708094592:12345-192.168.204.26@tcp:101:touch.0 Request processed in 3112us (3343us total) trans 77309411473 rc 0/0 00000100:00100000:3.0:1783074186.098617:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1324 00000100:00100000:2.0:1783074186.102822:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.102899:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708094848 00000100:00100000:1.0:1783074186.102910:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708094848 00000100:00100000:1.0:1783074186.102970:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1325 00000100:00100000:1.0:1783074186.102980:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:71966:x1869685708094848:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:1.0:1783074186.103042:0:66200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074186.103071:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671a00/0x5fb609b3016e05be lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ff expref: 16 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.103088:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9524fc299b00) 00010000:00010000:1.0:1783074186.103100:0:66200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074186.103152:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.103167:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.103178:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074186.103297:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008301589c reply state 0000000043b22e5f transno 77309411474 ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.103348:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.103356:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9524f4710e00) 00010000:00010000:1.0:1783074186.103358:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074186.103361:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074186.103456:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:71966:x1869685708094848:12345-192.168.204.26@tcp:36:touch.0 Request processed in 476us (641us total) trans 77309411474 rc 0/0 00000100:00100000:1.0:1783074186.103464:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1325 00000100:00100000:2.0:1783074186.108081:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.108850:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708094976 00000100:00100000:1.0:1783074186.108861:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708094976 00000100:00100000:1.0:1783074186.108965:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1326 00000100:00100000:1.0:1783074186.108975:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:71966:x1869685708094976:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074186.109012:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074186.109035:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8e00/0x5fb609b3016e05d3 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b306 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.109094:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8e00/0x5fb609b3016e05d3 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b306 expref: 18 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.109110:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8e00/0x5fb609b3016e05d3 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b306 expref: 18 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074186.109129:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9524f4710e00) 00010000:00010000:1.0:1783074186.109133:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074186.109137:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c8e00, rc 0) 00000100:00100000:1.0:1783074186.109206:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:71966:x1869685708094976:12345-192.168.204.26@tcp:101:touch.0 Request processed in 231us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074186.109226:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1326 00000100:00100000:2.0:1783074186.111497:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.111537:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708095104 00000100:00100000:1.0:1783074186.111546:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708095104 00000100:00100000:1.0:1783074186.111656:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4933 00000100:00100000:1.0:1783074186.111666:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708095104:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:1.0:1783074186.111891:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708095104:12345-192.168.204.26@tcp:2:touch.0 Request processed in 225us (397us total) trans 4294968715 rc 0/0 00000100:00100000:1.0:1783074186.111899:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4933 00000100:00100000:2.0:1783074186.114196:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074186.114456:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708095360 00000100:00100000:1.0:1783074186.114467:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708095360 00000100:00100000:1.0:1783074186.114518:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 242 00000100:00100000:1.0:1783074186.114529:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4206c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:71966:x1869685708095360:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074186.114811:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4206c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:71966:x1869685708095360:12345-192.168.204.26@tcp:35:touch.0 Request processed in 283us (622us total) trans 77309411475 rc 0/0 00000100:00100000:1.0:1783074186.114820:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 242 00000100:00100000:2.0:1783074186.223977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074186.224074:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074186.224254:0:92373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708095488 00000100:00100000:3.0:1783074186.224263:0:92373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708095488 00000100:00100000:3.0:1783074186.224343:0:92373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:3.0:1783074186.224357:0:92373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2403:x1869685708095488:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074186.224412:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708095616 00000100:00100000:1.0:1783074186.224417:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708095616 00000100:00080000:2.0:1783074186.224455:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074186.224466:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2182 00000100:00100000:1.0:1783074186.224475:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708095616:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074186.224536:0:92373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2403:x1869685708095488:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 182us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074186.224536:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708095616:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 61us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074186.224545:0:92373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:1.0:1783074186.224545:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2182 00010000:00010000:2.0:1783074186.863691:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783074187.043652:0:93652:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783074187.043707:0:93652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.043783:0:93652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.043790:0:93652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.043797:0:93652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.043826:0:93652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783074187.043833:0:93652:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783074187.043869:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074187.043875:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783074187.043879:0:93652:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783074187.043903:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783074187.043949:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074187.043956:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.043969:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151ae00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074187.043972:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.043979:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074187.043989:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074187.044299:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783074187.044302:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783074187.044304:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783074187.044371:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.044377:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074187.044394:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.044399:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c151ae00/0x5fb609b3016e02e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e02ed expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.044408:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074187.044409:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074187.044411:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074187.044424:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723611648:0@lo:39:umount.0 00000100:00100000:3.0:1783074187.044479:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074187.044542:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074187.044554:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723611776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074187.044575:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074187.044638:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611648 00000100:00100000:3.0:1783074187.044644:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611648 00000100:00100000:3.0:1783074187.044695:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1783074187.044697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611776 00000100:00100000:0.0:1783074187.044704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611776 00000100:00100000:3.0:1783074187.044705:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723611648:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783074187.044734:0:67186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dff4a 00000100:00080000:3.0:1783074187.044749:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9523c6ca9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783074187.044754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1783074187.044766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723611776:12345-0@lo:103:ldlm_bl.0 00010000:00000080:3.0:1783074187.044775:0:67186:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c557fb80 x1869685723611648/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:513/0 lens 224/224 e 0 to 0 dl 1783074198 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074187.044778:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783074187.044821:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869685723611648:12345-0@lo:39:umount.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074187.044829:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000020:00000080:3.0:1783074187.044838:0:67186:0:(genops.c:906:class_export_put()) final put ffff9523c6caf000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1783074187.044869:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e02ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e02e6 expref: 24 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.044886:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074187.044928:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3660:x1869685723611776:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074187.044937:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1783074187.044953:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723611776:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783074187.044993:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c4b3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783074187.045007:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723611648:0@lo:39:umount.0 00010000:00010000:1.0:1783074187.045019:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783074187.045031:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074187.045035:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074187.045039:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074187.045101:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6caf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783074187.045152:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6ca9800 for lustre-MDT0000 00010000:00010000:0.0:1783074187.045981:0:93652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046001:0:93652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046009:0:93652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046016:0:93652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046036:0:93652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074187.046043:0:93652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046050:0:93652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046057:0:93652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046062:0:93652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046078:0:93652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074187.046084:0:93652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046086:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074187.046097:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046097:0:93652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046116:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db000 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074187.046121:0:93652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046129:0:93652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046188:0:93652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074187.046196:0:93652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046203:0:93652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046209:0:93652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.046215:0:93652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046240:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:1.0:1783074187.046240:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046248:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046254:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046257:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074187.046263:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074187.046267:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046278:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074187.046288:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074187.046294:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:3.0:1783074187.046303:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074187.046333:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074187.046335:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074187.046338:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783074187.046342:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783074187.046347:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074187.046349:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074187.046357:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046364:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.046366:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086ce00 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:1.0:1783074187.046369:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074187.046371:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046389:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074187.046394:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021db000/0x5fb609b3016e02f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e02fb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.046395:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046402:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074187.046415:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046421:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016dfe4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfe55 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046421:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1783074187.046424:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074187.046428:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074187.046431:0:6517:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783074187.046435:0:6517:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783074187.046444:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f086d000 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:3.0:1783074187.046448:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1783074187.046449:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.046453:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074187.046457:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074187.046458:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.046474:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074187.046480:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074187.046490:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074187.046496:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074187.046498:0:8460:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1783074187.046511:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046517:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783074187.046549:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723612160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074187.046608:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074187.046691:0:93652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1783074187.046696:0:93652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1783074187.046699:0:93652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783074187.046701:0:93652:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783074187.046731:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046731:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783074187.046732:0:93652:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783074187.046738:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783074187.046745:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1783074187.046747:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086d000/0x5fb609b3016dfd3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfd44 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:0.0:1783074187.046753:0:93652:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1783074187.046756:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086ce00/0x5fb609b3016dfe1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016dfe24 expref: -99 pid: 92361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.046764:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.046767:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.046769:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074187.046782:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723611904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074187.046786:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074187.046789:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074187.046791:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074187.046821:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074187.046849:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074187.046855:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723612032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074187.046877:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074187.046906:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723612288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074187.046917:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612160 00000100:00100000:2.0:1783074187.046924:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612160 00000100:00100000:1.0:1783074187.046932:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074187.046968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723611904 00000100:00100000:2.0:1783074187.046971:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723611904 00000100:00100000:1.0:1783074187.046975:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612032 00000100:00100000:1.0:1783074187.046982:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612032 00000100:00100000:2.0:1783074187.047005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612288 00000100:00100000:2.0:1783074187.047010:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612288 00000100:00100000:1.0:1783074187.047018:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1783074187.047028:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3660:x1869685723612160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074187.047040:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00010000:00010000:1.0:1783074187.047041:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783074187.047050:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3658:x1869685723611904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074187.047059:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074187.047068:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e02fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e02f4 expref: 26 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.047077:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074187.047126:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28e200/0x5fb609b3016dfe24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfe1d expref: 25 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.047137:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074187.047163:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723612160:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074187.047170:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1783074187.047189:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1783074187.047196:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723612032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074187.047205:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074187.047216:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086de00/0x5fb609b3016dfe55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfe4e expref: 23 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074187.047218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723611904:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074187.047233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00010000:00010000:1.0:1783074187.047233:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074187.047266:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3658:x1869685723612032:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074187.047274:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1783074187.047279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1783074187.047285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723612288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074187.047292:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074187.047325:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298e00/0x5fb609b3016dfd44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfd3d expref: 21 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074187.047332:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074187.047357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3661:x1869685723612288:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074187.047368:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00010000:00010000:1.0:1783074187.047415:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074187.047428:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723612288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074187.047430:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723612160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074187.047448:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723612032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074187.047453:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723611904:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1783074187.048228:0:93652:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1783074187.048772:0:92362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00010000:00010000:0.0:1783074187.048895:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048912:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048920:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048925:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ec00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074187.048930:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048939:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048957:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524ca7b9700) 00010000:00010000:0.0:1783074187.048960:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074187.048966:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048972:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28ec00/0x5fb609b3016e04c9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.048987:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783074187.048992:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:0.0:1783074187.048995:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074187.049001:0:93652:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524f7800000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783074187.049004:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074187.049014:0:93652:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9524de7c0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783074187.049018:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a400 already unused, calling callback (ffffffffc186d4f0) 00000020:00080000:2.0:1783074187.049023:0:93652:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9523c6ca8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783074187.049032:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074187.049038:0:93652:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9523c316e000 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 192.168.204.26@tcp 10 (0 0 4) 0 0 0 0: 0000000000000000 120259084300 stale:0 00010000:00010000:0.0:1783074187.049044:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783074187.049047:0:93652:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9523c6942000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:2.0:1783074187.049059:0:93652:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9524f3da3380) has exports, disconnecting them 00000020:00080000:2.0:1783074187.049066:0:93652:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524f7800000), last request at 1783074173 00010000:00010000:0.0:1783074187.049066:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524ca7b9700) 00010000:00010000:0.0:1783074187.049073:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00000080:2.0:1783074187.049076:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dff43 00010000:00010000:0.0:1783074187.049077:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.049084:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e0501 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783074187.049087:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9524f7804800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074187.049117:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524f7800000): rc 0 00000020:00000080:2.0:1783074187.049119:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524f7800000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783074187.049136:0:93652:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9524de7c0800), last request at 1783074184 00000020:00000080:2.0:1783074187.049140:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dff3c 00010000:00010000:3.0:1783074187.049142:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074187.049144:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9524de7c6800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074187.049157:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524de7c0800): rc 0 00000020:00000080:2.0:1783074187.049159:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524de7c0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783074187.049163:0:93652:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9523c6ca8800), last request at 1783074184 00000020:00000080:2.0:1783074187.049166:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dff35 00000100:00080000:2.0:1783074187.049171:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9523c6cab800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783074187.049623:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f7800000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1783074187.049640:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074187.049683:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524de7c0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1783074187.049688:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074187.049707:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f7804800 for lustre-MDT0000 00000020:00000080:1.0:1783074187.049713:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524de7c6800 for lustre-MDT0000 00000020:00080000:2.0:1783074187.049764:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c6ca8800): rc 0 00000020:00000080:2.0:1783074187.049767:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c6ca8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783074187.049780:0:93652:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.26@tcp (ffff9523c316e000), last request at 1783074186 00000020:00000080:2.0:1783074187.049789:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd9f 00000020:00010000:2.0:1783074187.049803:0:93652:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523c316e000: total 1 00000100:00080000:2.0:1783074187.049806:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9524d2ca4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074187.049855:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9523c316e000): rc 0 00000020:00080000:2.0:1783074187.049859:0:93652:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9523c6942000), last request at 1783074168 00000020:00000080:2.0:1783074187.049862:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd98 00000020:00010000:2.0:1783074187.049866:0:93652:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523c6942000: total 1 00000100:00080000:2.0:1783074187.049868:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9523cd177000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783074187.049967:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6ca8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00010000:3.0:1783074187.050001:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523c316e000: total 1 00010000:00010000:3.0:1783074187.050050:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523c316e000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783074187.050083:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0452 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b296 expref: 5 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783074187.050086:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6cab800 for lustre-MDT0000 00010000:00010000:3.0:1783074187.050119:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e600/0x5fb609b3016e0436 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b28f expref: 4 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.050137:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e051d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ce expref: 3 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.050154:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e0491 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b2ab expref: 2 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074187.050168:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523c316e000, canceled 4 locks, left on hash table 0. 00000020:00080000:2.0:1783074187.050176:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c6942000): rc 0 00000004:00000080:2.0:1783074187.050183:0:93652:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd3bc0d93ae0 00000100:00080000:2.0:1783074187.050201:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783074187.050205:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1783074187.053347:0:46245:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523c6942000: total 0 00010000:00010000:0.0:1783074187.053356:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074187.053433:0:46245:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523c6942000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783074187.053469:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299400/0x5fb609b3016dff66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dff5f expref: 2 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074187.054182:0:46245:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523c6942000, canceled 1 locks, left on hash table 0. 00000100:00080000:2.0:1783074187.057203:0:93652:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783074187.057239:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9523cd170000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783074187.057334:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723612416:0@lo:39:umount.0 00000100:00100000:1.0:1783074187.057403:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074187.057522:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612416 00000100:00100000:1.0:1783074187.057531:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612416 00000100:00100000:1.0:1783074187.057619:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:1.0:1783074187.057629:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723612416:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783074187.057660:0:26189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdd7 00000100:00080000:1.0:1783074187.057668:0:26189:0:(import.c:65:import_set_state_nolock()) ffff9523c6cad000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783074187.057692:0:26189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411475 00000100:00100000:1.0:1783074187.057837:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3657:x1869685723612416:12345-0@lo:39:umount.0 Request processed in 208us (433us total) trans 77309411476 rc 0/0 00000100:00100000:1.0:1783074187.057844:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00080000:1.0:1783074187.058064:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523cd170000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783074187.058071:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723612416:0@lo:39:umount.0 00010000:00010000:1.0:1783074187.058087:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783074187.058167:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783074187.058171:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968717 gen 3 00000004:00080000:2.0:1783074187.058218:0:93652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783074187.058967:0:93652:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783074187.058986:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9524fc3c0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783074187.059011:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783074187.059014:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968713 gen 3 00000004:00080000:2.0:1783074187.059030:0:93652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074187.059200:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723612544:0@lo:9:umount.0 00000100:00100000:1.0:1783074187.059238:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074187.059271:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612544 00000100:00100000:1.0:1783074187.059276:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612544 00000100:00100000:1.0:1783074187.059340:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:1.0:1783074187.059346:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723612544:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783074187.059376:0:26175:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdec 00000100:00080000:1.0:1783074187.059382:0:26175:0:(import.c:65:import_set_state_nolock()) ffff9524c6026800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783074187.059420:0:26175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968718 00000100:00080000:2.0:1783074187.059459:0:93652:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783074187.059470:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9524f462d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783074187.059514:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f3da3380) has no exports 00000100:00100000:1.0:1783074187.059717:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723612544:12345-0@lo:9:umount.0 Request processed in 370us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074187.059724:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00080000:1.0:1783074187.059743:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074187.059758:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723612672:0@lo:9:umount.0 00000100:00100000:1.0:1783074187.059783:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074187.059820:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524fc3c0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783074187.059829:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783074187.059830:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074187.059833:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723612544:0@lo:9:umount.0 00010000:00010000:1.0:1783074187.059860:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074187.059902:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612672 00000100:00100000:2.0:1783074187.059906:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612672 00000100:00100000:2.0:1783074187.059949:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:2.0:1783074187.059955:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723612672:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783074187.059968:0:26172:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfe08 00000100:00080000:2.0:1783074187.059980:0:26172:0:(import.c:65:import_set_state_nolock()) ffff9524f0834800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783074187.060007:0:26172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968715 00000100:00100000:2.0:1783074187.060092:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3657:x1869685723612672:12345-0@lo:9:umount.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074187.060099:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00000100:00080000:1.0:1783074187.060144:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783074187.060161:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f462d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783074187.060165:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783074187.060166:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783074187.060169:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723612672:0@lo:9:umount.0 00010000:00010000:1.0:1783074187.060183:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783074187.062855:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9524f3da3380) has no exports 00000020:00000080:3.0:1783074187.157976:0:6518:0:(genops.c:906:class_export_put()) final put ffff9523c316e000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00010000:00010000:3.0:1783074187.158057:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074187.158061:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074187.158064:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074187.158100:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316e000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b for lustre-MDT0000 00000020:00000080:1.0:1783074187.158159:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524d2ca4800 for lustre-MDT0000 00000020:00000080:0.0:1783074187.188815:0:46245:0:(genops.c:906:class_export_put()) final put ffff9523c6942000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783074187.189162:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6942000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783074187.189222:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523cd177000 for lustre-MDT0000 00010000:00010000:1.0:1783074187.189235:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.189237:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.189240:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783074187.204992:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdb4 00000020:00000080:2.0:1783074187.205006:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524c5fdc800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783074187.205073:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783074187.205077:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c5fdc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783074187.205177:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074187.205200:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783074187.205203:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9524f3da0000) has no exports 00000020:00000080:1.0:1783074187.206450:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdad 00000020:00000080:1.0:1783074187.206457:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524ee2c4800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074187.206501:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074187.206511:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783074187.206514:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524fc3c3800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783074187.206517:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783074187.206517:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783074187.206527:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1783074187.206754:0:93652:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c468c600 - data ffff9524fbcf5870/ffff9523c683e800 00000020:01000000:3.0:1783074187.206880:0:93652:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c468c4e0 - data ffff9524fbd9c438/ffff9524f091d800 00000100:00080000:2.0:1783074187.251012:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783074187.251021:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783074187.251034:0:93652:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9524f469a300 x1869685723612416/t77309411476(77309411476) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074197 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074187.251062:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783074187.253527:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783074187.253534:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968717 gen 4 00000004:00080000:2.0:1783074187.253601:0:93652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783074187.253604:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783074187.254380:0:92380:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783074187.254386:0:92380:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:0.0:1783074187.254401:0:92380:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:2.0:1783074187.254981:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783074187.254986:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968713 gen 4 00000004:00080000:2.0:1783074187.255007:0:93652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783074187.255009:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783074187.255234:0:92382:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783074187.255239:0:92382:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:1.0:1783074187.255249:0:92382:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:2.0:1783074187.256497:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd67 00000020:00000080:2.0:1783074187.256508:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c3168000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783074187.257165:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd7c 00000020:00000080:2.0:1783074187.257171:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c6943800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074187.257195:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c3168000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783074187.257232:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783074187.257237:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074187.257247:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783074187.257251:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9524e69d0000) has no exports 00000004:01000000:2.0:1783074187.257464:0:93652:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783074187.257481:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfe01 00000020:00000080:2.0:1783074187.257485:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523cd175000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783074187.257489:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783074187.257492:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074187.257500:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783074187.257503:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9524c44119c0) has no exports 00000020:00000080:2.0:1783074187.257509:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdfa 00000020:00000080:2.0:1783074187.257513:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524f4628800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074187.257809:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6943800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783074187.257816:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523cd175000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783074187.257821:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f4628800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783074187.258028:0:93652:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783074187.258032:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783074187.258037:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968713 gen 5 00000004:00080000:2.0:1783074187.258042:0:93652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783074187.258044:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074187.258117:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074187.258126:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074187.258133:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfde5 00000020:00000080:2.0:1783074187.258137:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524e6a70000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074187.258213:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f462d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783074187.258219:0:44310:0:(genops.c:906:class_export_put()) final put ffff9524e6a71800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074187.258221:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524e6a71800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783074187.258225:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783074187.258342:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783074187.258346:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524e6a70000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783074187.258347:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074187.258352:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783074187.258355:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9523c338cd40) has no exports 00000020:00000080:2.0:1783074187.258359:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdde 00000020:00000080:2.0:1783074187.258363:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524fc3c1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074187.258378:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fc3c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783074187.258717:0:93652:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783074187.258719:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783074187.258721:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968717 gen 5 00000004:00080000:2.0:1783074187.258724:0:93652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783074187.258725:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074187.258752:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fc3c0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783074187.258757:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074187.258763:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074187.258766:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523cd175800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074187.258768:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9523cd175800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783074187.258783:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783074187.258852:0:93652:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783074187.258857:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdc9 00000020:00000080:2.0:1783074187.258860:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523cd173000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783074187.258869:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783074187.258872:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074187.258878:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783074187.258880:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9523c338b380) has no exports 00000020:00000080:2.0:1783074187.258884:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfdc2 00000020:00000080:1.0:1783074187.258884:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523cd173000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783074187.258888:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523cd174800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074187.258900:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523cd174800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783074187.262414:0:93652:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783074187.262421:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074187.262430:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074187.262438:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783074187.262495:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074187.262520:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074187.262548:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074187.262553:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074187.262558:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c6946800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783074187.262562:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6946800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783074187.262568:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783074187.262616:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523cd170000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783074187.262626:0:44310:0:(genops.c:906:class_export_put()) final put ffff9523cd172800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074187.262629:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523cd172800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783074187.262643:0:44310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783074187.262691:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd83 00000020:00000080:0.0:1783074187.262698:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c6947800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783074187.262711:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783074187.262715:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074187.262720:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1783074187.262724:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6947800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:0.0:1783074187.262724:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9524f3da4d40) has no exports 00000020:00000080:0.0:1783074187.262749:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074187.262754:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783074187.262756:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c316c800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783074187.262758:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783074187.262762:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783074187.262798:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd8a 00000020:00000080:0.0:1783074187.262802:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c6945000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783074187.262820:0:93652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6e2d800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783074187.262824:0:93652:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6e2d800 3 00000020:01000004:0.0:1783074187.262827:0:93652:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524c6e2d800 from lustre-MDT0000 00000020:00000080:1.0:1783074187.262847:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6945000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074187.262848:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074187.262856:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783074187.262860:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c316f000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783074187.262862:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783074187.262870:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783074187.262899:0:93652:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783074187.262903:0:93652:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783074187.262906:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783074187.262909:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074187.262915:0:93652:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783074187.262929:0:93652:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9523c32c8800 f1623620-a4b0-4769-84e0-0d08c968afe8 192.168.204.26@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783074187.262935:0:93652:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9523cd176800 522b6a34-04f4-4017-ab45-61a21d19bfef 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783074187.262939:0:93652:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9524e69d3380) has exports, disconnecting them 00000020:00080000:0.0:1783074187.262943:0:93652:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.26@tcp (ffff9523c32c8800), last request at 1783074170 00000020:00000080:0.0:1783074187.262964:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dff12 00000020:00010000:0.0:1783074187.262969:0:93652:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523c32c8800: total 0 00000100:00080000:0.0:1783074187.262972:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9523c32cb800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783074187.263015:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523c32c8800: total 0 00010000:00010000:1.0:1783074187.263053:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523c32c8800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783074187.263088:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e02df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b265 expref: 6 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263106:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9525021dae00/0x5fb609b3016e02d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b25e expref: 5 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263118:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7400/0x5fb609b3016dff19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1ee expref: 4 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263130:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7200/0x5fb609b3016dff27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b1fc expref: 3 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263138:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523c32c8800, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1783074187.263158:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.263160:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.263162:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783074187.263246:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9523c32c8800): rc 0 00000020:00000080:0.0:1783074187.263250:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c32c8800/f1623620-a4b0-4769-84e0-0d08c968afe8 00000020:00080000:0.0:1783074187.263269:0:93652:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9523cd176800), last request at 1783074168 00000020:00000080:0.0:1783074187.263339:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd2f 00000020:00010000:0.0:1783074187.263343:0:93652:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523cd176800: total 1 00000100:00080000:0.0:1783074187.263346:0:93652:0:(import.c:65:import_set_state_nolock()) ffff9523cd174000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783074187.263358:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523cd176800): rc 0 00000020:00080000:0.0:1783074187.263362:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9524e69d3380) has no exports 00000100:00100000:0.0:1783074187.263421:0:92368:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9524fc57ac00:92368] 1 exiting: rc = 0 00000100:00100000:3.0:1783074187.263424:0:92367:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9524fc57ba00:92367] 0 exiting: rc = 1 00000020:00010000:1.0:1783074187.263497:0:8460:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523cd176800: total 1 00010000:00010000:1.0:1783074187.263527:0:8460:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523cd176800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783074187.263544:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9525021da400/0x5fb609b3016e034f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0348 expref: 14 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263555:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bca00/0x5fb609b3016dfec5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfebe expref: 13 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263565:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e0341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e033a expref: 12 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263596:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c200/0x5fb609b3016dfe71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfe6a expref: 11 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263612:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c151bc00/0x5fb609b3016e035d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0356 expref: 10 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263623:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd800/0x5fb609b3016dfeef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfee8 expref: 9 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263632:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6800/0x5fb609b3016e0309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0302 expref: 8 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263641:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c69bd400/0x5fb609b3016dfefd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfef6 expref: 7 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263654:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c151aa00/0x5fb609b3016e0317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0310 expref: 6 pid: 92373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263664:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086c800/0x5fb609b3016dfe8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfe86 expref: 5 pid: 92369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263675:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524c151a800/0x5fb609b3016e0325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e031e expref: 4 pid: 92367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263689:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524f086d400/0x5fb609b3016dfe9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016dfe94 expref: 3 pid: 92368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263702:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e0333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e032c expref: 2 pid: 92372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074187.263725:0:8460:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523cd176800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783074187.263738:0:8460:0:(genops.c:906:class_export_put()) final put ffff9523cd176800/522b6a34-04f4-4017-ab45-61a21d19bfef 00010000:00010000:1.0:1783074187.263742:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.263744:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074187.263745:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074187.263752:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c32c8800/f1623620-a4b0-4769-84e0-0d08c968afe8 for MGS 00000020:00000080:1.0:1783074187.263771:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523cd176800/522b6a34-04f4-4017-ab45-61a21d19bfef for MGS 00000020:00000080:1.0:1783074187.263785:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c32cb800 for MGS 00000020:00000080:1.0:1783074187.263789:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523cd174000 for MGS 00000100:00100000:3.0:1783074187.270116:0:92369:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9524f0851400:92369] 2 exiting: rc = 0 00000100:00100000:3.0:1783074187.270202:0:92373:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9524e71a2600:92373] 4 exiting: rc = 0 00000100:00100000:0.0:1783074187.270294:0:92372:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9523c8775e00:92372] 3 exiting: rc = 0 00000100:00100000:1.0:1783074187.270669:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270681:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270692:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270699:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270705:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270710:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270716:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270721:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270730:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270738:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270744:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270750:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270756:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270762:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270768:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270773:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270779:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270785:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270794:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270810:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270816:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270822:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270845:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270851:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270857:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270862:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270867:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270874:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270879:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270884:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270889:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270895:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270900:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270906:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270911:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270918:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270923:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270929:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270934:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270939:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270945:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270950:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270955:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270960:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270966:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270971:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270981:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270987:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270992:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.270998:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271004:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271009:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271014:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271018:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271022:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271026:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271031:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271041:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271046:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271050:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271055:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271060:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271065:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783074187.271069:0:93652:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783074187.274399:0:93652:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c6b0e5a0 - data ffff9524df92a438/ffff9523c5708800 00000020:01000000:1.0:1783074187.274518:0:93652:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9524fb677600 - data ffff9523c18f8a20/ffff9523c3163800 00000020:00000080:1.0:1783074187.275445:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd28 00000020:00000080:1.0:1783074187.275455:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524c6e2c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783074187.275473:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6e2c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783074187.275493:0:93652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6e2d800 from MGS, refs=2 00000020:01000004:1.0:1783074187.275498:0:93652:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6e2d800 2 00000020:01000004:1.0:1783074187.275502:0:93652:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524c6e2d800 from MGS 00000020:00000080:1.0:1783074187.275531:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074187.275539:0:93652:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783074187.275542:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524c356a000/MGS 00000020:00000080:1.0:1783074187.275544:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c356a000/MGS for MGS 00000020:01000000:1.0:1783074187.275555:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783074187.275665:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783074187.275670:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074187.275681:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783074187.275687:0:93652:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9524c86b1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783074187.275701:0:93652:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9523c2284d40) has exports, disconnecting them 00000020:00080000:1.0:1783074187.275707:0:93652:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9524c86b1800), last request at 1783074168 00000020:00000080:1.0:1783074187.275711:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfe40 00000020:00080000:1.0:1783074187.275721:0:93652:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524c86b1800): rc 0 00000020:00000080:1.0:1783074187.275725:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524c86b1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783074187.277163:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c86b1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783074187.279651:0:93652:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783074187.279660:0:93652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074187.279664:0:93652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783074187.279671:0:93652:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074187.279788:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c4b3a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783074187.279913:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074187.279926:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783074187.279931:0:93652:0:(genops.c:906:class_export_put()) final put ffff9523c316d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783074187.279935:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783074187.279941:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783074187.280018:0:93652:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6e2d800 1 00000020:00000080:0.0:1783074187.280034:0:93652:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfd1a 00000020:00000080:0.0:1783074187.280041:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524c3568000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783074187.280091:0:93652:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783074187.280096:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783074187.280099:0:93652:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783074187.280103:0:93652:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9524e69d4d40) has no exports 00000020:00000080:2.0:1783074187.282233:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c3568000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783074187.344114:0:93652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783074187.344127:0:93652:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783074187.344133:0:93652:0:(genops.c:906:class_export_put()) final put ffff9524c6e2d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783074187.344137:0:93652:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6e2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783074187.344149:0:93652:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783074187.344274:0:93652:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524c6e2e800 00000020:02000400:0.0:1783074187.344530:0:93652:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783074187.888539:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074188.718605:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074188.718627:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723612800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074188.718693:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074188.719962:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612800 00000100:00100000:2.0:1783074188.719971:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612800 00000100:00100000:2.0:1783074188.720040:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:2.0:1783074188.720050:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723612800:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783074188.720081:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783074188.720100:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074188.720156:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723612800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074188.720164:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:1.0:1783074188.720209:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723612928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074188.720258:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074188.720300:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723612928 00000100:00100000:1.0:1783074188.720307:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723612800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074188.720344:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723612928 00000100:00080000:1.0:1783074188.720367:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074188.720385:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:3.0:1783074188.720393:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723612928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783074188.720409:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074188.720469:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723612928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074188.720476:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:1.0:1783074188.720500:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723612928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783074188.910934:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074189.230526:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723613056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074189.230570:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524d232a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723613184:0@lo:400:kworker.0 00000100:00100000:3.0:1783074189.230672:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723613312:0@lo:400:kworker.0 00000100:00100000:1.0:1783074189.230719:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723613440:0@lo:400:kworker.0 00000400:00000100:2.0:1783074189.230747:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723613184 offset 0 length 224: 4 00000100:00100000:1.0:1783074189.230757:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074189.230781:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723613952:0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.230789:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723613696:0@lo:400:kworker.0 00000100:00100000:1.0:1783074189.230803:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074189.230809:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074189.230822:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074189.230824:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074189.230826:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723614208:0@lo:400:kworker.0 00000100:00100000:1.0:1783074189.230831:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723613824:0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.230851:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074189.230854:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074189.230858:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723613568:0@lo:400:kworker.0 00000100:00100000:1.0:1783074189.230884:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613440 00000100:00100000:1.0:1783074189.230890:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613440 00000100:00100000:2.0:1783074189.230891:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613696 00000100:00100000:0.0:1783074189.230899:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074189.230907:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613696 00000100:00100000:0.0:1783074189.230924:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723614080:0@lo:400:kworker.0 00000100:00100000:1.0:1783074189.230941:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614208 00000100:00100000:2.0:1783074189.230942:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613568 00000100:00100000:2.0:1783074189.230946:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613568 00000100:00100000:1.0:1783074189.230946:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614208 00000100:00100000:0.0:1783074189.230950:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074189.230963:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1783074189.230969:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1783074189.230972:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723613440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074189.230976:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723613696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074189.230989:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1783074189.231007:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3660:x1869685723613568:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783074189.231017:0:68632:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074189.231043:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074189.231163:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723613440:12345-0@lo:400:kworker.0 Request processed in 190us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074189.231163:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723613696:12345-0@lo:400:kworker.0 Request processed in 186us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074189.231171:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1783074189.231174:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1783074189.231177:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613312 00000100:00100000:3.0:1783074189.231182:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613312 00000100:00100000:1.0:1783074189.231192:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1783074189.231197:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1869685723614208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.231198:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1783074189.231202:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1869685723613312:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783074189.231208:0:66202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074189.231219:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613952 00000100:00100000:3.0:1783074189.231232:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613952 00000100:00100000:2.0:1783074189.231242:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1869685723613312:12345-0@lo:400:kworker.0 Request processed in 37us (197us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783074189.231248:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1783074189.231270:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614080 00000100:00100000:3.0:1783074189.231274:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614080 00000100:00100000:2.0:1783074189.231290:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723613696:0@lo:400:kworker.0 00000100:00100000:3.0:1783074189.231294:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:3.0:1783074189.231300:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723613952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074189.231361:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723613952:12345-0@lo:400:kworker.0 Request processed in 60us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074189.231365:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613056 00000100:00100000:3.0:1783074189.231370:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1783074189.231371:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613056 00000100:00100000:3.0:1783074189.231386:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:3.0:1783074189.231394:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723614080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.231399:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613824 00000100:00100000:2.0:1783074189.231402:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613824 00000100:00100000:2.0:1783074189.231421:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:2.0:1783074189.231426:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1869685723613056:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783074189.231433:0:23954:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783074189.231435:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723614080:12345-0@lo:400:kworker.0 Request processed in 40us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074189.231443:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:3.0:1783074189.231468:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:2.0:1783074189.231469:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1869685723613056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 39us (646us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074189.231478:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1869685723613824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.231479:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000020:00080000:3.0:1783074189.231491:0:8454:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1783074189.231511:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783074189.231517:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783074189.231521:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1783074189.231530:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1869685723613824:12345-0@lo:400:kworker.0 Request processed in 51us (673us total) trans 0 rc -107/-107 00000100:00080000:2.0:1783074189.231534:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783074189.231539:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00080000:2.0:1783074189.231541:0:3658:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3013 00000100:00080000:2.0:1783074189.231559:0:3658:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074189.231580:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f469ad80 x1869685723614336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074189.231588:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783074189.231593:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783074189.231597:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783074189.231602:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783074189.231602:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723613312:0@lo:400:kworker.0 00000100:00080000:3.0:1783074189.231610:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3013 00000100:00080000:3.0:1783074189.231616:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074189.231630:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c557e300 x1869685723614464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074189.231642:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723613824:0@lo:400:kworker.0 00000100:00080000:2.0:1783074189.231649:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074189.231659:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723613440:0@lo:400:kworker.0 00000100:00100000:3.0:1783074189.231673:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723613952:0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.231694:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723614080:0@lo:400:kworker.0 00000100:02020000:2.0:1783074189.231708:0:3660:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783074189.231711:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783074189.231713:0:3660:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9524f0d24800 already not connected (conn 53, was 52): CONNECTING 00000100:00100000:2.0:1783074189.231741:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f469ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723614336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783074189.231766:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074189.231783:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723614464:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783074189.231817:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074189.231827:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3660:x1869685723613568:12345-0@lo:400:kworker.0 Request processed in 818us (925us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074189.231834:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1783074189.231847:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614336 00000100:00100000:2.0:1783074189.231852:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614336 00000100:00080000:0.0:1783074189.231868:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074189.231872:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1783074189.231877:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:02000400:0.0:1783074189.231878:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783074189.231884:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723614336:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1783074189.231900:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00020000:2.0:1783074189.231903:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1783074189.231906:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3013 00000100:00080000:0.0:1783074189.231911:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074189.231926:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c53f9c00 x1869685723614592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074189.231939:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723614336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 53us (170us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074189.231940:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723613568:0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.231953:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1783074189.231977:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723614592:0@lo:38:ptlrpcd_00_02.0 00000020:00080000:1.0:1783074189.231989:0:66200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783074189.232007:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074189.232026:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783074189.232029:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1869685723614208:12345-0@lo:400:kworker.0 Request processed in 831us (1178us total) trans 0 rc -107/-107 00000100:00080000:2.0:1783074189.232031:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074189.232034:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f469ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723614336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783074189.232044:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1783074189.232053:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614592 00000100:00100000:1.0:1783074189.232056:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614592 00000100:00100000:2.0:1783074189.232058:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614464 00000100:00100000:2.0:1783074189.232060:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614464 00000100:00100000:2.0:1783074189.232071:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1783074189.232071:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1783074189.232076:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723614464:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783074189.232076:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723614592:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1783074189.232086:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1783074189.232088:0:23954:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074189.232111:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723614464:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33us (294us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074189.232111:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723614592:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 33us (103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074189.232117:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1783074189.232118:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00080000:2.0:1783074189.232137:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074189.232141:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074189.232144:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723614592:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783074189.232151:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074189.232155:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074189.232158:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723614464:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1783074189.232474:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783074189.232477:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783074189.232480:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783074189.232483:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074189.232485:0:3661:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3013 00000100:00080000:0.0:1783074189.232489:0:3661:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074189.232501:0:3661:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c53f8e00 x1869685723614720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074189.232519:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869685723614208:0@lo:400:kworker.0 00000100:00100000:2.0:1783074189.232932:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723614720:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783074189.232957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074189.232998:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614720 00000100:00100000:3.0:1783074189.233002:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614720 00000100:00100000:3.0:1783074189.233021:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1783074189.233025:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723614720:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1783074189.233033:0:67186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074189.233066:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723614720:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40us (109us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074189.233071:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00080000:2.0:1783074189.233088:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074189.233095:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783074189.233098:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723614720:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:0.0:1783074189.745238:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783074189.745253:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411476 is committed 00000020:00000080:0.0:1783074189.745259:0:75594:0:(genops.c:906:class_export_put()) final put ffff9523c6ca9000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783074189.745295:0:75594:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411475 is committed 00010000:00010000:3.0:1783074189.745354:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745367:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745375:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745382:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074189.745388:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745396:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745416:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff9524f4710a00) 00000020:00000080:1.0:1783074189.745417:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c6ca9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00010000:00010000:3.0:1783074189.745421:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074189.745427:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745434:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8000/0x5fb609b3016e055c lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745467:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745474:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783074189.745485:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c6cad000 for lustre-MDT0001 00010000:00010000:3.0:1783074189.745491:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745576:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074189.745580:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745587:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745598:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9524f4710700) 00010000:00010000:3.0:1783074189.745601:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074189.745604:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745609:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c8a00/0x5fb609b3016e0571 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745620:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745626:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745631:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745635:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074189.745637:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745642:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745657:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff9524fc299d00) 00010000:00010000:3.0:1783074189.745659:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074189.745662:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745667:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb671000/0x5fb609b3016e05b7 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745679:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745684:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745689:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745694:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074189.745696:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745701:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745706:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9524f4710e00) 00010000:00010000:3.0:1783074189.745708:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074189.745710:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074189.745714:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524df2c9e00/0x5fb609b3016e05cc lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074189.934572:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074190.958540:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783074191.344644:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708095744 offset 0 length 224: 4 00000100:00100000:2.0:1783074191.344705:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074191.344745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074191.344772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074191.344803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074191.344839:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096256 00000100:00100000:2.0:1783074191.344848:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096256 00000100:00100000:2.0:1783074191.344901:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096128 00000100:00100000:2.0:1783074191.344904:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096128 00000100:00100000:2.0:1783074191.344932:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2185 00000100:00100000:0.0:1783074191.344935:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096000 00000100:00100000:0.0:1783074191.344942:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096000 00000100:00100000:2.0:1783074191.344943:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2402:x1869685708096256:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074191.344978:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708095872 00000100:00100000:0.0:1783074191.344982:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708095872 00000100:00100000:0.0:1783074191.345003:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 871 00000100:00100000:0.0:1783074191.345012:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2402:x1869685708096000:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074191.345026:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2402:x1869685708096256:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074191.345035:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2185 00000100:00100000:2.0:1783074191.345058:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2186 00000100:00100000:0.0:1783074191.345072:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2402:x1869685708096000:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 58us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074191.345075:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1334 00000100:00100000:2.0:1783074191.345075:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708096128:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074191.345085:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 871 00000100:00100000:3.0:1783074191.345090:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869685708095872:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:3.0:1783074191.345100:0:67186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00100000:2.0:1783074191.345115:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708096128:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074191.345123:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2186 00000100:00100000:3.0:1783074191.345137:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869685708095872:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (361us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074191.345146:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1334 00000100:00080000:0.0:1783074191.345154:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074191.345159:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783074191.345163:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074191.347500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074191.347788:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096384 00000100:00100000:0.0:1783074191.347847:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096384 00000100:00100000:0.0:1783074191.347893:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1335 00000100:00100000:0.0:1783074191.347900:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708096384:12345-192.168.204.26@tcp:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783074191.347928:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074191.348041:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1869685708096384:12345-192.168.204.26@tcp:38:ptlrpcd_00_00.0 Request processed in 138us (543us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074191.348049:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1335 00000001:00100000:3.0:1783074191.791987:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074191.791996:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524d2470000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783074191.792166:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968715 is committed 00000020:00000080:2.0:1783074191.792249:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2470000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783074191.792454:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f0834800 for lustre-OST0001 00010000:00010000:3.0:1783074191.982435:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783074192.816450:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074192.816459:0:8438:0:(genops.c:906:class_export_put()) final put ffff9523c2c2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783074192.816547:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c2c2f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783074192.816918:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c6026800 for lustre-OST0000 00010000:00010000:1.0:1783074193.006707:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074193.839076:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723614848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074193.839150:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074193.839158:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723614976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074193.840415:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074193.840719:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614848 00000100:00100000:2.0:1783074193.840728:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614848 00000100:00080000:0.0:1783074193.840763:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074193.840780:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723614976 00000100:00100000:2.0:1783074193.840785:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723614976 00000100:00100000:3.0:1783074193.840807:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1783074193.840820:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723614848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074193.840945:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:2.0:1783074193.840953:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723614976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074193.840980:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783074193.841030:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074193.841037:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723614976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074193.841046:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:3.0:1783074193.841085:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723614848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 269us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074193.841092:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1783074193.841138:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723614848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074193.841151:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723614976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783074193.841190:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783074194.030508:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783074194.350835:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074194.350841:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074194.350845:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074194.350851:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3028 00000100:00080000:1.0:1783074194.350855:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074194.350860:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074194.350892:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff6d80 x1869685723615232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074194.350903:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723615104:0@lo:400:kworker.0 00000100:00080000:1.0:1783074194.350913:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074194.350916:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074194.350917:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074194.350920:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3028 00000100:00080000:1.0:1783074194.350922:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074194.350925:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074194.350933:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff5c00 x1869685723615488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1783074194.350959:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723615104 offset 0 length 224: 4 00000100:00100000:2.0:1783074194.350969:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723615360:0@lo:400:kworker.0 00000100:00100000:2.0:1783074194.351006:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074194.351078:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723615232:0@lo:38:kworker.0 00000100:00100000:3.0:1783074194.351109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074194.351156:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723615488:0@lo:38:kworker.0 00000100:00100000:3.0:1783074194.351179:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074194.351210:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074194.351214:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074194.351215:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074194.351219:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3028 00000100:00080000:1.0:1783074194.351221:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074194.351224:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074194.351235:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff6680 x1869685723615744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074194.351243:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074194.351245:0:44310:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074194.351246:0:44310:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074194.351249:0:44310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3028 00000100:00080000:1.0:1783074194.351250:0:44310:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783074194.351252:0:44310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074194.351263:0:44310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff5f80 x1869685723615872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074194.352357:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723615744:0@lo:38:kworker.0 00000100:00100000:3.0:1783074194.352391:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074194.352414:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723615872:0@lo:38:kworker.0 00000100:00100000:2.0:1783074194.352518:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723615360 00000100:00100000:2.0:1783074194.352525:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723615360 00000100:00100000:2.0:1783074194.352580:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723615232 00000100:00100000:2.0:1783074194.352584:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723615232 00000100:00100000:2.0:1783074194.352596:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723615488 00000100:00100000:2.0:1783074194.352599:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723615488 00000100:00100000:2.0:1783074194.352611:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1783074194.352620:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074194.352679:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723615360:12345-0@lo:400:kworker.0 Request processed in 60us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074194.352684:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1783074194.352688:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1783074194.352689:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723615232:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783074194.352704:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1783074194.352707:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723615488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074194.352709:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1783074194.352714:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074194.352736:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723615488:12345-0@lo:38:kworker.0 Request processed in 27us (1556us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074194.352736:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723615232:12345-0@lo:38:kworker.0 Request processed in 46us (1627us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074194.352742:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1783074194.352789:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723615360:0@lo:400:kworker.0 00000100:00100000:0.0:1783074194.352816:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783074194.352826:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723615616:0@lo:400:kworker.0 00000100:00100000:2.0:1783074194.352840:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723615744 00000100:00100000:2.0:1783074194.352843:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723615744 00000100:00100000:2.0:1783074194.352864:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1783074194.352868:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723615744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783074194.352878:0:8454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074194.352904:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723615744:12345-0@lo:38:kworker.0 Request processed in 34us (512us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074194.352910:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00080000:2.0:1783074194.352936:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074194.353557:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1783074194.353636:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074194.353692:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074194.353698:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074194.353702:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723615232:0@lo:38:kworker.0 00000100:00080000:3.0:1783074194.353712:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074194.353716:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074194.353720:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723615488:0@lo:38:kworker.0 00000100:00100000:1.0:1783074194.353737:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723615872 00000100:00100000:1.0:1783074194.353744:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723615872 00000100:00080000:3.0:1783074194.353745:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074194.353750:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074194.353753:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723615744:0@lo:38:kworker.0 00000100:00100000:1.0:1783074194.353771:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1783074194.353777:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723615872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783074194.353790:0:66200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783074194.353821:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869685723615872:12345-0@lo:38:kworker.0 Request processed in 43us (185us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074194.353827:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00080000:3.0:1783074194.353895:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783074194.353900:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074194.353903:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723615872:0@lo:38:kworker.0 00000100:00100000:0.0:1783074194.354180:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074194.354332:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723615616 00000100:00100000:2.0:1783074194.354337:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723615616 00000100:00080000:0.0:1783074194.354781:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074194.354824:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1783074194.354833:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723615616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074194.354988:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723615616:12345-0@lo:400:kworker.0 Request processed in 156us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074194.355151:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723615616:0@lo:400:kworker.0 00000100:00100000:2.0:1783074194.355254:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00010000:00010000:1.0:1783074195.054615:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074196.078456:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1783074196.462783:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708096512 offset 0 length 224: 4 00000100:00100000:3.0:1783074196.462854:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074196.462880:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074196.462899:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074196.462923:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096640 00000100:00100000:3.0:1783074196.462927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074196.462934:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096640 00000100:00100000:2.0:1783074196.462941:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096768 00000100:00100000:2.0:1783074196.462947:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096768 00000100:00100000:0.0:1783074196.462951:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708096896 00000100:00100000:0.0:1783074196.462958:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708096896 00000100:00100000:1.0:1783074196.462979:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1339 00000100:00100000:1.0:1783074196.462989:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708096640:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:2.0:1783074196.463006:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 874 00000100:00100000:0.0:1783074196.463017:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708097024 00000100:00100000:2.0:1783074196.463018:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2402:x1869685708096768:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074196.463023:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708097024 00010000:00020000:1.0:1783074196.463027:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074196.463058:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2187 00000100:00100000:0.0:1783074196.463068:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708096896:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074196.463081:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2188 00000100:00100000:1.0:1783074196.463090:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708096640:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 99us (232us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074196.463091:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2402:x1869685708096768:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074196.463096:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708097024:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074196.463106:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708096896:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074196.463110:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 874 00000100:00100000:1.0:1783074196.463122:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1339 00000100:00100000:0.0:1783074196.463136:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2187 00000100:00100000:3.0:1783074196.463145:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708097024:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074196.463154:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2188 00000100:00080000:2.0:1783074196.463154:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074196.463158:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074196.463161:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783074197.102515:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074198.127099:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074198.958455:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723616000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783074198.958533:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074198.958581:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616000 00000100:00100000:1.0:1783074198.958591:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616000 00000100:00080000:2.0:1783074198.958637:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074198.958655:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1783074198.958666:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723616000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074198.958703:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074198.958724:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723616128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074198.958766:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074198.958767:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723616000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074198.958806:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1783074198.958828:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616128 00000100:00100000:1.0:1783074198.958831:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616128 00000100:00100000:1.0:1783074198.958875:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:1.0:1783074198.958882:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723616128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783074198.958898:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1783074198.958926:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074198.958940:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723616128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074198.958948:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00100000:3.0:1783074198.958963:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723616128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074198.958997:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723616000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783074199.152198:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074199.470550:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723616256:0@lo:400:kworker.0 00000400:00000100:3.0:1783074199.470603:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685723616256 offset 0 length 224: 4 00000100:00080000:2.0:1783074199.470705:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074199.470711:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074199.470715:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074199.470720:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3033 00000100:00080000:2.0:1783074199.470725:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074199.470732:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074199.470758:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf0700 x1869685723616384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074199.470800:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074199.470804:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074199.470806:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074199.470809:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3033 00000100:00080000:2.0:1783074199.470812:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074199.470815:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074199.470826:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df291880 x1869685723616640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074199.470841:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783074199.470845:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074199.470846:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074199.470850:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3033 00000100:00080000:2.0:1783074199.470853:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074199.470856:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074199.470866:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df290000 x1869685723616896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783074199.470892:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783074199.470893:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723616384:0@lo:38:kworker.0 00000100:00080000:2.0:1783074199.470897:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783074199.470901:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783074199.470905:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3033 00000100:00080000:2.0:1783074199.470908:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783074199.470912:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074199.470925:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df290e00 x1869685723617024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074199.470935:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074199.470996:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723616512:0@lo:400:kworker.0 00000100:00100000:1.0:1783074199.471030:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723616768:0@lo:400:kworker.0 00000100:00100000:0.0:1783074199.471068:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723616640:0@lo:38:kworker.0 00000100:00100000:1.0:1783074199.471070:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074199.471105:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074199.471452:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723616896:0@lo:38:kworker.0 00000100:00100000:0.0:1783074199.471479:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074199.471497:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723617024:0@lo:38:kworker.0 00000100:00100000:0.0:1783074199.471519:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074199.472262:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616384 00000100:00100000:3.0:1783074199.472272:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616384 00000100:00100000:0.0:1783074199.472277:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074199.472304:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616768 00000100:00100000:3.0:1783074199.472308:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616768 00000100:00100000:0.0:1783074199.472340:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616640 00000100:00100000:0.0:1783074199.472345:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616640 00000100:00100000:3.0:1783074199.472374:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617024 00000100:00100000:0.0:1783074199.472375:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616512 00000100:00100000:3.0:1783074199.472380:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617024 00000100:00100000:0.0:1783074199.472381:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616512 00000100:00100000:3.0:1783074199.472405:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1783074199.472411:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1783074199.472418:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723616768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074199.472420:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723616512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074199.472481:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723616512:12345-0@lo:400:kworker.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074199.472488:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1783074199.472510:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723616768:12345-0@lo:400:kworker.0 Request processed in 96us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074199.472512:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1783074199.472529:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1783074199.472531:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723616384:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074199.472548:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00010000:00020000:0.0:1783074199.472551:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074199.472556:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723616640:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783074199.472570:0:66202:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074199.472580:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723616384:12345-0@lo:38:kworker.0 Request processed in 51us (1648us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074199.472585:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1783074199.472597:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1783074199.472601:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723617024:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783074199.472608:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783074199.472610:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723616640:12345-0@lo:38:kworker.0 Request processed in 53us (1504us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074199.472633:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783074199.472633:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723617024:12345-0@lo:38:kworker.0 Request processed in 27us (1110us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074199.472641:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1783074199.472662:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723616896 00000100:00100000:3.0:1783074199.472667:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723616896 00000100:00100000:0.0:1783074199.472676:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723616512:0@lo:400:kworker.0 00000100:00100000:3.0:1783074199.472696:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00080000:0.0:1783074199.472702:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783074199.472703:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723616896:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783074199.472709:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074199.472713:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723617024:0@lo:38:kworker.0 00010000:00020000:3.0:1783074199.472719:0:26189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1783074199.472719:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074199.472725:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074199.472727:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723616384:0@lo:38:kworker.0 00000100:00080000:0.0:1783074199.472733:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074199.472735:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783074199.472737:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723616640:0@lo:38:kworker.0 00000100:00080000:0.0:1783074199.472753:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074199.472755:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783074199.472763:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723616896:12345-0@lo:38:kworker.0 Request processed in 58us (1280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074199.472764:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723616896:0@lo:38:kworker.0 00000100:00100000:3.0:1783074199.472777:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00080000:3.0:1783074199.472797:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074199.472823:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723616768:0@lo:400:kworker.0 00010000:00010000:3.0:1783074200.176353:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074201.199654:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783074201.585147:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.26@tcp portal 26 match 1869685708097152 offset 0 length 224: 4 00000100:00100000:2.0:1783074201.585188:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074201.585220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074201.585249:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074201.585279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074201.585343:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708097664 00000100:00100000:2.0:1783074201.585353:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708097664 00000100:00100000:2.0:1783074201.585406:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708097536 00000100:00100000:2.0:1783074201.585409:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708097536 00000100:00100000:2.0:1783074201.585436:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2189 00000100:00100000:2.0:1783074201.585446:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708097664:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074201.585524:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708097664:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074201.585532:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2189 00000100:00100000:2.0:1783074201.585550:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2190 00000100:00100000:2.0:1783074201.585556:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708097536:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074201.585597:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708097536:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074201.585604:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2190 00000100:00100000:2.0:1783074201.585626:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708097408 00000100:00100000:2.0:1783074201.585629:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708097408 00000100:00100000:2.0:1783074201.585655:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708097280 00000100:00100000:2.0:1783074201.585658:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708097280 00000100:00100000:2.0:1783074201.585672:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 877 00000100:00100000:2.0:1783074201.585677:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2402:x1869685708097408:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074201.585703:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2402:x1869685708097408:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074201.585710:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 877 00000100:00100000:2.0:1783074201.585721:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1343 00000100:00100000:2.0:1783074201.585726:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708097280:12345-192.168.204.26@tcp:38:kworker.0 00010000:00020000:2.0:1783074201.585745:0:68632:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783074201.585769:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1869685708097280:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 41us (489us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074201.585775:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1343 00000100:00080000:2.0:1783074201.585790:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074201.585794:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074201.585796:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783074202.222512:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074203.249336:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783074203.393629:0:94270:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783074203.393635:0:94270:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783074203.393636:0:94270:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783074203.393760:0:94270:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9524c6cae000 00000020:01000004:0.0:1783074203.393776:0:94270:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783074203.393790:0:94270:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783074203.393805:0:94270:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9524c44119c0) 00000020:00000080:0.0:1783074203.393822:0:94270:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783074203.480874:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783074203.482613:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.483256:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.483501:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783074203.483833:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.484084:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.484252:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.484453:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783074203.484626:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783074203.484815:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783074203.485054:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783074203.485220:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.485498:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.485726:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783074203.486326:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783074203.491666:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.491866:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.492053:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.492252:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.492780:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.493024:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.494251:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.494657:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.495621:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.495955:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.496166:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.496410:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.496724:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.496956:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.497912:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.498211:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.498617:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783074203.498831:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783074203.499231:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783074203.499915:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.500197:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.500920:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783074203.501330:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.501991:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783074203.502259:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783074203.502631:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.502869:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.503086:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783074203.503334:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.503552:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.503756:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783074203.503984:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783074203.504422:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.504802:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.505016:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.505073:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.505099:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.505124:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.505543:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.505746:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783074203.508607:0:94270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1783074203.509729:0:94270:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783074203.509929:0:94270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783074203.509936:0:94270:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783074203.509946:0:94270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e05e1 00000020:01000004:2.0:1783074203.509953:0:94270:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783074203.509965:0:94270:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783074203.509983:0:94270:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524c6cae000 from MGS 00000020:01000004:2.0:1783074203.509986:0:94270:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783074203.509996:0:94270:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9523c2284d40) 00000020:00000080:2.0:1783074203.510007:0:94270:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1783074203.510074:0:94270:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cae000 from MGS, refs=2 00080000:01000000:2.0:1783074203.510079:0:94270:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783074203.510085:0:94270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e05ef 00010000:00010000:2.0:1783074203.510204:0:94270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1783074203.513306:0:94270:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783074203.517856:0:94274:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783074203.518031:0:94270:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783074203.518079:0:94270:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074203.518724:0:94270:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783074203.519037:0:94270:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783074203.519190:0:94270:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783074203.519197:0:94270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783074203.519722:0:94270:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783074203.519729:0:94270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783074203.519979:0:94270:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783074203.519987:0:94270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783074203.520653:0:94270:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783074203.520674:0:94270:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783074203.520681:0:94270:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783074203.520684:0:94270:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1783074203.520690:0:94270:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783074203.520697:0:94270:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783074203.520700:0:94270:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783074203.520703:0:94270:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783074203.520711:0:94270:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524d232a300 x1869685723613184/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074203.520768:0:94270:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9524c8ff6a00 x1869685723615104/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074203.520788:0:94270:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9523c49c0380 x1869685723616256/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074215 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783074203.520795:0:94270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783074203.520798:0:94270:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783074203.520799:0:94270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783074203.520802:0:94270:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1783074203.520840:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524d232a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723613184:0@lo:400:kworker.0 00000100:00100000:2.0:1783074203.520899:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723616256:0@lo:400:kworker.0 00000100:00100000:0.0:1783074203.520911:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723615104:0@lo:400:kworker.0 10000000:01000000:3.0:1783074203.520920:0:94270:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1783074203.520939:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074203.520950:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074203.520956:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1783074203.521111:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783074203.521123:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299200/0x5fb609b3016dfef6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dfefd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521199:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521207:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521212:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521228:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521232:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e0309 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521242:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521248:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521253:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521257:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521260:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021db600/0x5fb609b3016e0310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e0317 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521268:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521275:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521290:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521294:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521297:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021da000/0x5fb609b3016e031e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e0325 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521335:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521342:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521347:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521351:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521354:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021db400/0x5fb609b3016e032c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e0333 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521366:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521373:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521378:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521381:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521384:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9525021dba00/0x5fb609b3016e033a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e0341 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521392:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521398:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521403:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521411:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521414:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e0348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e034f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521423:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521429:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521434:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521437:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521439:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524c151b200/0x5fb609b3016e0356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016e035d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521449:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521521:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521527:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521539:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521543:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016dfe6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dfe71 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521555:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521833:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521848:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074203.521895:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521901:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28fa00/0x5fb609b3016dfe86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dfe8d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521914:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521920:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521925:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074203.521939:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521943:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28f600/0x5fb609b3016dfe94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dfe9b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.521951:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.521957:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.521961:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074203.521965:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.521968:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086cc00/0x5fb609b3016dfebe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dfec5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.522034:0:94270:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074203.522050:0:94270:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.522124:0:94270:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783074203.522159:0:94270:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783074203.522165:0:94270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524f086ca00/0x5fb609b3016dfee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5fb609b3016dfeef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783074203.522889:0:94270:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9524d08cc800 already not connected (conn 56, was 0): DISCONN 00000100:00080000:1.0:1783074203.522897:0:94270:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074203.522904:0:94270:0:(import.c:512:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 3007 00000100:00080000:1.0:1783074203.522912:0:94270:0:(import.c:626:import_select_connection()) MGC192.168.204.126@tcp: import ffff9524d08cc800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074203.522943:0:94270:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff4000 x1869685723617152/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074203.522967:0:94270:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1783074203.523088:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723617152:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783074203.523163:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.523304:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617152 00000100:00100000:3.0:1783074203.523334:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617152 00000100:00100000:3.0:1783074203.523371:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783074203.523389:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1869685723617152:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783074203.523432:0:94276:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo t0 exp 0000000000000000 cur 3042 last 0 00000020:00000080:3.0:1783074203.523457:0:94276:0:(genops.c:1406:class_connect()) connect: client 522b6a34-04f4-4017-ab45-61a21d19bfef, cookie 0x5fb609b3016e05f6 00000100:00080000:1.0:1783074203.523800:0:94276:0:(import.c:65:import_set_state_nolock()) ffff9524de7c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074203.523859:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:3657:x1869685723617152:12345-0@lo:250:mount.lustre.0 Request processed in 469us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.523871:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783074203.523889:0:3657:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 29 00000100:00080000:2.0:1783074203.523898:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:2.0:1783074203.523905:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783074203.523910:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783074203.523914:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524d08cc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783074203.523916:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783074203.523949:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783074203.523962:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:522b6a34-04f4-4017-ab45-61a21d19bfef:3657:1869685723617152:0@lo:250:mount.lustre.0 00000020:01000000:0.0:1783074203.523990:0:85943:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.126@tcp 10000000:01000000:0.0:1783074203.524009:0:85943:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1783074203.524012:0:85943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783074203.524014:0:85943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783074203.524016:0:85943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074203.524017:0:85943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074203.524019:0:85943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074203.524020:0:85943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074203.524022:0:85943:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783074203.524023:0:85943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074203.524024:0:85943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783074203.524062:0:85943:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00080000:1.0:1783074203.524065:0:94270:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 10000000:01000000:0.0:1783074203.524069:0:85943:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1783074203.524072:0:85943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783074203.524073:0:85943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783074203.524074:0:85943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074203.524075:0:94270:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783074203.524076:0:85943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074203.524079:0:85943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074203.524082:0:85943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783074203.524083:0:85943:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783074203.524084:0:85943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074203.524086:0:85943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783074203.524100:0:85943:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783074203.524104:0:85943:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1783074203.524105:0:85943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783074203.524112:0:85943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000100:00100000:3.0:1783074203.524114:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723617280:0@lo:253:kworker.0 00000020:01000004:0.0:1783074203.524115:0:85943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783074203.524117:0:85943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783074203.524120:0:85943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783074203.524123:0:85943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074203.524125:0:94270:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783074203.524125:0:85943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783074203.524128:0:85943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783074203.524130:0:85943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783074203.524132:0:94270:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:0.0:1783074203.524154:0:85943:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1783074203.524165:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.524183:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723617536:0@lo:253:kworker.0 00000100:00100000:3.0:1783074203.524231:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074203.524240:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723617408:0@lo:253:kworker.0 00000040:01000000:1.0:1783074203.524241:0:94270:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783074203.524270:0:94270:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783074203.524274:0:94270:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783074203.524276:0:94270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:0.0:1783074203.524291:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1783074203.524298:0:94270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:3.0:1783074203.524299:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1783074203.524301:0:94270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074203.524304:0:94270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074203.524305:0:94270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074203.524306:0:94270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074203.524307:0:94270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074203.524330:0:94270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074203.524332:0:94270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074203.524335:0:94270:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783074203.524338:0:94270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783074203.524339:0:94270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074203.524340:0:94270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074203.524341:0:94270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074203.524341:0:94270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074203.524343:0:94270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074203.524344:0:94270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074203.524345:0:94270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074203.524346:0:94270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074203.524346:0:94270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783074203.524372:0:94270:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783074203.524391:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723617664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783074203.524428:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.524671:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617280 00000100:00100000:2.0:1783074203.524677:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617280 00000100:00100000:1.0:1783074203.524683:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c46599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.524703:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617536 00000100:00100000:2.0:1783074203.524705:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617408 00000100:00100000:3.0:1783074203.524709:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617536 00000100:00100000:2.0:1783074203.524710:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617408 00000100:00100000:2.0:1783074203.524724:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617664 00000100:00100000:2.0:1783074203.524727:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617664 00000100:00100000:2.0:1783074203.524744:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783074203.524751:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3660:x1869685723617280:12345-0@lo:253:kworker.0 00000100:00100000:3.0:1783074203.524755:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783074203.524766:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3660:x1869685723617408:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783074203.524779:0:94277:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783074203.524786:0:94278:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1783074203.525042:0:94279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783074203.525099:0:94277:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 123 20000000:01000000:2.0:1783074203.528694:0:94280:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783074203.528702:0:94280:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783074203.528705:0:94280:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783074203.528708:0:94280:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783074203.528726:0:94280:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:1.0:1783074203.529047:0:94277:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783074203.529073:0:94277:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783074203.531003:0:94277:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783074203.531021:0:94277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783074203.531139:0:94279:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074203.531144:0:94279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074203.531170:0:94279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531190:0:94279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783074203.531193:0:94278:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783074203.531199:0:94279:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056175s 00010000:00010000:0.0:1783074203.531204:0:94279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531211:0:94279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531216:0:94279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531223:0:94279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531229:0:94279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ee00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074203.531233:0:94279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531252:0:94279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531267:0:94279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531275:0:94279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.531293:0:94279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e05fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074203.531746:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:3660:x1869685723617280:12345-0@lo:253:kworker.0 Request processed in 6981us (7568us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.531758:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1783074203.531795:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783074203.531797:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000100:00100000:1.0:1783074203.531797:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1783074203.531799:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074203.531800:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074203.531801:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074203.531802:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074203.531804:0:3660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074203.531806:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074203.531807:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783074203.531807:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3658:x1869685723617536:12345-0@lo:253:kworker.0 00000100:00100000:3.0:1783074203.531811:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723617280:0@lo:253:kworker.0 20000000:01000000:1.0:1783074203.531836:0:94277:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783074203.537017:0:94278:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783074203.537090:0:94277:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783074203.537247:0:94278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783074203.537437:0:94279:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074203.537442:0:94279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074203.537464:0:94279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537481:0:94279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074203.537490:0:94279:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056175s 00010000:00010000:0.0:1783074203.537494:0:94279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537501:0:94279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537507:0:94279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537513:0:94279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537526:0:94279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074203.537531:0:94279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537539:0:94279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537551:0:94279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537559:0:94279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.537564:0:94279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28e400/0x5fb609b3016e0604 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074203.540957:0:94277:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783074203.541015:0:94277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783074203.541110:0:94279:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074203.541115:0:94279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074203.541136:0:94279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541154:0:94279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074203.541161:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:3660:x1869685723617408:12345-0@lo:253:kworker.0 Request processed in 16391us (16859us total) trans 0 rc 0/0 20000000:01000000:0.0:1783074203.541167:0:94279:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056175s 00010000:00010000:0.0:1783074203.541174:0:94279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074203.541177:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783074203.541184:0:94279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541204:0:94279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541211:0:94279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541218:0:94279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28ee00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074203.541223:0:94279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541232:0:94279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074203.541238:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783074203.541253:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:94270:x1869685723617664:12345-0@lo:253:mount.lustre.0 00010000:00010000:0.0:1783074203.541254:0:94279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541265:0:94279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.541272:0:94279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e060b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783074203.541330:0:94278:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783074203.541333:0:94278:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783074203.541337:0:94278:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1783074203.541343:0:94278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783074203.541414:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:3658:x1869685723617536:12345-0@lo:253:kworker.0 Request processed in 9607us (17122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.541422:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1783074203.541444:0:3660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783074203.541447:0:3660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783074203.541449:0:3660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074203.541451:0:3660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074203.541452:0:3660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074203.541454:0:3660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074203.541456:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783074203.541456:0:3660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074203.541459:0:3660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074203.541460:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783074203.541462:0:3660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:2.0:1783074203.541463:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074203.541466:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074203.541469:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1783074203.541470:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723617408:0@lo:253:kworker.0 00000020:01000004:2.0:1783074203.541471:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074203.541474:0:3658:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074203.541476:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074203.541479:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783074203.541483:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723617536:0@lo:253:kworker.0 00000100:00100000:3.0:1783074203.541763:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:94270:x1869685723617664:12345-0@lo:253:mount.lustre.0 Request processed in 514us (17334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.541770:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783074203.541837:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723617664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783074203.541850:0:94270:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783074203.541853:0:94270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783074203.541854:0:94270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783074203.541855:0:94270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074203.541856:0:94270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074203.541858:0:94270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074203.541859:0:94270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074203.541860:0:94270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783074203.541862:0:94270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783074203.541863:0:94270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074203.541864:0:94270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783074203.541881:0:94270:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9524c6cae000 from lustre-MDT0000 10000000:01000000:1.0:1783074203.541910:0:94270:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783074203.541913:0:94270:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074203.541921:0:94270:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9524c6cae000 10000000:01000000:1.0:1783074203.541924:0:94270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783074203.541928:0:94270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9524c6cae000 10000000:01000000:1.0:1783074203.541931:0:94270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783074203.541935:0:94270:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9524c6cae000 from 1 10000000:01000000:1.0:1783074203.541938:0:94270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783074203.541965:0:94270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.541974:0:94270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.542074:0:94270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074203.542093:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723617792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074203.542127:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.542162:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.542214:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617792 00000100:00100000:0.0:1783074203.542220:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617792 00000100:00100000:0.0:1783074203.542259:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783074203.542266:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:94270:x1869685723617792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074203.542275:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074203.542297:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28e800/0x5fb609b3016e0619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0612 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.542445:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28e800/0x5fb609b3016e0619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0612 expref: 6 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.542455:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28e800/0x5fb609b3016e0619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0612 expref: 6 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.542463:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e800, rc 0) 00000100:00100000:0.0:1783074203.542532:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+6:94270:x1869685723617792:12345-0@lo:101:mount.lustre.0 Request processed in 266us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.542539:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783074203.542588:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723617792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074203.542601:0:94270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0619 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.542610:0:94270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0619 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.542621:0:94270:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783074203.542636:0:94270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0619 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.542644:0:94270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c8000/0x5fb609b3016e0612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0619 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.542651:0:94270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783074203.542654:0:94270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783074203.542659:0:94270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9524c6cae000 10000000:01000000:1.0:1783074203.542661:0:94270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783074203.542664:0:94270:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783074203.542666:0:94270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074203.542679:0:94270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.542692:0:94270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.542700:0:94270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074203.542712:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723617920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074203.542735:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.542761:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074203.543061:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723617920 00000100:00100000:2.0:1783074203.543066:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723617920 00000100:00100000:2.0:1783074203.543095:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783074203.543102:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:94270:x1869685723617920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074203.543110:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074203.543120:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0620 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.543134:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 7 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.543153:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 7 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.543160:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7400, rc 0) 00000100:00100000:2.0:1783074203.543193:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:94270:x1869685723617920:12345-0@lo:101:mount.lustre.0 Request processed in 92us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.543201:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783074203.543220:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723617920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783074203.543232:0:94270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.543239:0:94270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074203.543298:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723618048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074203.543469:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.543524:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.543554:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618048 00000100:00100000:0.0:1783074203.543558:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618048 00000100:00100000:0.0:1783074203.543618:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783074203.543625:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+7:94270:x1869685723618048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074203.543751:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94270:x1869685723618048:12345-0@lo:501:mount.lustre.0 Request processed in 126us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.543758:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783074203.543822:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723618048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074203.543850:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723618176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074203.543891:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.543937:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.543970:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618176 00000100:00100000:3.0:1783074203.543974:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618176 00000100:00100000:3.0:1783074203.544012:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783074203.544019:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94270:x1869685723618176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783074203.544167:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94270:x1869685723618176:12345-0@lo:503:mount.lustre.0 Request processed in 149us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.544172:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783074203.544267:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723618176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074203.544663:0:94281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94281:1869685723618304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074203.544688:0:94281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.544710:0:94281:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.544724:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618304 00000100:00100000:0.0:1783074203.544728:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618304 00000100:00100000:0.0:1783074203.544765:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783074203.544771:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94281:x1869685723618304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074203.545168:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94281:x1869685723618304:12345-0@lo:502:llog_process_th.0 Request processed in 396us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.545175:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783074203.545197:0:94281:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94281:1869685723618304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074203.545219:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074203.545229:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.545232:0:94281:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783074203.545240:0:94281:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783074203.545243:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074203.545256:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9524fb4d99c0) 00000020:00000080:2.0:1783074203.545276:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1783074203.545296:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783074203.545492:0:94281:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783074203.545505:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e0635 00000020:00000080:2.0:1783074203.545701:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783074203.545704:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.545707:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.545708:0:94281:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783074203.545710:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074203.545712:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.545713:0:94281:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783074203.545715:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074203.545721:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9524fb4d8000) 00000020:00000080:2.0:1783074203.545730:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1783074203.545732:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783074203.545733:0:94281:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783074203.545736:0:94281:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783074203.545741:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783074203.545782:0:94281:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cae000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783074203.545794:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9524fb4dcd40) 00000020:00000080:2.0:1783074203.545807:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1783074203.545859:0:94281:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783074203.545864:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e064a 00000020:00000080:2.0:1783074203.545955:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783074203.545962:0:94281:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783074203.545966:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb609b3016e0651 00080000:01000000:2.0:1783074203.545971:0:94281:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783074203.545975:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e0658 00010000:00010000:2.0:1783074203.587646:0:94281:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1783074203.587785:0:94281:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116997 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:2.0:1783074203.587832:0:94281:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:2.0:1783074203.587859:0:94281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:2.0:1783074203.587960:0:94281:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1783074203.588011:0:94281:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524e01136c0: xid 1869685708087680, transno 120259084293, client gen 24, slot idx 0 00000001:00080000:2.0:1783074203.588023:0:94281:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524d2be0840: xid 1869685723608704, transno 120259084297, client gen 22, slot idx 1 00000001:00080000:2.0:1783074203.588027:0:94281:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524c68df9c0: xid 1869685723608960, transno 120259084298, client gen 22, slot idx 2 00000001:00080000:2.0:1783074203.588030:0:94281:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9524c68df600: xid 1869685723605376, transno 120259084294, client gen 22, slot idx 3 00000020:00000080:2.0:1783074203.588421:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9524fb4db380) 00000020:00000080:2.0:1783074203.588442:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1783074203.588509:0:94281:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783074203.588516:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e0674 00000020:00000080:3.0:1783074203.588925:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783074203.597365:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb609b3016e067b 00000020:00000080:2.0:1783074203.597713:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783074203.597722:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.597727:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.597728:0:94281:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783074203.597730:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074203.597732:0:94281:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1783074203.597733:0:94281:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074203.597734:0:94281:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074203.597735:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783074203.597737:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.597739:0:94281:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074203.597741:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074203.597745:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.597747:0:94281:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783074203.597751:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783074203.597794:0:94281:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783074203.597807:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.597810:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.597812:0:94281:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783074203.597814:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074203.597819:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.597820:0:94281:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783074203.597823:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074203.597834:0:94281:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:2.0:1783074203.597859:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074203.597875:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9524d2e4cd40) 00000020:00000080:2.0:1783074203.597891:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1783074203.597897:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783074203.597951:0:94281:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783074203.597957:0:94281:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783074203.597962:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e0689 00010000:00080000:2.0:1783074203.598010:0:94281:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c6211000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1783074203.599672:0:94281:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783074203.600559:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074203.600570:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783074203.600604:0:94281:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074203.600642:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e0690 00000100:00080000:2.0:1783074203.600651:0:94281:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074203.600657:0:94281:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9524c6211000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074203.600688:0:94281:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df292680 x1869685723618432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074203.600747:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723618432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074203.600815:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783074203.600890:0:94281:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1783074203.601036:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.601040:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.601042:0:94281:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783074203.601045:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783074203.601048:0:94281:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1783074203.601049:0:94281:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074203.601051:0:94281:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783074203.601052:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783074203.601055:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.601056:0:94281:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783074203.601059:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783074203.601063:0:94281:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783074203.601071:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.601072:0:94281:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783074203.601076:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783074203.601080:0:94281:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1783074203.601098:0:94281:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783074203.601100:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783074203.601112:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9524d2e4b380) 00000020:00000080:2.0:1783074203.601134:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783074203.601140:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1783074203.601153:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618432 00000100:00100000:3.0:1783074203.601161:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618432 00000100:00100000:3.0:1783074203.601197:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:3.0:1783074203.601204:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723618432:12345-0@lo:38:llog_process_th.0 00000004:00080000:2.0:1783074203.601207:0:94281:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783074203.601216:0:94281:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783074203.601222:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e069e 00010000:00080000:3.0:1783074203.601234:0:23954:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3042 last 0 00010000:00080000:2.0:1783074203.601256:0:94281:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9523c6a63800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000020:00000080:3.0:1783074203.601271:0:23954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e06a5 00000004:00100000:3.0:1783074203.601447:0:23954:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:2.0:1783074203.601469:0:94281:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:3.0:1783074203.601553:0:23954:0:(import.c:65:import_set_state_nolock()) ffff9524f7803000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074203.601818:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723618432:12345-0@lo:38:llog_process_th.0 Request processed in 612us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.601835:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00080000:1.0:1783074203.602010:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074203.602017:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074203.602020:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074203.602025:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3038 00000100:00080000:1.0:1783074203.602029:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783074203.602033:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074203.602065:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff7b80 x1869685723618560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074203.602157:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723618688:0@lo:400:kworker.0 00000100:00100000:3.0:1783074203.602190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074203.602289:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074203.602296:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074203.602298:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783074203.602302:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618688 00000100:00080000:1.0:1783074203.602303:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3038 00000100:00080000:1.0:1783074203.602324:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1783074203.602328:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618688 00000100:00080000:1.0:1783074203.602331:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074203.602348:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff4000 x1869685723618816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074203.602375:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00080000:1.0:1783074203.602381:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783074203.602386:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723618688:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783074203.602388:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074203.602391:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074203.602397:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3038 00000100:00080000:1.0:1783074203.602400:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1783074203.602430:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723618688:12345-0@lo:400:kworker.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.602438:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00080000:2.0:1783074203.602464:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074203.602476:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783074203.602484:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723618944:0@lo:400:kworker.0 00000100:00100000:2.0:1783074203.602510:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.602537:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618944 00000100:00100000:2.0:1783074203.602540:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618944 00000100:00100000:2.0:1783074203.602566:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1783074203.602572:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723618944:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783074203.602619:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074203.602635:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff7480 x1869685723619072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783074203.602664:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074203.602667:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783074203.602669:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074203.602672:0:85943:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3038 00000100:00080000:1.0:1783074203.602675:0:85943:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783074203.602678:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074203.602687:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff5c00 x1869685723619456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074203.602721:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783074203.602729:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723619200:0@lo:400:kworker.0 00000100:00100000:3.0:1783074203.602764:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723618688:0@lo:400:kworker.0 00000100:00100000:3.0:1783074203.602794:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783074203.602801:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869685723618944:12345-0@lo:400:kworker.0 Request processed in 226us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.602803:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723619328:0@lo:400:kworker.0 00000100:00100000:2.0:1783074203.602816:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00080000:2.0:1783074203.602838:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074203.602839:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.602865:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869685723618944:0@lo:400:kworker.0 00000040:01000000:2.0:1783074203.602926:0:94281:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783074203.603089:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619328 00000100:00100000:3.0:1783074203.603094:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619328 00000040:01000000:2.0:1783074203.603106:0:94281:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783074203.603130:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1783074203.603139:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723619328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074203.603185:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723619328:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.603191:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00080000:3.0:1783074203.603210:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074203.603237:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723619328:0@lo:400:kworker.0 00000040:00080000:2.0:1783074203.603405:0:94281:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000100:00100000:1.0:1783074203.603527:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.603592:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619200 00000100:00100000:3.0:1783074203.603596:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619200 00000100:00100000:3.0:1783074203.603673:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1783074203.603679:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723619200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074203.603723:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723619200:12345-0@lo:400:kworker.0 Request processed in 43us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.603730:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1783074203.603760:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723619200:0@lo:400:kworker.0 00000100:00080000:1.0:1783074203.603866:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783074203.604211:0:94281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074203.604240:0:94281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000100:00100000:0.0:1783074203.604713:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783074203.604723:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783074203.604730:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783074203.604735:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783074203.604738:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c6211000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074203.604887:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723618432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783074203.604936:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723618560:0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.604985:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.605010:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723618816:0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.605029:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.605056:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723619072:0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.605081:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.605094:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723619456:0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.605114:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.605151:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618560 00000100:00100000:0.0:1783074203.605156:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618560 00000100:00100000:0.0:1783074203.605188:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723618816 00000100:00100000:0.0:1783074203.605191:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723618816 00000100:00100000:0.0:1783074203.605205:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619456 00000100:00100000:0.0:1783074203.605208:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619456 00000100:00100000:0.0:1783074203.605220:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1783074203.605225:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723618560:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.605288:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723618560:12345-0@lo:38:kworker.0 Request processed in 49us (290us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783074203.605296:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1783074203.605334:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1783074203.605342:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723618816:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.605350:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1783074203.605357:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723619456:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783074203.605372:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619072 00000100:00100000:3.0:1783074203.605384:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619072 00000100:00100000:2.0:1783074203.605385:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1869685723618816:12345-0@lo:38:kworker.0 Request processed in 42us (354us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783074203.605394:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1783074203.605411:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723619456:12345-0@lo:38:kworker.0 Request processed in 50us (292us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074203.605417:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1783074203.605422:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00080000:0.0:1783074203.605457:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074203.605462:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783074203.605466:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723618560:0@lo:38:kworker.0 00000100:00080000:0.0:1783074203.605476:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783074203.605479:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723619072:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783074203.605482:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783074203.605490:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723618816:0@lo:38:kworker.0 00000100:00080000:0.0:1783074203.605499:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074203.605501:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783074203.605504:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723619456:0@lo:38:kworker.0 00000100:00100000:3.0:1783074203.605660:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723619072:12345-0@lo:38:kworker.0 Request processed in 181us (576us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074203.605668:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00080000:0.0:1783074203.605670:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074203.605676:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783074203.605680:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723619072:0@lo:38:kworker.0 00000100:00100000:0.0:1783074203.605786:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074203.605828:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723619584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074203.605853:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.605925:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619584 00000100:00100000:1.0:1783074203.605929:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619584 00000100:00100000:1.0:1783074203.606086:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1783074203.606095:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723619584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783074203.606122:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:1.0:1783074203.606159:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723619584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.606165:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:0.0:1783074203.606217:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723619584:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783074203.609017:0:94281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000040:00080000:1.0:1783074203.609707:0:94287:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:1.0:1783074203.609713:0:94287:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783074203.609884:0:94287:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:1.0:1783074203.609904:0:94287:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783074203.610152:0:94287:0:(llog.c:800:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:1.0:1783074203.610155:0:94287:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783074203.610542:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783074203.610555:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783074203.610594:0:94281:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783074203.610621:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e06ac 00000100:00080000:3.0:1783074203.610630:0:94281:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783074203.610636:0:94281:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9523c6a63800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074203.610670:0:94281:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c557f800 x1869685723619712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074203.610705:0:94281:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1783074203.610723:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723619712:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1783074203.610773:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074203.610961:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074203.610964:0:94281:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783074203.610969:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783074203.610972:0:94281:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1783074203.610974:0:94281:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074203.610976:0:94281:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074203.610977:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783074203.611017:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074203.611019:0:94281:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783074203.611022:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783074203.611026:0:94281:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783074203.611028:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074203.611029:0:94281:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783074203.611031:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783074203.611034:0:94281:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000100:00100000:0.0:1783074203.611169:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.611275:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619712 00000100:00100000:2.0:1783074203.611294:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619712 00000020:01000000:3.0:1783074203.611381:0:94281:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783074203.611384:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783074203.611396:0:94281:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9524fa8619c0) 00000020:00000080:3.0:1783074203.611417:0:94281:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783074203.611423:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1783074203.611478:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4936 00000100:00100000:2.0:1783074203.611486:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3657:x1869685723619712:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1783074203.611543:0:26176:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3042 last 0 00000004:00080000:3.0:1783074203.611565:0:94281:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000020:00000080:2.0:1783074203.611570:0:26176:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e06ba 00080000:01000000:3.0:1783074203.611574:0:94281:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783074203.611583:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb609b3016e06c1 00002000:00100000:2.0:1783074203.611587:0:26176:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9524ee2c7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783074203.611593:0:26176:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783074203.611596:0:26176:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783074203.611652:0:26176:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783074203.611669:0:26176:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1783074203.611681:0:94281:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c7838000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:2.0:1783074203.611761:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723619712:12345-0@lo:8:llog_process_th.0 Request processed in 275us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.611767:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4936 00010000:00010000:3.0:1783074203.611877:0:94281:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1783074203.611878:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783074203.611885:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783074203.611892:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783074203.611900:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783074203.611903:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:01000000:3.0:1783074203.611943:0:94281:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:0.0:1783074203.611945:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783074203.611952:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723619712:0@lo:8:llog_process_th.0 00000040:01000000:3.0:1783074203.611959:0:94281:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000004:00080000:1.0:1783074203.611969:0:94287:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783074203.612012:0:94287:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3042829699924ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783074203.612018:0:94287:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783074203.612244:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723619840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074203.612274:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.612414:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619840 00000100:00100000:3.0:1783074203.612419:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619840 00000100:00080000:0.0:1783074203.612464:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074203.612494:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:3.0:1783074203.612503:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723619840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074203.612530:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074203.612589:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723619840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074203.612600:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723619840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.612608:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000040:00080000:3.0:1783074203.612683:0:94281:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1783074203.614041:0:94281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783074203.614069:0:94281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000004:00080000:1.0:1783074203.614229:0:94271:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1783074203.614683:0:94281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000040:00080000:3.0:1783074203.615037:0:94289:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:3.0:1783074203.615042:0:94289:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783074203.615583:0:94289:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:3.0:1783074203.615602:0:94289:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783074203.615758:0:94281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783074203.615769:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783074203.615816:0:94281:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783074203.615846:0:94281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e06c8 00000100:00080000:2.0:1783074203.615857:0:94281:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783074203.615864:0:94281:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9524c7838000 using connection 192.168.204.126@tcp/0@lo 00000040:00080000:3.0:1783074203.615890:0:94289:0:(llog.c:800:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000100:00100000:2.0:1783074203.615895:0:94281:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df291f80 x1869685723619968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:3.0:1783074203.615904:0:94289:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000100:00080000:2.0:1783074203.615931:0:94281:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783074203.615985:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723619968:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1783074203.615992:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.615997:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.615999:0:94281:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783074203.616003:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074203.616008:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.616010:0:94281:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783074203.616014:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783074203.616016:0:94281:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783074203.616018:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.616022:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.616024:0:94281:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783074203.616026:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074203.616029:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.616031:0:94281:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783074203.616035:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783074203.616041:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074203.616043:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.616045:0:94281:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1783074203.616048:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1783074203.616055:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783074203.616066:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074203.616068:0:94281:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1783074203.616073:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1783074203.616172:0:94281:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:0.0:1783074203.616246:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723619968 00000100:00100000:0.0:1783074203.616253:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723619968 00000100:00100000:0.0:1783074203.616302:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:0.0:1783074203.616334:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3657:x1869685723619968:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783074203.616370:0:26173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3042 last 0 00000020:00000080:0.0:1783074203.616395:0:26173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb609b3016e06cf 00002000:00100000:0.0:1783074203.616408:0:26173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9524c6e2d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783074203.616411:0:26173:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783074203.616415:0:26173:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783074203.616466:0:26173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783074203.616489:0:26173:0:(import.c:65:import_set_state_nolock()) ffff9524c6e2c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074203.616559:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3657:x1869685723619968:12345-0@lo:8:llog_process_th.0 Request processed in 247us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.616567:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00000100:00100000:1.0:1783074203.616599:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1783074203.616606:0:94281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94281:1869685723620096:0@lo:502:llog_process_th.0 00000100:00080000:1.0:1783074203.616608:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:2.0:1783074203.616655:0:94281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074203.616683:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1783074203.616685:0:94281:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba300c0 going to sleep for 11 seconds 00000100:00080000:1.0:1783074203.616690:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783074203.616695:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c7838000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783074203.616743:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620096 00000004:00080000:1.0:1783074203.616759:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783074203.616761:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620096 00000100:00100000:1.0:1783074203.616765:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723619968:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783074203.616782:0:94289:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783074203.616817:0:94289:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3042834504704ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783074203.616824:0:94289:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783074203.616853:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723620224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074203.616886:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.616915:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783074203.616924:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94281:x1869685723620096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074203.617010:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94281:x1869685723620096:12345-0@lo:502:llog_process_th.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.617017:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783074203.617243:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620224 00000100:00100000:2.0:1783074203.617248:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620224 00000100:00080000:0.0:1783074203.617295:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074203.617340:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1783074203.617351:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723620224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783074203.617371:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074203.617395:0:94281:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94281:1869685723620096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074203.617421:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723620224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.617440:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723620224:0@lo:13:osp-pre-1-0.0 00000020:01000000:3.0:1783074203.617457:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074203.617462:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074203.617464:0:94281:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:3.0:1783074203.617467:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074203.617471:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074203.617472:0:94281:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1783074203.617488:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1783074203.617500:0:94281:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1783074203.617574:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000020:01000004:2.0:1783074203.617820:0:94291:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cae000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783074203.617825:0:94291:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cae000 4 00000100:00100000:3.0:1783074203.617827:0:94281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4685c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94281:1869685723620352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074203.617854:0:94281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.617880:0:94281:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c86546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.617997:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620352 00000100:00100000:0.0:1783074203.618001:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620352 00000100:00100000:0.0:1783074203.618022:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783074203.618032:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94281:x1869685723620352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074203.618089:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94281:x1869685723620352:12345-0@lo:502:llog_process_th.0 Request processed in 58us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.618094:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783074203.618152:0:94281:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4685c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94281:1869685723620352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783074203.618165:0:94281:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074203.618169:0:94281:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074203.618170:0:94281:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783074203.618173:0:94281:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1783074203.618458:0:94270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:1.0:1783074203.618490:0:94270:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783074203.618507:0:94270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.618518:0:94270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074203.618525:0:94270:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6cae000 from 1 10000000:01000000:1.0:1783074203.618527:0:94270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783074203.618555:0:94270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.618563:0:94270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.618573:0:94270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074203.618582:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783074203.618603:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.618633:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e600 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.618634:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620480 00000100:00100000:3.0:1783074203.618638:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620480 00000100:00100000:3.0:1783074203.618673:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783074203.618680:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:94270:x1869685723620480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074203.618689:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074203.618703:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e06d6 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.618732:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 9 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.618742:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 9 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.618752:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670000, rc 0) 00000100:00100000:2.0:1783074203.618948:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074203.618952:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:94270:x1869685723620480:12345-0@lo:101:mount.lustre.0 Request processed in 271us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.618959:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1783074203.618966:0:94270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.618976:0:94270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074203.619089:0:94271:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783074203.619521:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620608:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783074203.619557:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.619588:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.619606:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620608 00000100:00100000:0.0:1783074203.619612:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620608 00000100:00100000:0.0:1783074203.619643:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783074203.619650:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:94270:x1869685723620608:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783074203.619666:0:94276:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783074203.619681:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783074203.619685:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783074203.619688:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783074203.619690:0:94276:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 126 00000100:00100000:0.0:1783074203.619769:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+9:94270:x1869685723620608:12345-0@lo:256:mount.lustre.0 Request processed in 119us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.619788:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783074203.619879:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620608:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783074203.620471:0:94270:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074203.620490:0:94270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.620500:0:94270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074203.620507:0:94270:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524c6cae000 from 1 10000000:01000000:2.0:1783074203.620510:0:94270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074203.620533:0:94270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.620542:0:94270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.620551:0:94270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074203.620564:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783074203.620595:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.620626:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.620803:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620736 00000100:00100000:0.0:1783074203.620813:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620736 00000100:00100000:0.0:1783074203.620848:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783074203.620855:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:94270:x1869685723620736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074203.620865:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074203.620876:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e06eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e06e4 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.620907:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e06eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e06e4 expref: 10 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.620917:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e06eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e06e4 expref: 10 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.620926:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28ee00, rc 0) 00000100:00100000:0.0:1783074203.620961:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94270:x1869685723620736:12345-0@lo:101:mount.lustre.0 Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.620968:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783074203.620992:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783074203.621004:0:94270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06eb expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.621011:0:94270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e06eb expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074203.621061:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074203.621079:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.621103:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074203.621124:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620864 00000100:00100000:1.0:1783074203.621129:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620864 00000100:00100000:1.0:1783074203.621158:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783074203.621165:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94270:x1869685723620864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074203.621292:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94270:x1869685723620864:12345-0@lo:501:mount.lustre.0 Request processed in 126us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.621308:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074203.621342:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074203.621346:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783074203.621372:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.621386:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.621606:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723620992 00000100:00100000:0.0:1783074203.621610:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723620992 00000100:00100000:0.0:1783074203.621627:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783074203.621632:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723620992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783074203.621711:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723620992:12345-0@lo:503:mount.lustre.0 Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.621718:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783074203.621911:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723620992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074203.622263:0:94292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94292:1869685723621120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074203.622308:0:94292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.622580:0:94292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.622631:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621120 00000100:00100000:0.0:1783074203.622636:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621120 00000100:00100000:0.0:1783074203.622666:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783074203.622673:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94292:x1869685723621120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074203.623487:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94292:x1869685723621120:12345-0@lo:502:llog_process_th.0 Request processed in 813us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.623496:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783074203.623631:0:94292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94292:1869685723621120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074203.623656:0:94292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074203.623665:0:94292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074203.623667:0:94292:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783074203.623676:0:94292:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524c6cae000 00000020:00000080:1.0:1783074203.623678:0:94292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783074203.623687:0:94292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074203.623689:0:94292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074203.623691:0:94292:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783074203.623693:0:94292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074203.623695:0:94292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074203.623696:0:94292:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783074203.623700:0:94292:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9524c6cae000 00000020:00000080:1.0:1783074203.623701:0:94292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783074203.623777:0:94292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94292:1869685723621248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074203.623813:0:94292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.623948:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621248 00000100:00100000:3.0:1783074203.623953:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621248 00000100:00100000:1.0:1783074203.623959:0:94292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.624292:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783074203.624301:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94292:x1869685723621248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074203.624451:0:94292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94292:1869685723621248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783074203.624474:0:94292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1783074203.624477:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94292:x1869685723621248:12345-0@lo:502:llog_process_th.0 Request processed in 173us (658us total) trans 0 rc 0/0 00000020:00000080:1.0:1783074203.624480:0:94292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074203.624483:0:94292:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783074203.624489:0:94292:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1783074203.624490:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000000:3.0:1783074203.624636:0:94270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783074203.624769:0:94270:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783074203.624788:0:94270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06eb expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.624810:0:94270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06eb expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074203.624859:0:94270:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783074203.624862:0:94270:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9524c6cae000 10000000:01000000:3.0:1783074203.624869:0:94270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9524c6cae000 10000000:01000000:3.0:1783074203.624874:0:94270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783074203.624880:0:94270:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6cae000 from 1 10000000:01000000:3.0:1783074203.624883:0:94270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783074203.624908:0:94270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.624917:0:94270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.624926:0:94270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074203.624940:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4685c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723621376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783074203.624967:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.625046:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621376 00000100:00100000:0.0:1783074203.625051:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621376 00000100:00100000:3.0:1783074203.625075:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654780 going to sleep for 11 seconds 00000100:00100000:0.0:1783074203.625117:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783074203.625124:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:94270:x1869685723621376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074203.625132:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074203.625142:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e06f2 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.625163:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 11 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.625174:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 11 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.625183:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e400, rc 0) 00000100:00100000:0.0:1783074203.625220:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723621376:12345-0@lo:101:mount.lustre.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.625227:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783074203.625379:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4685c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723621376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074203.625394:0:94270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.625404:0:94270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074203.625465:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723621504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783074203.625492:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.625558:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074203.625953:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621504 00000100:00100000:1.0:1783074203.625958:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621504 00000100:00100000:1.0:1783074203.626040:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783074203.626048:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723621504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783074203.626160:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723621504:12345-0@lo:501:mount.lustre.0 Request processed in 112us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.626167:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783074203.626194:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723621504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783074203.626228:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723621632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074203.626263:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.626381:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30600 going to sleep for 11 seconds 00000100:00100000:1.0:1783074203.626437:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621632 00000100:00100000:1.0:1783074203.626442:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621632 00000100:00100000:1.0:1783074203.626477:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783074203.626484:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723621632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783074203.626651:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723621632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783074203.626652:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723621632:12345-0@lo:503:mount.lustre.0 Request processed in 167us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.626665:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783074203.627107:0:94294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94294:1869685723621760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074203.627144:0:94294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.627193:0:94294:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a3000 going to sleep for 11 seconds 00000100:00100000:2.0:1783074203.627230:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621760 00000100:00100000:2.0:1783074203.627234:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621760 00000100:00100000:2.0:1783074203.627307:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783074203.627332:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94294:x1869685723621760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074203.627426:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94294:x1869685723621760:12345-0@lo:502:llog_process_th.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.627433:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783074203.627499:0:94294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94294:1869685723621760:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783074203.627550:0:94294:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783074203.627562:0:94294:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9523c338b380) 00000020:00000080:1.0:1783074203.627582:0:94294:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783074203.627700:0:94294:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cae000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783074203.627703:0:94294:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524c6cae000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783074203.627705:0:94294:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cae000 4 00010000:00080000:1.0:1783074203.627730:0:94294:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524de7c4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1783074203.630812:0:94294:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783074203.631070:0:94294:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783074203.631128:0:94294:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783074203.631143:0:94294:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb609b3016e0707 00000100:00080000:1.0:1783074203.631154:0:94294:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783074203.631160:0:94294:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524de7c4800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074203.631197:0:94294:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c8ff7480 x1869685723621888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074203.631238:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723621888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074203.631340:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783074203.631396:0:94294:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783074203.631485:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723621888 00000100:00100000:3.0:1783074203.631493:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723621888 00000100:00100000:3.0:1783074203.631528:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1783074203.631535:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723621888:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783074203.631626:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783074203.631633:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524de7c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074203.631638:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783074203.631643:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723621888:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783074203.631742:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723621888:12345-0@lo:38:llog_process_th.0 Request processed in 205us (402us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074203.631751:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1783074203.632074:0:94294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94294:1869685723622016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074203.632123:0:94294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.632150:0:94294:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.632165:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622016 00000100:00100000:3.0:1783074203.632170:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622016 00000100:00100000:3.0:1783074203.632206:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783074203.632214:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94294:x1869685723622016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074203.632375:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94294:x1869685723622016:12345-0@lo:502:llog_process_th.0 Request processed in 161us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.632388:0:94294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94294:1869685723622016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074203.632395:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783074203.632446:0:94294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94294:1869685723622144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074203.632487:0:94294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074203.632513:0:94294:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524df15e000 going to sleep for 11 seconds 00000100:00100000:2.0:1783074203.632542:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622144 00000100:00100000:2.0:1783074203.632547:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622144 00000100:00100000:2.0:1783074203.632577:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783074203.632583:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94294:x1869685723622144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074203.632858:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94294:x1869685723622144:12345-0@lo:502:llog_process_th.0 Request processed in 275us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074203.632865:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783074203.632927:0:94294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:94294:1869685723622144:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783074203.632945:0:94294:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1783074203.633173:0:94270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:2.0:1783074203.633196:0:94270:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074203.633214:0:94270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074203.633225:0:94270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783074203.633267:0:94270:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783074203.633270:0:94270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074203.633272:0:94270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074203.633273:0:94270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074203.633274:0:94270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074203.633289:0:94270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074203.633291:0:94270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074203.633292:0:94270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074203.633294:0:94270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074203.633295:0:94270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783074203.633298:0:94270:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783074203.633300:0:94270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783074203.633302:0:94270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074203.633303:0:94270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074203.633304:0:94270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074203.633305:0:94270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783074203.633306:0:94270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074203.633308:0:94270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074203.633330:0:94270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074203.633332:0:94270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074203.633333:0:94270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783074203.633350:0:94270:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783074203.633358:0:94270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723622272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783074203.633390:0:94270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074203.633406:0:94270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c44986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.633501:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622272 00000100:00100000:3.0:1783074203.633506:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622272 00000100:00100000:3.0:1783074203.633543:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783074203.633550:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723622272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783074203.633570:0:94276:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783074203.633583:0:94276:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783074203.638244:0:94276:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783074203.638263:0:94276:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783074203.638455:0:94279:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783074203.638461:0:94279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783074203.638482:0:94279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.638507:0:94279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.638516:0:94279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.638551:0:94279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.638565:0:94279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 3142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074203.638579:0:94279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723622400:0@lo:104: 00000100:00100000:3.0:1783074203.638618:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:94270:x1869685723622272:12345-0@lo:253:mount.lustre.0 Request processed in 5066us (5225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.638629:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783074203.638710:0:94270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:94270:1869685723622272:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783074203.638722:0:94270:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783074203.638726:0:94270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783074203.638727:0:94270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783074203.638729:0:94270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783074203.638730:0:94270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783074203.638731:0:94270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1783074203.638732:0:94279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1783074203.638733:0:94270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783074203.638734:0:94270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783074203.638735:0:94270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783074203.638737:0:94270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783074203.638739:0:94270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783074203.638751:0:94270:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783074203.638764:0:94279:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.639233:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622400 00000100:00100000:3.0:1783074203.639239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622400 00000100:00100000:3.0:1783074203.639285:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1783074203.639297:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:94279:x1869685723622400:12345-0@lo:104: 00010000:00010000:3.0:1783074203.639443:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.639503:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074203.639510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:94279:x1869685723622400:12345-0@lo:104: Request processed in 218us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.639517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00010000:00010000:3.0:1783074203.639536:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074203.639544:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.639552:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074203.639563:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.639571:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074203.639578:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074203.639584:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783074203.639612:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.639618:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783074203.639622:0:94279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723622400:0@lo:104: 00010000:00010000:3.0:1783074203.639636:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.639640:0:94279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.639643:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c9800/0x5fb609b3016e06d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e06dd expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074203.639657:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074203.639659:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074203.639660:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074203.639671:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723622528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074203.639697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074203.639858:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622528 00000100:00100000:0.0:1783074203.639863:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622528 00010000:00010000:0.0:1783074203.639880:0:7930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 3142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074203.639957:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1783074203.639965:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+11:3658:x1869685723622528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074203.639976:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074203.639982:0:7930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 3142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.639992:0:7930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 3142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640004:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670000/0x5fb609b3016e06dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e06d6 expref: 11 pid: 94278 timeout: 3142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640018:0:7930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640026:0:7930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783074203.640038:0:7930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001578237s 00010000:00010000:0.0:1783074203.640042:0:7930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640049:0:7930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640066:0:7930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640073:0:7930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640078:0:7930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074203.640082:0:7930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640090:0:7930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640576:0:7930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.640577:0:94279:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074203.640586:0:94279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074203.640587:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074203.640591:0:94279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28f000/0x5fb609b3016e070e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074203.640627:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+10:3658:x1869685723622528:12345-0@lo:103:ldlm_bl.0 Request processed in 663us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074203.640633:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1783074203.640700:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723622528:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783074203.645819:0:94270:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:0.0:1783074203.646117:0:94270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783074203.646194:0:94300:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:2.0:1783074203.646199:0:94300:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:2.0:1783074203.646679:0:94301:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783074203.646698:0:94270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1783074203.647175:0:94302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94302:1869685723622656:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783074203.647184:0:94301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783074203.647251:0:94302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.647353:0:94302:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c88cbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074203.647420:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622656 00000100:00100000:1.0:1783074203.647427:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622656 00000100:00100000:1.0:1783074203.647475:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1783074203.647484:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94302:x1869685723622656:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074203.647563:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94302:x1869685723622656:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.647570:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:3.0:1783074203.647654:0:94302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94302:1869685723622656:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783074203.647688:0:94302:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783074203.647717:0:94302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94302:1869685723622784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074203.647754:0:94302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.647818:0:94302:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2ad19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074203.647857:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622784 00000100:00100000:1.0:1783074203.647862:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622784 00000040:01000000:0.0:1783074203.647879:0:94270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:1.0:1783074203.647914:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000040:00080000:0.0:1783074203.647916:0:94270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783074203.647924:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94302:x1869685723622784:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783074203.648011:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94302:x1869685723622784:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074203.648018:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:3.0:1783074203.648063:0:94302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94302:1869685723622784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074203.648106:0:94302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94302:1869685723622912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074203.648127:0:94302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074203.648152:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723622912 00000100:00100000:3.0:1783074203.648155:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723622912 00000100:00100000:3.0:1783074203.648175:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1783074203.648181:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94302:x1869685723622912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783074203.648228:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94302:x1869685723622912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074203.648235:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1783074203.648252:0:94302:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2ad19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074203.648270:0:94302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94302:1869685723622912:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783074203.648333:0:94302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783074203.652903:0:94270:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783074203.652924:0:94270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783074203.653015:0:94270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074203.662468:0:94301:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783074203.662580:0:94301:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783074203.662634:0:94270:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783074203.663365:0:94270:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783074203.663396:0:94270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783074203.663497:0:94270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783074203.663585:0:94302:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783074203.663636:0:94302:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783074203.663639:0:94302:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1783074203.663935:0:94270:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00010000:00080000:2.0:1783074203.665256:0:94270:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084298 00010000:00080000:2.0:1783074203.665939:0:94303:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94303 00010000:02000000:2.0:1783074203.665949:0:94303:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1783074203.665953:0:94303:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783074203.665956:0:94303:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1783074203.666007:0:94270:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783074203.666022:0:94270:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783074203.666039:0:94270:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783074203.666051:0:94270:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783074203.666835:0:94270:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783074203.667075:0:94270:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783074204.078417:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074204.078443:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723623040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074204.078518:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.078569:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623040 00000100:00100000:1.0:1783074204.078576:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623040 00000100:00100000:1.0:1783074204.078630:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:1.0:1783074204.078640:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723623040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074204.078666:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074204.078720:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723623040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.078728:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:0.0:1783074204.078931:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723623040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074204.079952:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723623168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074204.080005:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074204.080050:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623168 00000100:00100000:3.0:1783074204.080057:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623168 00000100:00100000:3.0:1783074204.080114:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1783074204.080125:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723623168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783074204.080152:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074204.080612:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723623168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 489us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.080621:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1783074204.081143:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723623168:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783074204.270458:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783074204.913994:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783074204.914003:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6cae000 from 127 10000000:01000000:1.0:1783074204.914008:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783074204.914060:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.914073:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.914086:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.914112:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.914183:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.914234:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c497bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.914306:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623296 00000100:00100000:2.0:1783074204.914337:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623296 00000100:00100000:2.0:1783074204.914393:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783074204.914402:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:6527:x1869685723623296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.914417:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074204.914431:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0715 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.914459:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 11 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.914471:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 11 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.914482:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6e00, rc 0) 00000100:00100000:2.0:1783074204.914529:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723623296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.914536:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783074204.914546:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.914564:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.914585:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.914630:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.914662:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.915486:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c497bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.916439:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623424 00000100:00100000:2.0:1783074204.916446:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623424 00000100:00100000:2.0:1783074204.916489:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783074204.916498:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723623424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074204.916518:0:94276:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783074204.916535:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074204.916538:0:94276:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:2.0:1783074204.916647:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723623424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.916655:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783074204.916662:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783074204.916718:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783074204.916727:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.916737:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074204.916746:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074204.916748:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 58 10000000:01000000:1.0:1783074204.916750:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074204.916775:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.916784:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.916793:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.916809:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.916850:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.916883:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c497bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.916985:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623552 00000100:00100000:2.0:1783074204.916989:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623552 00000100:00100000:2.0:1783074204.917012:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783074204.917024:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:6527:x1869685723623552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.917034:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074204.917046:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0723 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.917068:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 12 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.917265:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 12 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.917277:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6400, rc 0) 00000100:00100000:2.0:1783074204.917332:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723623552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 307us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.917338:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783074204.917481:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.917493:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.917502:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.917556:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.917581:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.917604:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c497bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.917624:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623680 00000100:00100000:2.0:1783074204.917629:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623680 00000100:00100000:2.0:1783074204.917706:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783074204.917714:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723623680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.917829:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723623680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.917836:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783074204.917904:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.917935:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.917975:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.917991:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623808 00000100:00100000:2.0:1783074204.917996:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623808 00000100:00100000:3.0:1783074204.918018:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.918065:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783074204.918073:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723623808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.918157:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723623808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.918170:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783074204.918244:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074204.919621:0:94451:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1783074204.919714:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1783074204.919740:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074204.919749:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.919759:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074204.919768:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783074204.919770:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 124 10000000:01000000:1.0:1783074204.919772:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783074204.919801:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.919809:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.919830:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.919847:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.919888:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.919919:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c497b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.919976:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723623936 00000100:00100000:2.0:1783074204.919982:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723623936 00000100:00100000:2.0:1783074204.920047:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783074204.920055:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+12:6527:x1869685723623936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.920067:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074204.920080:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0731 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.920103:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 13 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.920114:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 13 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.920123:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6600, rc 0) 00000100:00100000:2.0:1783074204.920161:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723623936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.920167:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783074204.920305:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723623936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074204.920354:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.920365:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074204.920644:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.920675:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074204.920722:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8780 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.921331:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624064 00000100:00100000:2.0:1783074204.921336:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624064 00000100:00100000:2.0:1783074204.921381:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783074204.921396:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723624064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074204.921410:0:94276:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783074204.921425:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074204.921429:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783074204.921432:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783074204.921435:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783074204.921441:0:94276:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:2.0:1783074204.921516:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723624064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.921524:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783074204.921556:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783074204.921630:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783074204.921637:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.921646:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074204.921654:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783074204.921656:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1783074204.921659:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074204.921677:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.921685:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.921693:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.921705:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.921732:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.921750:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624192 00000100:00100000:2.0:1783074204.921753:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624192 00000100:00100000:1.0:1783074204.923964:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783074204.923983:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+13:6527:x1869685723624192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.923999:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074204.924017:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e073f expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.924044:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e073f expref: 14 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.924056:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e073f expref: 14 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.924067:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9200, rc 0) 00000100:00100000:1.0:1783074204.924113:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723624192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.924120:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783074204.924233:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.924267:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.924288:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.924297:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.924401:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.924430:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.924804:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074204.926453:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624320 00000100:00100000:3.0:1783074204.926463:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624320 00000100:00100000:3.0:1783074204.926518:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783074204.926527:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723624320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.926727:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723624320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.926743:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783074204.926782:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.926823:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.926863:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.926891:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074204.926901:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624448 00000100:00100000:3.0:1783074204.926907:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624448 00000100:00100000:3.0:1783074204.926937:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783074204.926944:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723624448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.927172:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723624448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.927180:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783074204.927213:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783074204.928440:0:94452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:3.0:1783074204.928529:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:3.0:1783074204.928556:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783074204.928567:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.928578:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074204.928587:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1783074204.928589:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9523c6b72800 from 1 10000000:01000000:3.0:1783074204.928592:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783074204.928624:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.928634:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.928644:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074204.928661:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.928712:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.928752:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624576 00000100:00100000:3.0:1783074204.928758:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.928759:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624576 00000100:00100000:1.0:1783074204.928806:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783074204.928814:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+14:6527:x1869685723624576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.928825:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074204.928837:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df2c8200/0x5fb609b3016e0754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e074d expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.928860:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df2c8200/0x5fb609b3016e0754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e074d expref: 15 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.928871:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df2c8200/0x5fb609b3016e0754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e074d expref: 15 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.928881:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c8200, rc 0) 00000100:00100000:1.0:1783074204.928918:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723624576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.928926:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783074204.928937:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074204.928953:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0754 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.928963:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0754 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074204.928977:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783074204.928982:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0754 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.928990:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670600/0x5fb609b3016e074d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0754 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074204.928998:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783074204.928999:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c6b72800 from 7 10000000:01000000:3.0:1783074204.929001:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783074204.929017:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.929023:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.929030:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074204.929041:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.929143:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074204.929177:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.929177:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624704 00000100:00100000:1.0:1783074204.929183:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624704 00000100:00100000:1.0:1783074204.929210:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783074204.929217:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723624704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.929224:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074204.929232:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df2c8400/0x5fb609b3016e0762 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e075b expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.929245:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df2c8400/0x5fb609b3016e0762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e075b expref: 16 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.929265:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df2c8400/0x5fb609b3016e0762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e075b expref: 16 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.929282:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c8400, rc 0) 00000100:00100000:1.0:1783074204.929334:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723624704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.929340:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783074204.929403:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074204.929414:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0762 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.929422:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0762 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074204.929473:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.929498:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074204.929524:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.929900:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624832 00000100:00100000:1.0:1783074204.929905:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624832 00000100:00100000:1.0:1783074204.929929:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783074204.929935:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723624832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.930029:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723624832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.930036:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.930038:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783074204.930066:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.930145:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074204.930162:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.930164:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723624960 00000100:00100000:1.0:1783074204.930169:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723624960 00000100:00100000:1.0:1783074204.930192:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783074204.930200:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723624960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.930285:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723624960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.930292:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783074204.930365:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723624960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074204.931034:0:94453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783074204.931169:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783074204.931194:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783074204.931203:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0762 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.931212:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0762 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074204.931231:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074204.931233:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 58 10000000:01000000:1.0:1783074204.931235:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074204.933885:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.933902:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.933915:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.933939:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.933998:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.934039:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074204.934216:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625088 00000100:00100000:3.0:1783074204.934222:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625088 00000100:00100000:3.0:1783074204.934293:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783074204.934304:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723625088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074204.934338:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074204.934355:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0769 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.934398:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 17 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.934411:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 17 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074204.934422:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00000100:00100000:3.0:1783074204.934487:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723625088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.934496:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783074204.934539:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.934553:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.934563:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.934621:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.934645:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.934673:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074204.934742:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625216 00000100:00100000:3.0:1783074204.934747:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625216 00000100:00100000:3.0:1783074204.934783:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783074204.934790:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723625216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.934977:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723625216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.934983:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783074204.935757:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.935791:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.935835:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.935868:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.936398:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625344 00000100:00100000:0.0:1783074204.936404:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625344 00000100:00100000:0.0:1783074204.936915:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783074204.936925:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723625344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.937031:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723625344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.937039:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783074204.937107:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074204.937757:0:94454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1783074204.937812:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1783074204.937834:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074204.937843:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.937854:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074204.937863:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783074204.937866:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783074204.937870:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074204.937896:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.937910:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.937918:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.937933:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.937965:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.938148:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.938205:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625472 00000100:00100000:1.0:1783074204.938210:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625472 00000100:00100000:1.0:1783074204.938241:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783074204.938248:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723625472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074204.938269:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074204.938283:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0777 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.939356:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 18 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.939376:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 18 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.939386:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c8800, rc 0) 00000100:00100000:1.0:1783074204.939472:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723625472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1223us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.939481:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783074204.939586:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.939603:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.939613:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.939668:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.939697:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.939753:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.939781:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625600 00000100:00100000:1.0:1783074204.939786:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625600 00000100:00100000:1.0:1783074204.939842:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783074204.939850:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723625600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.939973:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723625600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.939980:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783074204.940027:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.940054:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.940090:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.940177:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30000 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.940207:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625728 00000100:00100000:2.0:1783074204.940211:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625728 00000100:00100000:2.0:1783074204.940230:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783074204.940235:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723625728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.942144:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723625728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1902us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.942155:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783074204.944303:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074204.945139:0:94458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783074204.945195:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783074204.945215:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783074204.945227:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945239:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074204.945248:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783074204.945264:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f49f9000 from 7 10000000:01000000:0.0:1783074204.945267:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783074204.945308:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945341:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945351:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.945373:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.945427:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.945520:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.945541:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625856 00000100:00100000:0.0:1783074204.945546:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625856 00000100:00100000:0.0:1783074204.945586:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783074204.945595:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723625856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.945610:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074204.945622:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28fe00/0x5fb609b3016e078c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0785 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945645:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28fe00/0x5fb609b3016e078c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0785 expref: 19 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945657:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28fe00/0x5fb609b3016e078c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0785 expref: 19 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945667:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28fe00, rc 0) 00000100:00100000:0.0:1783074204.945699:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723625856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.945705:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783074204.945749:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.945762:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e078c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.945772:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e078c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.945816:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.945843:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.945859:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.945938:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723625984 00000100:00100000:0.0:1783074204.945941:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723625984 00000100:00100000:0.0:1783074204.945962:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783074204.945968:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723625984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.946065:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723625984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.946072:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783074204.946102:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723625984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.946128:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.946162:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.946173:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.946183:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626112 00000100:00100000:0.0:1783074204.946187:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626112 00000100:00100000:0.0:1783074204.946205:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783074204.946210:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723626112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.946289:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723626112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.946301:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783074204.946360:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074204.946974:0:94461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074204.947015:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074204.947032:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074204.947038:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e078c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947046:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e078c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074204.947054:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074204.947057:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 58 10000000:01000000:0.0:1783074204.947059:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074204.947077:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947085:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947092:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.947105:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.947139:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.947165:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4947b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.947176:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626240 00000100:00100000:0.0:1783074204.947179:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626240 00000100:00100000:0.0:1783074204.947207:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783074204.947213:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723626240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.947220:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074204.947230:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0793 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947246:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 20 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947269:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 20 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947277:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28ec00, rc 0) 00000100:00100000:0.0:1783074204.947307:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723626240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.947333:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783074204.947374:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.947388:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.947396:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.947435:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.947460:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.947478:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4947b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.947489:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626368 00000100:00100000:0.0:1783074204.947491:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626368 00000100:00100000:0.0:1783074204.947521:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783074204.947529:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723626368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.947605:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723626368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.947612:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783074204.947637:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.947660:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.947692:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.947704:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4947b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.947715:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626496 00000100:00100000:0.0:1783074204.947718:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626496 00000100:00100000:0.0:1783074204.947746:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783074204.947753:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723626496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.947818:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723626496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.947825:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783074204.947859:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074204.950859:0:94462:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1783074204.951006:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1783074204.951030:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074204.951040:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.951050:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074204.951058:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783074204.951060:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783074204.951063:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074204.951094:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.951103:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074204.951113:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074204.951132:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.951182:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.951248:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.951290:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626624 00000100:00100000:0.0:1783074204.951296:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626624 00000100:00100000:0.0:1783074204.951421:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783074204.951431:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723626624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.951445:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074204.951519:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e07a1 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.951555:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 21 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.951566:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 21 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.951575:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28ea00, rc 0) 00000100:00100000:0.0:1783074204.951659:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723626624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.951667:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783074204.951737:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.951750:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.951760:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.951876:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.951903:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.951957:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.953199:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626752 00000100:00100000:0.0:1783074204.953206:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626752 00000100:00100000:0.0:1783074204.953295:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783074204.953305:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723626752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.953460:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723626752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.953469:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783074204.953487:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.953525:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.953565:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074204.953655:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723626880 00000100:00100000:1.0:1783074204.953660:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723626880 00000100:00100000:3.0:1783074204.953667:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c20f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074204.953696:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783074204.953704:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723626880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074204.954353:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723626880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 649us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074204.954362:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783074204.954833:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723626880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074204.955676:0:94465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783074204.957333:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783074204.957357:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783074204.957368:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.957380:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074204.957390:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783074204.957394:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9524f4a91000 from 7 10000000:01000000:2.0:1783074204.957397:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783074204.957430:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.957438:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.957449:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.957493:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.957543:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.957580:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.957729:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627008 00000100:00100000:0.0:1783074204.957735:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627008 00000100:00100000:0.0:1783074204.957785:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783074204.957794:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723627008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.957808:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074204.957820:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524df28e200/0x5fb609b3016e07b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e07af expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.957845:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524df28e200/0x5fb609b3016e07b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e07af expref: 22 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.957863:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524df28e200/0x5fb609b3016e07b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e07af expref: 22 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.957872:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df28e200, rc 0) 00000100:00100000:0.0:1783074204.957918:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723627008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.957925:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783074204.958299:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.958342:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.958352:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074204.958407:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.958437:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.958455:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074204.958884:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627136 00000100:00100000:0.0:1783074204.958890:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627136 00000100:00100000:0.0:1783074204.958926:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783074204.958934:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723627136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.959041:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723627136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074204.959049:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783074204.959568:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.959600:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.959640:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.959669:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb52a540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074204.960189:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627264 00000100:00100000:3.0:1783074204.960195:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627264 00000100:00100000:3.0:1783074204.960237:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783074204.960396:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723627264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074204.960517:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723627264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074204.960525:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783074204.960549:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074204.963208:0:94469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783074204.963350:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783074204.963387:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783074204.963399:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.963411:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074204.963421:0:6527:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783074204.963424:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074204.963427:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783074204.963467:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.963488:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.963501:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.963524:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.963589:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074204.963633:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627392 00000100:00100000:0.0:1783074204.963638:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3318840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.963641:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627392 00000100:00100000:2.0:1783074204.963684:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783074204.963693:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723627392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.963705:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074204.963724:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e07c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e07bd expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.963746:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e07c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e07bd expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.963754:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7e00/0x5fb609b3016e07c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e07bd expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.963762:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7e00, rc 0) 00000100:00100000:2.0:1783074204.963806:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723627392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.963813:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783074204.963911:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.963924:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.963935:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e07c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074204.963951:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783074204.963955:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.963972:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28e600/0x5fb609b3016e07bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074204.963979:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783074204.963981:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:0.0:1783074204.963984:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783074204.963999:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.964016:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.964024:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.964038:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.964062:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.964085:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3318840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.964143:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627520 00000100:00100000:2.0:1783074204.964147:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627520 00000100:00100000:2.0:1783074204.964180:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783074204.964187:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723627520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074204.964194:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074204.964204:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e07cb expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.964219:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.964229:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074204.964236:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6a00, rc 0) 00000100:00100000:2.0:1783074204.964283:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723627520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074204.964298:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783074204.964351:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074204.964361:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.964540:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074204.964592:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074204.964618:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074204.964642:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3318840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074204.964657:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627648 00000100:00100000:2.0:1783074204.964663:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627648 00000100:00100000:2.0:1783074204.964695:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783074204.964703:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723627648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074204.964783:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723627648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (164us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074204.964791:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783074204.964821:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523caed2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723627648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783074204.964846:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783074204.964851:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074204.964859:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074205.294825:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074205.498893:0:94553:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1783074205.891619:0:94605:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783074205.891846:0:94605:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1783074206.243616:0:94655:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783074206.243832:0:94655:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783074206.319456:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074206.703104:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074206.703149:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074206.703285:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708097920 00000100:00100000:0.0:1783074206.703300:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708097920 00000100:00100000:0.0:1783074206.703398:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1348 00000100:00100000:0.0:1783074206.703408:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1869685708097920:12345-192.168.204.26@tcp:38:kworker.0 00000100:00100000:1.0:1783074206.703438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00080000:0.0:1783074206.703442:0:66201:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b' at ffff9524fc200000, cookie 0x5fb609b3016e0666 00010000:00080000:0.0:1783074206.703452:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp recovering/t120259084299 exp ffff9524fc200000 cur 3045 last 1783074203 00010000:02000400:0.0:1783074206.703461:0:66201:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1783074206.703468:0:66201:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:1.0:1783074206.703487:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098048 00000100:00100000:1.0:1783074206.703492:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098048 00000004:00100000:0.0:1783074206.703499:0:66201:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1783074206.703535:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 880 00000100:00100000:1.0:1783074206.703543:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2405:x1869685708098048:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074206.703618:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2405:x1869685708098048:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074206.703626:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 880 00000100:00080000:0.0:1783074206.703674:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524df207000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074206.703713:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708097920:12345-192.168.204.26@tcp:38:kworker.0 Request processed in 305us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074206.703720:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1348 00000100:00080000:1.0:1783074206.703752:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074206.703938:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098176 00000100:00100000:3.0:1783074206.703942:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098176 00000100:00100000:2.0:1783074206.704049:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074206.704121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074206.704164:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098432 00000100:00100000:0.0:1783074206.704169:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098432 00000100:00100000:0.0:1783074206.704188:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:0.0:1783074206.704192:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1869685708098432:12345-192.168.204.26@tcp:250:kworker.0 00010000:00080000:0.0:1783074206.704204:0:94276:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp t0 exp 0000000000000000 cur 3045 last 0 00000100:00080000:2.0:1783074206.704235:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1783074206.704242:0:94276:0:(genops.c:1406:class_connect()) connect: client f1623620-a4b0-4769-84e0-0d08c968afe8, cookie 0x5fb609b3016e07d9 00000100:00100000:1.0:1783074206.704371:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098304 00000100:00100000:1.0:1783074206.704376:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098304 00000100:00080000:0.0:1783074206.704440:0:94276:0:(import.c:65:import_set_state_nolock()) ffff9524df200800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074206.704453:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4938 00000100:00100000:1.0:1783074206.704462:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2401:x1869685708098176:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:1.0:1783074206.704484:0:26169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016dfc87 00000100:00100000:0.0:1783074206.704486:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+5:2401:x1869685708098432:12345-192.168.204.26@tcp:250:kworker.0 Request processed in 290us (362us total) trans 0 rc 0/0 00000100:00080000:1.0:1783074206.704491:0:26169:0:(import.c:65:import_set_state_nolock()) ffff9524fb54e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783074206.704497:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000001:00000004:1.0:1783074206.704551:0:26169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968718 00000100:00100000:0.0:1783074206.704624:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4939 00000100:00100000:0.0:1783074206.704650:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2401:x1869685708098304:12345-192.168.204.26@tcp:9:kworker.0 00000100:00100000:1.0:1783074206.704671:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+2:2401:x1869685708098176:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 209us (1519us total) trans 0 rc 0/0 00000020:00000080:0.0:1783074206.704678:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016e04bb 00000100:00100000:1.0:1783074206.704681:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4938 00000100:00080000:0.0:1783074206.704687:0:26167:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783074206.704720:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968715 00000100:00100000:0.0:1783074206.704810:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+2:2401:x1869685708098304:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 178us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074206.704818:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4939 00010000:00010000:3.0:1783074206.704830:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074206.704868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074206.704961:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708091904 00000100:00100000:3.0:1783074206.704965:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708091904 00000100:00080000:2.0:1783074206.704997:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783074206.705057:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074206.705182:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1349 00000100:00100000:3.0:1783074206.705191:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c4b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708091904:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00080000:3.0:1783074206.705203:0:66202:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084299, current: 120259084299, replaying 00000100:00100000:3.0:1783074206.705233:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c4b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708091904:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 44us (364us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074206.705239:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1349 00010000:00080000:0.0:1783074206.705361:0:94303:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1783074207.343334:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.367384:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074208.622855:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.623082:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098688 00000100:00100000:2.0:1783074208.623092:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098688 00000100:00100000:2.0:1783074208.623140:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:2.0:1783074208.623150:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+5:70871:x1869685708098688:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074208.623167:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074208.623198:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b30d expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.623230:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 6 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.623242:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 6 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.623252:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6000, rc 0) 00000100:00100000:2.0:1783074208.623354:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708098688:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 205us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.623361:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1783074208.626146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.628258:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098816 00000100:00100000:2.0:1783074208.628269:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098816 00000100:00100000:2.0:1783074208.628352:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1783074208.628363:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708098816:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783074208.628391:0:94276:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1783074208.628412:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074208.628415:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783074208.628418:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783074208.628420:0:94276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783074208.628422:0:94276:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:2.0:1783074208.632253:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708098816:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 3886us (6107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.632264:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1783074208.634453:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.634505:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098944 00000100:00100000:2.0:1783074208.634513:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098944 00000100:00100000:2.0:1783074208.634554:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:2.0:1783074208.634564:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+6:70871:x1869685708098944:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074208.634582:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074208.634600:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b314 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.634635:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 7 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.634647:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 7 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.634668:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7000, rc 0) 00000100:00100000:2.0:1783074208.634707:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+7:70871:x1869685708098944:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 145us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.634712:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1783074208.635658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.635701:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099072 00000100:00100000:2.0:1783074208.635705:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099072 00000100:00100000:2.0:1783074208.635729:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:2.0:1783074208.635734:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+7:70871:x1869685708099072:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074208.635829:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708099072:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 95us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.635836:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:3.0:1783074208.637272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.637343:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099200 00000100:00100000:2.0:1783074208.637349:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099200 00000100:00100000:2.0:1783074208.637385:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:2.0:1783074208.637392:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708099200:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074208.637493:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708099200:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.637500:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1783074208.641197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.641253:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099328 00000100:00100000:2.0:1783074208.641261:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099328 00000100:00100000:2.0:1783074208.641303:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1783074208.641329:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708099328:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074208.641344:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074208.641363:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc6200/0x5fb609b3016e07ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b31b expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.641406:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc6200/0x5fb609b3016e07ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b31b expref: 9 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.641415:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc6200/0x5fb609b3016e07ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b31b expref: 9 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.641423:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6200, rc 0) 00000100:00100000:2.0:1783074208.641469:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708099328:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.641476:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1783074208.642345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.642415:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099456 00000100:00100000:2.0:1783074208.642427:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099456 00000100:00100000:2.0:1783074208.642491:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:2.0:1783074208.642499:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708099456:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074208.642630:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708099456:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 130us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.642638:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:3.0:1783074208.643538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.643628:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099584 00000100:00100000:2.0:1783074208.643632:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099584 00000100:00100000:2.0:1783074208.643670:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:2.0:1783074208.643678:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708099584:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074208.643771:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708099584:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.643779:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:1.0:1783074208.646207:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.646274:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099712 00000100:00100000:2.0:1783074208.646291:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099712 00000100:00100000:2.0:1783074208.646378:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1783074208.646387:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708099712:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074208.646402:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074208.646419:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b322 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.646449:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 10 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.646462:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 10 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.646472:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7600, rc 0) 00000100:00100000:2.0:1783074208.646523:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708099712:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.646529:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:0.0:1783074208.647400:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.647460:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099840 00000100:00100000:2.0:1783074208.647464:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099840 00000100:00100000:2.0:1783074208.647490:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:2.0:1783074208.647495:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708099840:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074208.647557:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708099840:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 61us (158us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074208.647561:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00080000:3.0:1783074208.686510:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074208.686517:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074208.686522:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074208.686535:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9523c1704000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074208.686560:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c4b16a00 x1869685723628032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074208.686573:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723627904:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783074208.686590:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074208.686593:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1783074208.686603:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723628160:0@lo:400:kworker.0 00000100:00080000:3.0:1783074208.686610:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074208.686618:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9523c2e07000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074208.686635:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c4b15880 x1869685723628288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783074208.686656:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783074208.686656:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074208.686662:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074208.686665:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783074208.686666:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074208.686672:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9524f0d24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1783074208.686685:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723628032:0@lo:38:kworker.0 00000100:00100000:3.0:1783074208.686689:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c4b17b80 x1869685723628544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074208.686724:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723627776:0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.686726:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628160 00000100:00080000:3.0:1783074208.686731:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783074208.686733:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074208.686738:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074208.686741:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783074208.686741:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628160 00000100:00080000:3.0:1783074208.686750:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9523c4d13000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074208.686767:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6ceb800 x1869685723628928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074208.686777:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723628288:0@lo:38:kworker.0 00000100:00100000:0.0:1783074208.686779:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074208.686798:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628032 00000100:00080000:3.0:1783074208.686799:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1783074208.686804:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628032 00000100:00080000:3.0:1783074208.686805:0:85943:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783074208.686809:0:85943:0:(import.c:65:import_set_state_nolock()) ffff9524de7c4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074208.686814:0:85943:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9524de7c4800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1783074208.686828:0:85943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524c6ceb100 x1869685723629312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074208.686832:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1783074208.686847:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723628160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074208.686871:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723628416:0@lo:400:kworker.0 00000100:00100000:1.0:1783074208.687607:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.687610:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723628672:0@lo:400:kworker.0 00000100:00100000:3.0:1783074208.687626:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627904 00000100:00100000:3.0:1783074208.687635:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627904 00000100:00100000:2.0:1783074208.687639:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723628160:12345-0@lo:400:kworker.0 Request processed in 793us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.687650:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1783074208.687655:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c4b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723628544:0@lo:38:kworker.0 00000100:00100000:0.0:1783074208.687665:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074208.687671:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:2.0:1783074208.687673:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628288 00000100:00100000:2.0:1783074208.687679:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628288 00000100:00100000:3.0:1783074208.687683:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723627904:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783074208.687697:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074208.687701:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1783074208.687708:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723628032:12345-0@lo:38:kworker.0 00000004:00000024:3.0:1783074208.687714:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:0.0:1783074208.687721:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628672 00000100:00100000:1.0:1783074208.687724:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723628928:0@lo:38:kworker.0 00000100:00100000:0.0:1783074208.687728:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628672 00010000:00080000:2.0:1783074208.687733:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3047 last 0 00000100:00100000:1.0:1783074208.687761:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783074208.687775:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016e07fc 00000100:00100000:0.0:1783074208.687780:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1783074208.687792:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723628672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074208.687794:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723627904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.687799:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723629312:0@lo:38:kworker.0 00000004:00100000:2.0:1783074208.687800:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783074208.687806:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:3.0:1783074208.687831:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628544 00000100:00100000:3.0:1783074208.687836:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628544 00000100:00100000:1.0:1783074208.687845:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.687856:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723628672:12345-0@lo:400:kworker.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.687863:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:0.0:1783074208.687868:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1783074208.687872:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1869685723628544:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783074208.687886:0:23954:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9524fc207800, cookie 0x5fb609b3016e065f 00010000:00080000:3.0:1783074208.687890:0:23954:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084297 exp ffff9524fc207800 cur 3047 last 1783074203 00000100:00100000:1.0:1783074208.687896:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628928 00000100:00100000:1.0:1783074208.687902:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628928 00000100:00100000:0.0:1783074208.687902:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723627776 00000004:00100000:3.0:1783074208.687903:0:23954:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783074208.687909:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723627776 00000100:00100000:1.0:1783074208.687927:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629312 00000100:00100000:1.0:1783074208.687932:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629312 00000100:00080000:3.0:1783074208.687933:0:23954:0:(import.c:65:import_set_state_nolock()) ffff9523c316e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074208.687952:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783074208.687957:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1783074208.687962:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723627776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074208.687967:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723628288:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783074208.687988:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3047 last 0 00000100:00100000:3.0:1783074208.687990:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723628544:12345-0@lo:38:kworker.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.687999:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00080000:2.0:1783074208.688004:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524c2b7b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783074208.688015:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723627776:12345-0@lo:400:kworker.0 Request processed in 53us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.688022:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000020:00000080:1.0:1783074208.688024:0:67186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb609b3016e0803 00000100:00100000:0.0:1783074208.688026:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783074208.688032:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723628928:12345-0@lo:38:kworker.0 00000004:00100000:1.0:1783074208.688035:0:67186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783074208.688050:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723628032:12345-0@lo:38:kworker.0 Request processed in 339us (1319us total) trans 0 rc 0/0 00010000:00080000:3.0:1783074208.688051:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3047 last 0 00000100:00080000:1.0:1783074208.688061:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9524fb6b6000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1783074208.688064:0:94303:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1783074208.688066:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00010000:00080000:0.0:1783074208.688074:0:94303:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 120259084299 00000020:00080000:0.0:1783074208.688082:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.688086:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00000020:00000080:3.0:1783074208.688087:0:66202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb609b3016e080a 00000100:00100000:2.0:1783074208.688090:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00010000:00080000:0.0:1783074208.688096:0:94303:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084299) 00000004:00100000:3.0:1783074208.688098:0:66202:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783074208.688101:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869685723629312:12345-0@lo:38:kworker.0 00000020:00080000:0.0:1783074208.688103:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1783074208.688108:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869685723628288:12345-0@lo:38:kworker.0 Request processed in 139us (500us total) trans 0 rc 0/0 00010000:00080000:0.0:1783074208.688119:0:94303:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708091904 t120259084299 from 192.168.204.26@tcp req@ffff9524c4b17480 x1869685708091904/t0(120259084299) o36->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:532/0 lens 528/0 e 0 to 0 dl 1783074217 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074208.688122:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00010000:00080000:2.0:1783074208.688124:0:66201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3047 last 0 00000100:00080000:3.0:1783074208.688125:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9523c316c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074208.688156:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783074208.688163:0:66201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb609b3016e0811 00000100:00100000:3.0:1783074208.688173:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869685723628928:12345-0@lo:38:kworker.0 Request processed in 141us (411us total) trans 0 rc 0/0 00000004:00100000:2.0:1783074208.688195:0:66201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783074208.688203:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1783074208.688211:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723629184:0@lo:400:kworker.0 00000100:00100000:0.0:1783074208.688220:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723628800:0@lo:400:kworker.0 00000100:00100000:3.0:1783074208.688221:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628416 00000100:00080000:2.0:1783074208.688222:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524fc3c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074208.688228:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628416 00000100:00100000:3.0:1783074208.688262:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1783074208.688269:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074208.688273:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723628416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.688275:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869685723629312:12345-0@lo:38:kworker.0 Request processed in 174us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.688291:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1783074208.688335:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074208.688347:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723628800 00000100:00100000:2.0:1783074208.688352:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723628800 00000100:00100000:0.0:1783074208.688359:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723627904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074208.688365:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723628416:12345-0@lo:400:kworker.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.688374:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1783074208.688386:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629184 00000100:00100000:0.0:1783074208.688387:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783074208.688390:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723628416:0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.688391:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629184 00000100:00100000:0.0:1783074208.688409:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723629056:0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.688423:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:3.0:1783074208.688429:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723628160:0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.688435:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523caed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723628800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074208.688445:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074208.688456:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723627776:0@lo:400:kworker.0 00000100:00100000:3.0:1783074208.688470:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084298 gen 3 00000004:00080000:3.0:1783074208.688476:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084297 committed transno 120259084298 00000100:00100000:2.0:1783074208.688489:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523caed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723628800:12345-0@lo:400:kworker.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.688491:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723628672:0@lo:400:kworker.0 00000004:00080000:3.0:1783074208.688495:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084298 committed transno 120259084298 00000100:00100000:0.0:1783074208.688501:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723628800:0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.688506:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00080000:3.0:1783074208.688519:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00100000:2.0:1783074208.688526:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629056 00000100:00080000:3.0:1783074208.688531:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00100000:2.0:1783074208.688531:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629056 00000100:00080000:3.0:1783074208.688538:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1783074208.688542:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084298 gen 3 00000100:00080000:3.0:1783074208.688545:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9524f0d24800 from lustre-MDT0000_UUID committed 120259084298 last 0 00000100:00080000:3.0:1783074208.688548:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1783074208.688566:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1783074208.688573:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:2.0:1783074208.688576:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723629184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074208.688586:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723629056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074208.688620:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723629184:12345-0@lo:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.688628:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1783074208.688646:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723629056:12345-0@lo:400:kworker.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074208.688655:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00080000:2.0:1783074208.688670:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074208.688674:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074208.688677:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074208.688690:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723628544:0@lo:38:kworker.0 00000100:00100000:0.0:1783074208.688693:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723629056:0@lo:400:kworker.0 00010000:00080000:3.0:1783074208.688724:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524c6ceb800 x1869685723628928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074208.688726:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723629184:0@lo:400:kworker.0 00000100:00080000:3.0:1783074208.688742:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00010000:00080000:2.0:1783074208.688768:0:94669:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1783074208.688773:0:94669:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1783074208.688780:0:94669:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:0.0:1783074208.689985:0:94303:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1788us 00010000:00010000:2.0:1783074208.690127:0:94669:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016dff66 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783074208.690160:0:94669:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:3.0:1783074208.690799:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9524c6ceb800 x1869685723628928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074233 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.690810:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783074208.690821:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c4d13000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783074208.690826:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783074208.690832:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869685723628928:0@lo:38:kworker.0 00010000:00080000:3.0:1783074208.690867:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524c6ceb100 x1869685723629312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.690881:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:3.0:1783074208.690888:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783074208.690893:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783074208.690895:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524de7c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783074208.690906:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869685723629312:0@lo:38:kworker.0 00010000:00080000:3.0:1783074208.690920:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524c4b16a00 x1869685723628032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.690930:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00080000:3.0:1783074208.691775:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9524c4b16a00 x1869685723628032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074233 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.691785:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783074208.691789:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783074208.691793:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783074208.691798:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723628032:0@lo:38:kworker.0 00010000:00080000:3.0:1783074208.691818:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524c4b15880 x1869685723628288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.691831:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:3.0:1783074208.692699:0:3657:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9524c4b15880 x1869685723628288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074233 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.692722:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783074208.692725:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c2e07000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783074208.692729:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783074208.692734:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869685723628288:0@lo:38:kworker.0 00000100:00100000:3.0:1783074208.692787:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723629440:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1783074208.692849:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.692921:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629440 00000100:00100000:0.0:1783074208.692930:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629440 00000100:00100000:0.0:1783074208.692974:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:0.0:1783074208.692986:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723629440:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1783074208.693015:0:8454:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524c6ceb100 x1869685723629440/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:534/0 lens 328/0 e 0 to 0 dl 1783074219 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074208.693024:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1869685723629440:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 42us (176us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074208.693030:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00010000:00010000:0.0:1783074208.699050:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699076:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699101:0:94303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699115:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699123:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699129:0:94303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699708:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699717:0:94303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699724:0:94303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699731:0:94303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fa00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074208.699736:0:94303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699744:0:94303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699758:0:94303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4400) 00010000:00010000:0.0:1783074208.699761:0:94303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074208.699766:0:94303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699779:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28fa00/0x5fb609b3016e0818 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074208.699801:0:94303:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008633e908 reply state 000000006c2b8900 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699819:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.699825:0:94303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d2de4a00) 00010000:00010000:0.0:1783074208.699827:0:94303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074208.699831:0:94303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074208.699941:0:94303:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1783074208.699963:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.699967:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000020:00080000:0.0:1783074208.699971:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.699973:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000001:00080000:2.0:1783074208.700974:0:94271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084299 is committed 00010000:00010000:3.0:1783074208.701056:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.701064:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.701069:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.701073:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074208.701076:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.701080:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.701089:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d2de4a00) 00010000:00010000:3.0:1783074208.701091:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074208.701093:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.701096:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f600/0x5fb609b3016e081f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074208.702504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.702537:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708092416 00000100:00100000:2.0:1783074208.702547:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708092416 00000100:00100000:2.0:1783074208.702602:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1354 00000100:00100000:2.0:1783074208.702615:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708092416:12345-192.168.204.26@tcp:36:rm.0 00010000:00080000:2.0:1783074208.702637:0:66201:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:2.0:1783074208.702658:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708092416:12345-192.168.204.26@tcp:36:rm.0 Request processed in 47us (159us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074208.702664:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1354 00000020:00080000:0.0:1783074208.702708:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.702712:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:0.0:1783074208.702716:0:94303:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:0.0:1783074208.702719:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.702728:0:94303:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708092416 t120259084300 from 192.168.204.26@tcp req@ffff9524fc258a80 x1869685708092416/t0(120259084300) o36->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:534/0 lens 512/0 e 0 to 0 dl 1783074219 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074208.702957:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.702973:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.702993:0:94303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703011:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703018:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703024:0:94303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703095:0:94303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703103:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703110:0:94303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703358:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703366:0:94303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703373:0:94303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703378:0:94303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074208.703382:0:94303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703396:0:94303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703409:0:94303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9524d2de4800) 00010000:00010000:0.0:1783074208.703412:0:94303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783074208.703416:0:94303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703422:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0834 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703443:0:94303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703448:0:94303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703453:0:94303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703458:0:94303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074208.703461:0:94303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703467:0:94303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703475:0:94303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4d00) 00010000:00010000:0.0:1783074208.703477:0:94303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074208.703480:0:94303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703495:0:94303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28f000/0x5fb609b3016e0826 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074208.703508:0:94303:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075bb2ce6 reply state 000000005a2bce87 transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703518:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.703524:0:94303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff9524d2de4f00) 00010000:00010000:0.0:1783074208.703526:0:94303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074208.703529:0:94303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783074208.703588:0:94303:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783074208.703605:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.703608:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:0.0:1783074208.703612:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.703614:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000100:00100000:1.0:1783074208.707159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074208.707235:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708099968 00000100:00100000:2.0:1783074208.707245:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708099968 00000100:00100000:2.0:1783074208.707301:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 883 00000100:00100000:2.0:1783074208.707342:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2401:x1869685708099968:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783074208.707367:0:66200:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9523c2140a80 x1869685708099968/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:534/0 lens 224/0 e 0 to 0 dl 1783074219 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074208.707402:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2401:x1869685708099968:12345-192.168.204.26@tcp:400:ldlm_lock_repla.0 Request processed in 92us (252us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074208.707408:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 883 00000020:00080000:0.0:1783074208.707779:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.707783:0:94303:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:0.0:1783074208.707786:0:94303:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783074208.707788:0:94303:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783074208.707794:0:94303:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783074208.707797:0:94303:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1783074208.707803:0:94303:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9524c6ceb100 x1869685723629440/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:534/0 lens 328/0 e 0 to 0 dl 1783074219 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074208.707817:0:94303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074208.707850:0:94303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299e00/0x5fb609b3016e083b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fb609b3016dff5f expref: -99 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.707891:0:94303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299e00/0x5fb609b3016e083b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016dff5f expref: 7 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.707912:0:94303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299e00/0x5fb609b3016e083b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016dff5f expref: 7 pid: 94303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.707922:0:94303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299e00, rc 0) 00010000:00080000:0.0:1783074208.707985:0:94303:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1783074208.707997:0:94303:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1783074208.708037:0:3657:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9523c3298000/0x5fb609b3016dff5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e083b expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783074208.708046:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1783074208.708082:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723629440:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1783074208.708107:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723629568:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1783074208.708134:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.708236:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629568 00000100:00100000:0.0:1783074208.708241:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629568 00000100:00100000:0.0:1783074208.708274:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:0.0:1783074208.708281:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1869685723629568:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1783074208.708294:0:26189:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524c6cead80 x1869685723629568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:534/0 lens 224/0 e 0 to 0 dl 1783074219 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074208.708334:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1869685723629568:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 52us (196us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074208.708341:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00010000:00080000:2.0:1783074208.708439:0:94303:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1783074208.708544:0:94303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:1.0:1783074208.710340:0:94271:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783074208.710348:0:94271:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00080000:1.0:1783074208.710366:0:94271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00010000:00010000:3.0:1783074208.710427:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.710439:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.710448:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.710455:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28e000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074208.710466:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.710479:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783074208.710481:0:94303:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:3.0:1783074208.710513:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.710520:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df28e000/0x5fb609b3016e082d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783074208.710580:0:94303:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1783074208.710593:0:94303:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.26@tcp: req@ffff9523c2140a80 x1869685708099968/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:534/0 lens 224/0 e 0 to 0 dl 1783074219 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783074208.710716:0:94303:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9524c6cead80 x1869685723629568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:534/0 lens 224/0 e 0 to 0 dl 1783074219 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783074208.710768:0:94303:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1783074208.710811:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1783074208.710820:0:3657:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9524c6ceb800 x1869685723629568/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074224 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.710828:0:3657:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9524c6ceb800 x1869685723629568/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074224 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074208.710833:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524f0d24800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783074208.710847:0:3657:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1783074208.710852:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008cc15b2c): req@ffff9523c557d880 x1869685723613056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074205 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074208.710865:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723629568:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783074208.710926:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723629696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074208.710934:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074208.711002:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723613056 00000100:00100000:3.0:1783074208.711007:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723613056 00000100:00100000:1.0:1783074208.711051:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074208.711056:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:3.0:1783074208.711068:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723613056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783074208.711097:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444663296 avail 1298423808 00000100:00100000:1.0:1783074208.711098:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629696 00000100:00100000:1.0:1783074208.711105:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629696 00000100:00100000:1.0:1783074208.711146:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:3.0:1783074208.711154:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723613056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.711156:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3661:x1869685723629696:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074208.711171:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000004:00000024:1.0:1783074208.711192:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444663296 avail 1298423808 00000100:00100000:3.0:1783074208.711224:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723613056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074208.711242:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723629696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.711249:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1783074208.711293:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723629696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074208.712938:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074208.713041:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708098560 00000100:00100000:3.0:1783074208.713054:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708098560 00000100:00100000:3.0:1783074208.713124:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1355 00000100:00100000:3.0:1783074208.713135:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:72283:x1869685708098560:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074208.713202:0:68632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444663296 avail 1298423808 00000100:00100000:3.0:1783074208.713306:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:72283:x1869685708098560:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 173us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.713357:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1355 00000100:00100000:0.0:1783074208.715340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074208.715414:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100096 00000100:00100000:1.0:1783074208.715424:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100096 00000100:00080000:0.0:1783074208.715491:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074208.715503:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1356 00000100:00100000:1.0:1783074208.715515:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:72283:x1869685708100096:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074208.715551:0:66201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:1.0:1783074208.715621:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:72283:x1869685708100096:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.715629:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1356 00000100:00100000:1.0:1783074208.717766:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074208.717828:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100224 00000100:00100000:3.0:1783074208.717836:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100224 00000100:00100000:3.0:1783074208.717884:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4940 00000100:00100000:3.0:1783074208.717892:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2401:x1869685708100224:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:3.0:1783074208.717926:0:26178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 3047 last 0 00000020:00000080:3.0:1783074208.717958:0:26178:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016e0842 00002000:00100000:3.0:1783074208.717971:0:26178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b/ffff9523c316d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783074208.717990:0:26178:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783074208.718076:0:26178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783074208.718136:0:26178:0:(import.c:65:import_set_state_nolock()) ffff9524c4404800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783074208.718208:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708100224:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 314us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.718216:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4940 00000001:00100000:1.0:1783074208.720112:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:1.0:1783074208.720123:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000020:00000080:1.0:1783074208.720127:0:8438:0:(genops.c:906:class_export_put()) final put ffff9524fb548800/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:1.0:1783074208.720155:0:8438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783074208.720234:0:85943:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb548800/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b for lustre-OST0000 00000020:00000080:3.0:1783074208.720278:0:85943:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb54e000 for lustre-OST0000 00000100:00100000:0.0:1783074208.721127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074208.721210:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100352 00000100:00100000:3.0:1783074208.721226:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100352 00000100:00100000:3.0:1783074208.721344:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1757 00000100:00100000:3.0:1783074208.721355:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:72283:x1869685708100352:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074208.721381:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074208.721449:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:72283:x1869685708100352:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074208.721468:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1757 00000100:00080000:0.0:1783074208.721552:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000080:2.0:1783074208.722810:0:94303:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3bc8083e10 00100000:10000000:2.0:1783074208.722819:0:94303:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1783074208.722847:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074208.722919:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100480 00000100:00100000:1.0:1783074208.722925:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100480 00000100:00100000:1.0:1783074208.722961:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4941 00000100:00100000:1.0:1783074208.722969:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2401:x1869685708100480:12345-192.168.204.26@tcp:8:lfs.0 00010000:00080000:1.0:1783074208.723062:0:26170:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp t0 exp 0000000000000000 cur 3047 last 0 00000020:00000080:1.0:1783074208.723098:0:26170:0:(genops.c:1406:class_connect()) connect: client 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, cookie 0x5fb609b3016e0849 00002000:00100000:1.0:1783074208.723112:0:26170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b/ffff9524fb6b3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783074208.723132:0:26170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783074208.723218:0:26170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783074208.723247:0:26170:0:(import.c:65:import_set_state_nolock()) ffff9523c2c2f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783074208.723295:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708100480:12345-192.168.204.26@tcp:8:lfs.0 Request processed in 325us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.723302:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4941 00000004:00080000:3.0:1783074208.723392:0:94288:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:3.0:1783074208.723429:0:94288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94288:1869685723629824:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783074208.723472:0:94288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074208.723553:0:94288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00000004:00080000:3.0:1783074208.723564:0:94290:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:3.0:1783074208.723579:0:94290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94290:1869685723629952:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783074208.723595:0:94290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074208.723619:0:94290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c67b0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074208.723647:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629824 00000100:00100000:1.0:1783074208.723651:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629824 00000100:00100000:1.0:1783074208.723687:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723629952 00000100:00100000:1.0:1783074208.723690:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723629952 00000100:00100000:1.0:1783074208.723710:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:1.0:1783074208.723716:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:94288:x1869685723629824:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783074208.723737:0:26166:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -94 00002000:02000040:1.0:1783074208.723741:0:26166:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1921) 00000100:00100000:3.0:1783074208.723747:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943 00000100:00100000:3.0:1783074208.723754:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94290:x1869685723629952:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783074208.723767:0:8443:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -95 00002000:02000040:3.0:1783074208.723770:0:8443:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1921) 00002000:00010000:1.0:1783074208.723808:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.723816:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.723833:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.723837:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.723844:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.723860:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.723870:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.723877:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.723895:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074208.723968:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.723973:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.723982:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.723985:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.723989:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724020:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724028:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724035:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724061:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783074208.724104:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.724110:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724117:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.724119:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.724123:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724130:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724137:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724153:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724167:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783074208.724225:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.724231:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724238:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.724241:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.724244:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724244:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074208.724252:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724253:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724262:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724270:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724271:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.724276:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724282:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783074208.724285:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724303:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724327:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000273af7c6/0x5fb609b3016e0850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.724345:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.724350:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724363:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.724366:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.724370:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724380:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724388:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724395:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724402:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783074208.724403:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074208.724406:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724413:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.724416:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724424:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724434:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724448:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000628dd99d/0x5fb609b3016e0857 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.724458:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.724460:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783074208.724462:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724463:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724471:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.724471:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dba00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724474:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.724474:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724478:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724482:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724487:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724492:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724500:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005154db1e/0x5fb609b3016e085e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724504:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724510:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074208.724511:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724512:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724519:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724520:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074208.724526:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724533:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724543:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724550:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e80476c/0x5fb609b3016e0865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.724553:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.724557:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724562:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074208.724565:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724570:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.724572:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724573:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.724575:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724577:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724584:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724588:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724594:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724595:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724602:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055284de8/0x5fb609b3016e086c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724603:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724617:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783074208.724618:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074208.724622:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724642:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.724645:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724652:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.724654:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.724658:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724663:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724665:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.724668:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.724672:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724674:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ada919/0x5fb609b3016e0873 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724681:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724686:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.724688:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724689:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724696:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724697:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724699:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724705:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074208.724716:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724726:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.724733:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.724733:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e087a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724737:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724744:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.724745:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074208.724748:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724751:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.724754:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dae00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724756:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724757:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724766:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724766:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724775:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724775:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724783:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724784:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7980f9/0x5fb609b3016e0881 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724791:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074208.724804:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074208.724807:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724813:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.724816:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.724821:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.724823:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724825:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724832:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.724833:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724835:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.724839:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724841:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf7c712/0x5fb609b3016e0888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724848:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724851:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.724853:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.724855:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724855:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.724862:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.724867:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724886:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074208.724920:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783074208.724923:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.724925:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724928:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724932:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724935:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.724938:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.724940:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724942:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724949:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724951:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724959:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724960:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.724968:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724968:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee51c5f/0x5fb609b3016e088f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724981:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074208.724984:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.724990:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbe00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.724991:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074208.724993:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.725000:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.725009:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.725016:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fc6fbf8/0x5fb609b3016e0896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.725023:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725027:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.725033:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.725035:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.725037:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.725038:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725041:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725045:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725054:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725062:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725069:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725082:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783074208.725119:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725124:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725132:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725135:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725139:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725148:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725167:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725174:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725194:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783074208.725231:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725236:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725244:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725247:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725251:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725259:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725268:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725275:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725294:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783074208.725351:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725356:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725364:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725367:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725370:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725379:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725387:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725395:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725403:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783074208.725440:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725445:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725452:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725460:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725465:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725474:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725483:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725490:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725498:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783074208.725534:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725539:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725547:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725550:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725554:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725562:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725570:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725584:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725593:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783074208.725629:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725634:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725642:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725645:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725648:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725657:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725665:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725673:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725682:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783074208.725713:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725718:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725731:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725734:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725738:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725747:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725755:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725762:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725771:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783074208.725806:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725811:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725819:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725821:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725825:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725834:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725852:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725860:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725868:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783074208.725904:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.725908:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725915:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.725918:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.725921:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725930:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725938:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725946:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.725963:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1783074208.725977:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1783074208.725982:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.725989:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.725993:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.726000:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.726001:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726005:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726011:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.726013:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726014:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.726018:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726020:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2abac64/0x5fb609b3016e089d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726027:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726033:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726039:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726046:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1783074208.726052:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1783074208.726055:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726061:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.726069:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726072:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00002000:00010000:1.0:1783074208.726079:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.726083:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726083:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726084:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726106:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.726107:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.726110:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726112:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726114:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.726123:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726126:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a5cc40/0x5fb609b3016e08a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726136:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726140:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726143:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1783074208.726148:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726156:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151aa00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.726158:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726159:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726160:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726174:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726192:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726197:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9a85c8/0x5fb609b3016e08ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726201:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1783074208.726209:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726218:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e08b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726222:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783074208.726228:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.726242:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.726244:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783074208.726249:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726251:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726262:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151bc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.726264:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.726264:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.726267:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726269:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.726270:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726277:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726291:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726294:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726295:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.726304:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726336:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726336:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726346:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a33744f/0x5fb609b3016e08b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726361:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726368:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783074208.726373:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726373:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1783074208.726383:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.726387:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726395:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726404:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.726417:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.726418:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e08c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726428:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726435:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783074208.726439:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.726440:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726445:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.726454:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726455:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151ae00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.726460:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726473:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726475:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726497:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726499:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726518:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726519:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed11d8dd/0x5fb609b3016e08ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726545:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1783074208.726546:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783074208.726551:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726557:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.726565:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726574:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.726582:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.726584:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726592:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726594:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4df4312/0x5fb609b3016e08d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726614:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783074208.726614:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.726620:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726621:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.726631:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726633:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.726637:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726650:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726651:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726676:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726678:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726688:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726704:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783074208.726706:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e08dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726726:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783074208.726731:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726737:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.726741:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.726745:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.726749:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726753:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726764:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726765:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.726774:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.726781:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d9f405/0x5fb609b3016e08e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726783:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726805:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726806:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074208.726823:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726838:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.726838:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726843:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726856:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726876:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783074208.726878:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726889:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726897:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd579a06/0x5fb609b3016e08ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726913:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783074208.726916:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.726918:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.726930:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.726931:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726934:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726954:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.726955:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726962:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.726972:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726972:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.726993:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008bb55b0/0x5fb609b3016e08f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.726995:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727010:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727024:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727025:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074208.727031:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727039:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.727044:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727058:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727059:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783074208.727073:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727082:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd31349/0x5fb609b3016e08f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727096:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783074208.727100:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.727103:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.727110:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.727114:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727115:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727135:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.727142:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.727152:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727154:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727175:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727178:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727209:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92f1bdc/0x5fb609b3016e08ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727211:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727227:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727228:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783074208.727234:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727242:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783074208.727243:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.727249:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727256:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727267:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727271:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008956126d/0x5fb609b3016e08c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727276:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3eb0a/0x5fb609b3016e0906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.727280:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.727289:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727296:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074208.727302:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727304:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.727333:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.727334:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.727338:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.727338:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727343:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727346:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727352:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727369:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.727371:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727373:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727375:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727386:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727390:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727398:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727402:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074208.727402:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dc95e3/0x5fb609b3016e090d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727420:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727429:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e26f6/0x5fb609b3016e0914 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727429:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074208.727436:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.727440:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.727446:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727446:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.727449:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727454:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.727456:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.727457:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.727458:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727459:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.727463:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727464:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.727473:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727474:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727481:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab7c118/0x5fb609b3016e091b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727482:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727495:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727504:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074208.727507:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727512:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783074208.727513:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.727516:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727523:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.727531:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.727535:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727543:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172277df/0x5fb609b3016e0922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074208.727548:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.727553:0:26166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.727554:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.727556:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.727558:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.727560:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.727563:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.727567:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727575:0:26166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727582:0:26166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727589:0:26166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.727612:0:26166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783074208.728017:0:26166:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00000100:00100000:1.0:1783074208.728112:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:94288:x1869685723629824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4392us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.728128:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00100000:0.0:1783074208.728148:0:94288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94288:1869685723629824:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783074208.728164:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.728170:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074208.728172:0:94288:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x781:0x0] from OST, last_created [0x280000401:0x781:0x0]last_used is [0x280000401:0x723:0x0] 00010000:00010000:2.0:1783074208.728216:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074208.728253:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723630080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074208.728260:0:94288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc25b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94288:1869685723630208:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783074208.728301:0:94288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074208.728332:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.728367:0:94288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00010000:00010000:1.0:1783074208.728393:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.728398:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.728407:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.728419:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.728426:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612f2668/0x5fb609b3016e0929 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.728442:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.728444:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.728446:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074208.728496:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630080 00000100:00100000:2.0:1783074208.728508:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630080 00000100:00100000:0.0:1783074208.728545:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630208 00000100:00100000:0.0:1783074208.728550:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630208 00000100:00100000:2.0:1783074208.728554:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:2.0:1783074208.728566:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723630080:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783074208.728583:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944 00002000:00000024:2.0:1783074208.728588:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074208.728594:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:94288:x1869685723630208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783074208.728627:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00000100:00100000:2.0:1783074208.728635:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1869685723630080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074208.728643:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:2.0:1783074208.728682:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723630080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783074208.729422:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074208.729927:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:94288:x1869685723630208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1335us (1626us total) trans 4294968719 rc 0/0 00000100:00100000:0.0:1783074208.729935:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944 00000100:00100000:1.0:1783074208.729977:0:94288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc25b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94288:1869685723630208:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783074208.729988:0:94288:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x781:0x0]-[0x280000401:0x7a1:0x0] 00000100:00100000:2.0:1783074208.731964:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074208.732228:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100608 00000100:00100000:0.0:1783074208.732235:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100608 00000100:00080000:2.0:1783074208.732281:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074208.732282:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1759 00000100:00100000:0.0:1783074208.732305:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:72283:x1869685708100608:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074208.732351:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074208.732415:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:72283:x1869685708100608:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 112us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074208.732427:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1759 00000001:00100000:1.0:1783074208.732744:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:1.0:1783074208.732751:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000020:00000080:1.0:1783074208.732754:0:9524:0:(genops.c:906:class_export_put()) final put ffff9524fb6b5000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00000001:00100000:1.0:1783074208.732779:0:9524:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783074208.732817:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fb6b5000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b for lustre-OST0001 00000020:00000080:2.0:1783074208.732936:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524fb6b3000 for lustre-OST0001 00002000:00010000:3.0:1783074208.739202:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.739218:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739237:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.739241:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.739248:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739265:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739296:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739304:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739351:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.739385:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.739394:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739405:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.739410:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739422:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.739445:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.739449:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739452:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739468:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce2a48ca/0x5fb609b3016e0930 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739470:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.739475:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.739484:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739495:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739501:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.739503:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739505:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.739509:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.739515:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739542:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.739562:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.739569:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.739578:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.739582:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.739584:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.739595:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.739597:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739616:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.739621:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.739623:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739626:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739641:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.739651:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7aa803d/0x5fb609b3016e0937 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739655:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739670:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.739673:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.739676:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.739680:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.739691:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.739719:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.739726:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.739730:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.739740:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739742:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.739748:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739752:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.739768:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.739772:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739774:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739797:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739799:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739812:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739815:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9af1ce/0x5fb609b3016e093e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739827:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739839:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.739844:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739854:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783074208.739864:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.739868:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739875:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739886:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739893:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f99b7e95/0x5fb609b3016e0945 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.739897:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.739902:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739910:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.739916:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.739920:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739927:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739930:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.739932:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.739934:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.739936:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.739944:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739962:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074208.739987:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.739991:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.739998:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.740001:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.740004:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740013:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740021:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740028:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740051:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783074208.740058:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074208.740063:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740071:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.740075:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740083:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740084:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.740092:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740099:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740102:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.740109:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740112:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004691fbc7/0x5fb609b3016e094c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740128:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740135:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.740139:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.740142:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740143:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740153:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740155:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740157:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.740191:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b584c6/0x5fb609b3016e0953 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.740253:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.740258:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740266:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.740269:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.740273:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740282:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740289:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740296:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740362:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074208.740397:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.740401:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740406:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.740409:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.740410:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.740415:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740417:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740424:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740441:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740445:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740465:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.740469:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740472:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.740485:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740496:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.740499:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740501:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.740514:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.740518:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1995897/0x5fb609b3016e095a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740521:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740539:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.740540:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074208.740543:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.740544:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740548:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740548:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740552:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740552:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.740556:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.740562:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740566:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740570:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740574:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb8aaa5/0x5fb609b3016e0961 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740585:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.740586:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740590:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740593:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740595:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074208.740608:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074208.740611:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740617:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.740620:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740628:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740631:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074208.740643:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.740647:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740650:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740655:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.740658:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.740658:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d0d74e2/0x5fb609b3016e0968 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740662:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740670:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740670:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740672:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740674:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.740677:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740684:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740701:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074208.740731:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.740734:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740743:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.740745:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074208.740746:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.740755:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740755:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740775:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074208.740776:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740780:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740791:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740795:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740800:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740826:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740827:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.740838:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c777dc/0x5fb609b3016e096f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740854:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.740858:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074208.740860:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783074208.740862:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.740862:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740865:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.740867:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.740887:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:0.0:1783074208.740887:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074208.740891:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.740893:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740901:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740902:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740926:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740941:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.740953:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074208.740954:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740965:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740971:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093cae322/0x5fb609b3016e0976 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.740974:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.740980:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740987:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.740988:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fa00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:0.0:1783074208.740991:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074208.740993:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.740994:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.740995:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.741000:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741004:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741008:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.741011:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.741015:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741016:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741023:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928ffa7c/0x5fb609b3016e097d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741024:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741032:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741040:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741046:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.741048:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.741050:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.741062:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.741067:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.741071:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741078:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.741081:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741088:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.741096:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.741098:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741100:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741106:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120f8cde/0x5fb609b3016e0984 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741108:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.741111:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.741115:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741117:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.741119:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.741120:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.741123:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741130:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741137:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741151:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.741171:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.741177:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741195:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.741198:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.741199:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.741208:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741210:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741217:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.741223:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741225:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.741231:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741234:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006187a3f/0x5fb609b3016e098b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741247:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741266:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741273:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.741275:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741275:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.741278:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.741300:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783074208.741354:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.741359:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741366:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.741369:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.741373:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741382:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741390:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741402:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741418:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783074208.741447:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074208.741453:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.741454:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.741462:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741468:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.741473:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741476:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.741484:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.741487:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741489:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741514:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741515:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741535:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb01159d/0x5fb609b3016e0992 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741537:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741556:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741561:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.741565:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741572:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bca00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.741581:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741589:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741599:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741607:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2d48aa/0x5fb609b3016e0999 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741619:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.741621:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741627:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.741631:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741638:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741649:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.741657:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.741664:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.741862:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783074208.741868:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a085cf2a/0x5fb609b3016e09a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.741923:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783074208.741926:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.741932:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741940:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.741943:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.741947:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741956:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741964:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741971:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.741991:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.742020:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1783074208.742027:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.742027:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742033:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742054:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074208.742055:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.742061:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.742061:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742075:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742079:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742088:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742096:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742098:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742118:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2c37f01/0x5fb609b3016e09a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742119:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742147:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074208.742148:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074208.742153:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742162:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.742164:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742173:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742197:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.742202:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.742211:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742216:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86bf32b/0x5fb609b3016e09ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742226:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.742230:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.742234:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742235:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.742238:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.742241:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742248:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742249:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742259:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742278:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742294:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.742341:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.742347:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.742349:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.742360:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742361:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.742368:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742373:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.742376:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.742380:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742389:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742397:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742404:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742416:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.742435:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742448:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.742454:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.742456:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002baabf1e/0x5fb609b3016e09b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742461:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742471:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074208.742477:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.742477:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742482:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.742487:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742507:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074208.742511:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742512:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742534:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742535:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742556:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742561:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742571:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.742572:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfb9beb/0x5fb609b3016e09bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742589:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.742592:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742600:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.742604:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742612:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.742616:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.742628:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742628:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742637:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.742641:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.742646:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742664:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3940f16/0x5fb609b3016e09c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742666:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742692:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742695:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742696:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.742699:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742705:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742708:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742719:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.742728:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.742734:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742742:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bcc00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.742746:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.742748:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.742758:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742761:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742776:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.742781:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.742782:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742786:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742797:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf73f23/0x5fb609b3016e09ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742804:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742811:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.742815:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742820:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742823:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742832:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.742843:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742860:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.742862:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.742868:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.742877:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bda00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074208.742882:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.742891:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.742898:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.742907:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.742907:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.742907:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742923:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.742929:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.742930:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e6c1112/0x5fb609b3016e09d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742935:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742950:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.742953:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.742956:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.742959:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.742960:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742967:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.742978:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.742988:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.742995:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743003:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc200 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:3.0:1783074208.743005:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.743007:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743011:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743027:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:2.0:1783074208.743028:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743038:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.743047:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743052:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743055:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743073:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743073:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b4c8955/0x5fb609b3016e09d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743093:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743103:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074208.743105:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074208.743108:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743117:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.743120:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.743136:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743141:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.743144:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.743152:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743159:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743162:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.743170:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074208.743174:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027c044f8/0x5fb609b3016e09df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743177:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743205:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743210:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743214:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.743216:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743217:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.743231:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743244:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.743255:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.743261:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743268:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc400 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.743272:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.743280:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783074208.743280:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743290:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743297:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743301:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.743309:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.743332:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743348:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175e3593/0x5fb609b3016e09e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743352:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743367:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743375:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743386:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783074208.743390:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783074208.743391:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743401:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bce00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.743404:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.743410:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743414:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743428:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.743429:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.743437:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743441:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008872f5b0/0x5fb609b3016e09ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743458:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.743461:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.743465:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743467:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743470:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743473:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.743480:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743488:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743495:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743509:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074208.743528:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074208.743534:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.743541:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc000 already unused, calling callback (ffffffffc0c63ce0) 00002000:00010000:3.0:1783074208.743545:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783074208.743545:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743550:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.743553:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743558:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.743561:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074208.743564:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743565:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743573:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.743577:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f50317f/0x5fb609b3016e09f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743589:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074208.743591:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.743592:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074208.743594:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.743596:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743612:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.743638:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783074208.743644:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.743649:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.743658:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743663:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.743670:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743671:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:3.0:1783074208.743678:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074208.743687:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743688:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743712:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743713:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743731:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d0fe614/0x5fb609b3016e09fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743734:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743743:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.743744:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743747:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743751:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074208.743780:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074208.743810:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.743816:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074208.743821:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783074208.743831:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743838:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=3047s v=(0 0) 00010000:00010000:1.0:1783074208.743841:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145800 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074208.743842:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074208.743848:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743849:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743866:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.743869:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743883:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.743888:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743899:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074208.743902:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4cf11cf/0x5fb609b3016e0a02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074208.743922:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783074208.743932:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074208.743933:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.743937:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074208.743940:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.743947:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743957:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144c00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074208.743962:0:46245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743972:0:46245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.743992:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.744003:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c6a5d0e/0x5fb609b3016e0a09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074208.744023:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.744027:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074208.744029:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783074208.744299:0:8443:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:3.0:1783074208.744426:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94290:x1869685723629952:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20669us (20825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074208.744427:0:94290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94290:1869685723629952:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783074208.744436:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943 00000004:00080000:0.0:1783074208.744445:0:94290:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x781:0x0] from OST, last_created [0x2c0000401:0x781:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:3.0:1783074208.744516:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723630336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074208.744516:0:94290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94290:1869685723630464:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783074208.744550:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.744550:0:94290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074208.744570:0:94290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d32d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074208.744590:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630464 00000100:00100000:1.0:1783074208.744597:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630464 00000100:00100000:1.0:1783074208.744637:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945 00000100:00100000:1.0:1783074208.744646:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:94290:x1869685723630464:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783074208.744685:0:8444:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1922 00000100:00100000:1.0:1783074208.745991:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:94290:x1869685723630464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1344us (1437us total) trans 4294968716 rc 0/0 00000100:00100000:1.0:1783074208.746002:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945 00000100:00100000:0.0:1783074208.746020:0:94290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94290:1869685723630464:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783074208.746032:0:94290:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x781:0x0]-[0x2c0000401:0x7a1:0x0] 00000100:00100000:1.0:1783074208.746148:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630336 00000100:00100000:1.0:1783074208.746152:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630336 00000100:00100000:1.0:1783074208.746194:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:1.0:1783074208.746201:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723630336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783074208.746217:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074208.746252:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723630336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074208.746256:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:3.0:1783074208.746293:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723630336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074209.198505:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723630592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074209.198622:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074209.198661:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723630720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074209.198663:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630592 00000100:00100000:1.0:1783074209.198673:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630592 00000100:00100000:2.0:1783074209.198721:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074209.198886:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630720 00000100:00100000:1.0:1783074209.198889:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630720 00000100:00100000:1.0:1783074209.198920:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:1.0:1783074209.198934:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723630592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783074209.198941:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1783074209.198954:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723630720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074209.198964:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00002000:00000024:2.0:1783074209.198974:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783074209.199027:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723630592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074209.199031:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723630720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074209.199039:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:2.0:1783074209.199051:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1783074209.199092:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723630720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783074209.199124:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723630592:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783074209.390762:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783074209.713767:0:75594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783074210.415998:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074211.047873:0:94851:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1783074211.441774:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074211.771498:0:94899:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1783074211.823850:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074211.823913:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100736 00000100:00100000:1.0:1783074211.823923:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100736 00000100:00100000:0.0:1783074211.823959:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074211.823987:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:0.0:1783074211.823994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074211.824002:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708100736:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074211.824037:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074211.824151:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708100736:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074211.824159:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:1.0:1783074211.824190:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100864 00000100:00100000:1.0:1783074211.824193:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100864 00000100:00100000:1.0:1783074211.824554:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708100992 00000100:00100000:1.0:1783074211.824559:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708100992 00000100:00100000:1.0:1783074211.824609:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 884 00000100:00100000:1.0:1783074211.824617:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708100864:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074211.824925:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 885 00000100:00100000:2.0:1783074211.824937:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2404:x1869685708100992:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074211.825497:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2404:x1869685708100992:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 561us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074211.825500:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708100864:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 879us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074211.825508:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 884 00000100:00100000:2.0:1783074211.825512:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 885 00000100:00080000:1.0:1783074211.825535:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783074211.825539:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074211.825637:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074211.825690:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101120 00000100:00100000:0.0:1783074211.825696:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101120 00000100:00100000:0.0:1783074211.825746:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101248 00000100:00100000:0.0:1783074211.825750:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101248 00000100:00100000:1.0:1783074211.825783:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2197 00000100:00100000:0.0:1783074211.825791:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2198 00000100:00100000:1.0:1783074211.825796:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708101120:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074211.825805:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708101248:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074211.825846:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708101248:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074211.825847:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2404:x1869685708101120:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 52us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074211.825859:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2198 00000100:00100000:1.0:1783074211.825873:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2197 00000100:00080000:3.0:1783074211.826135:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074211.826139:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783074212.462494:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074213.198574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074213.199112:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101376 00000100:00100000:2.0:1783074213.199123:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101376 00000100:00100000:2.0:1783074213.199224:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1357 00000100:00100000:2.0:1783074213.199236:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:72754:x1869685708101376:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074213.199259:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074213.199286:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7800/0x5fb609b3016e0a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b329 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.199378:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0a17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.199396:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.199411:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074213.199467:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074213.199470:0:66201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074213.199496:0:66201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.199520:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7800/0x5fb609b3016e0a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b329 expref: 8 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.199543:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0a17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b329 expref: 7 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.199571:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:2.0:1783074213.199574:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074213.199578:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7c00, rc 0) 00000100:00100000:2.0:1783074213.199645:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:72754:x1869685708101376:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 412us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.199652:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1357 00000100:00080000:3.0:1783074213.199725:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074213.203964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074213.204044:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101504 00000100:00100000:3.0:1783074213.204054:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101504 00000100:00100000:3.0:1783074213.204121:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1358 00000100:00100000:3.0:1783074213.204131:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:72754:x1869685708101504:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:3.0:1783074213.204171:0:66200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444663296 avail 1298423808 00000100:00100000:3.0:1783074213.204235:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:72754:x1869685708101504:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.204243:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1358 00000100:00100000:0.0:1783074213.206293:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074213.206386:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101632 00000100:00100000:2.0:1783074213.206393:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101632 00000100:00100000:2.0:1783074213.206449:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1359 00000100:00100000:2.0:1783074213.206459:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:72754:x1869685708101632:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1783074213.206491:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:2.0:1783074213.206578:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:72754:x1869685708101632:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 121us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.206586:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1359 00000100:00080000:3.0:1783074213.206643:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074213.208998:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074213.209073:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101760 00000100:00100000:3.0:1783074213.209082:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101760 00000100:00080000:1.0:1783074213.209157:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074213.209281:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1763 00000100:00100000:3.0:1783074213.209293:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:72754:x1869685708101760:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:3.0:1783074213.209354:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074213.209420:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:72754:x1869685708101760:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 128us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.209427:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1763 00000100:00100000:0.0:1783074213.211616:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074213.211680:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708101888 00000100:00100000:1.0:1783074213.211688:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708101888 00000100:00100000:1.0:1783074213.211787:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1764 00000100:00100000:1.0:1783074213.211795:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:72754:x1869685708101888:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:1.0:1783074213.211825:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074213.211888:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:72754:x1869685708101888:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074213.211893:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1764 00000100:00080000:3.0:1783074213.212058:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074213.225058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074213.225154:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102016 00000100:00100000:1.0:1783074213.225165:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102016 00000100:00100000:1.0:1783074213.225223:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1360 00000100:00100000:1.0:1783074213.225234:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:71656:x1869685708102016:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1783074213.225272:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074213.225296:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159600/0x5fb609b3016e0a1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b330 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225392:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225410:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225424:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225438:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225445:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225452:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225600:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016e0a33 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225609:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016e0a33 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225617:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016e0a33 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074213.225644:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783074213.225653:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074213.225687:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016e0a33 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225701:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225709:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225716:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225724:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225730:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074213.225735:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225752:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225765:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074213.225768:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074213.225774:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225781:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0a25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225907:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225925:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225932:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225937:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074213.225941:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225948:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225957:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9524f08f4400) 00010000:00010000:1.0:1783074213.225959:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074213.225963:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.225970:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159800/0x5fb609b3016e0a2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.226002:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159600/0x5fb609b3016e0a1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b330 expref: 9 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.226017:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159000/0x5fb609b3016e0a33 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b330 expref: 8 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.226025:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524f08f4900) 00010000:00010000:1.0:1783074213.226027:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783074213.226034:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159000, rc 0) 00000100:00100000:1.0:1783074213.226143:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71656:x1869685708102016:12345-192.168.204.26@tcp:101:bash.0 Request processed in 910us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074213.226151:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1360 00000100:00100000:2.0:1783074213.235956:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074213.236256:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102144 00000100:00100000:0.0:1783074213.236266:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102144 00000100:00100000:0.0:1783074213.236407:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1361 00000100:00100000:0.0:1783074213.236419:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:71656:x1869685708102144:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1783074213.236443:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074213.236465:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016e0a3a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b337 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.236537:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.236554:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.236566:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.236582:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.236589:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.236611:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074213.236780:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723630848:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074213.236897:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074213.236943:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4947240 going to sleep for 11 seconds 00000100:00100000:3.0:1783074213.236965:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630848 00000100:00100000:3.0:1783074213.236972:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630848 00000100:00100000:3.0:1783074213.237007:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:3.0:1783074213.237014:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723630848:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783074213.237136:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723630848:12345-0@lo:1000:mdt00_004.0 Request processed in 122us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.237144:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1783074213.237233:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723630848:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1783074213.237275:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299600/0x5fb609b3016e0a4f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237286:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299600/0x5fb609b3016e0a4f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237295:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299600/0x5fb609b3016e0a4f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074213.237335:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299600/0x5fb609b3016e0a4f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237349:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237357:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237364:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237371:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237388:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074213.237394:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237402:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237417:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524f08f4900) 00010000:00010000:0.0:1783074213.237420:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074213.237425:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237432:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a41 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237445:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237452:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237459:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237464:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074213.237467:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237473:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237490:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9524d2de4d00) 00010000:00010000:0.0:1783074213.237493:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074213.237496:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237503:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a48 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237534:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299c00/0x5fb609b3016e0a3a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b337 expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237548:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299600/0x5fb609b3016e0a4f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b337 expref: 9 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.237556:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524d2de4800) 00010000:00010000:0.0:1783074213.237559:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074213.237561:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299600, rc 0) 00000100:00100000:0.0:1783074213.237606:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71656:x1869685708102144:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1191us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074213.237613:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1361 00000100:00100000:0.0:1783074213.239179:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074213.239275:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102272 00000100:00100000:2.0:1783074213.239282:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102272 00000100:00100000:2.0:1783074213.239442:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1362 00000100:00100000:2.0:1783074213.239453:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71656:x1869685708102272:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1783074213.239472:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074213.239492:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0a56 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b33e expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.239548:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670000/0x5fb609b3016e0a5d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.239572:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670000/0x5fb609b3016e0a5d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.239585:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670000/0x5fb609b3016e0a5d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074213.239745:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1783074213.239750:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783074213.239798:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524edcc7800/0x5fb609b3016e0a56 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b33e expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.239816:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670000/0x5fb609b3016e0a5d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b33e expref: 10 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074213.239825:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299300) 00010000:00010000:2.0:1783074213.239828:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1783074213.239832:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670000, rc 0) 00000100:00100000:2.0:1783074213.239947:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71656:x1869685708102272:12345-192.168.204.26@tcp:101:bash.0 Request processed in 495us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.239956:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1362 00000100:00100000:2.0:1783074213.242572:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074213.242613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074213.242733:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102528 00000100:00100000:1.0:1783074213.242741:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102528 00000100:00100000:3.0:1783074213.242762:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102400 00000100:00100000:3.0:1783074213.242769:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102400 00000100:00100000:1.0:1783074213.242797:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1363 00000100:00100000:1.0:1783074213.242808:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71656:x1869685708102528:12345-192.168.204.26@tcp:101:bash.0 00000100:00100000:3.0:1783074213.242823:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 714 00010000:00010000:1.0:1783074213.242829:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074213.242851:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159800/0x5fb609b3016e0a64 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b345 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074213.242887:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2402:x1869685708102400:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074213.242901:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074213.242915:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.242924:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524fb670000/0x5fb609b3016e0a5d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b33e expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.242933:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.242944:0:19651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299300) 00010000:00010000:1.0:1783074213.242945:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.242953:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074213.242998:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2402:x1869685708102400:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 167us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.243003:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 714 00010000:00010000:1.0:1783074213.243951:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.243961:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.243968:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244069:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158000/0x5fb609b3016e0a79 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244087:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158000/0x5fb609b3016e0a79 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244092:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158000/0x5fb609b3016e0a79 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074213.244146:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783074213.244151:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074213.244174:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158000/0x5fb609b3016e0a79 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244185:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158000/0x5fb609b3016e0a79 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244196:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244203:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244210:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244217:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244223:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074213.244227:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244235:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244255:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9524fc299300) 00010000:00010000:1.0:1783074213.244258:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074213.244263:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244269:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158600/0x5fb609b3016e0a6b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244282:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244288:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244294:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244299:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074213.244302:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244308:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244328:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff9524f08f4400) 00010000:00010000:1.0:1783074213.244331:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074213.244334:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244340:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158800/0x5fb609b3016e0a72 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244456:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159800/0x5fb609b3016e0a64 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b345 expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244472:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158000/0x5fb609b3016e0a79 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b345 expref: 10 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.244479:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9524f4710700) 00010000:00010000:1.0:1783074213.244482:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074213.244485:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158000, rc 0) 00000100:00100000:1.0:1783074213.244586:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71656:x1869685708102528:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1778us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074213.244594:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1363 00000100:00100000:2.0:1783074213.246468:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074213.246636:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102656 00000100:00100000:0.0:1783074213.246644:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102656 00000100:00100000:0.0:1783074213.246733:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4946 00000100:00100000:0.0:1783074213.246758:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2405:x1869685708102656:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1783074213.246778:0:26171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074213.246798:0:26171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016e0a80 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b34c expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074213.246843:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x222:0x0] initial LVB size: 0, mtime: 0x6a478d89, atime: 0x6a478d89, ctime: 0x6a478d89, blocks: 0x0 00010000:00010000:0.0:1783074213.246861:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=3052s v=(0 0) 00010000:00010000:0.0:1783074213.246866:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074213.246877:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016e0a80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b34c expref: 6 pid: 26171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.246897:0:26171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f6cf8ba/0x5fb609b3016e0a80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b34c expref: 6 pid: 26171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.246911:0:26171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299c00, rc 0) 00000100:00100000:0.0:1783074213.246964:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2405:x1869685708102656:12345-192.168.204.26@tcp:101:bash.0 Request processed in 222us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074213.246972:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4946 00000100:00100000:2.0:1783074213.248849:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074213.249170:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102784 00000100:00100000:0.0:1783074213.249178:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102784 00000100:00100000:0.0:1783074213.249231:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1364 00000100:00100000:0.0:1783074213.249243:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:71656:x1869685708102784:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1783074213.249261:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074213.249283:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a87 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b353 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.249378:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.249395:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.249416:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.249431:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.249440:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074213.249448:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074213.249567:0:68632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723630976:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783074213.249618:0:68632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074213.249654:0:68632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fba30900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074213.249685:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723630976 00000100:00100000:2.0:1783074213.249690:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723630976 00000100:00100000:2.0:1783074213.249723:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:2.0:1783074213.249730:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723630976:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783074213.249812:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68632:x1869685723630976:12345-0@lo:1000:mdt00_004.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.249819:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:3.0:1783074213.249859:0:68632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68632:1869685723630976:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783074213.249905:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016e0a9c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249915:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016e0a9c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249928:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016e0a9c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074213.249946:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016e0a9c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249955:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249960:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249964:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249968:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249971:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074213.249974:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249979:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249988:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9524f08f4900) 00010000:00010000:3.0:1783074213.249990:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074213.249993:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.249997:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298400/0x5fb609b3016e0a8e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250010:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250017:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250022:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250027:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074213.250029:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250035:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250043:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9524d2de4700) 00010000:00010000:3.0:1783074213.250045:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074213.250048:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250053:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299200/0x5fb609b3016e0a95 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250084:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298800/0x5fb609b3016e0a87 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b353 expref: 11 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250108:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144e00/0x5fb609b3016e0a9c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b353 expref: 10 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.250126:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524faa40100) 00010000:00010000:3.0:1783074213.250128:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783074213.250130:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144e00, rc 0) 00000100:00100000:3.0:1783074213.250174:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71656:x1869685708102784:12345-192.168.204.26@tcp:101:bash.0 Request processed in 935us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.250180:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1364 00000100:00100000:1.0:1783074213.251410:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074213.251454:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708102912 00000100:00100000:3.0:1783074213.251473:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708102912 00000100:00100000:3.0:1783074213.251518:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1365 00000100:00100000:3.0:1783074213.251527:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:71656:x1869685708102912:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1783074213.251541:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074213.251559:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144200/0x5fb609b3016e0aa3 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b35a expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.251606:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144000/0x5fb609b3016e0aaa lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.251619:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144000/0x5fb609b3016e0aaa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.251629:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144000/0x5fb609b3016e0aaa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074213.251670:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783074213.251674:0:66202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783074213.251705:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144200/0x5fb609b3016e0aa3 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b35a expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.251734:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144000/0x5fb609b3016e0aaa lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b35a expref: 11 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.251742:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524ca7b9a00) 00010000:00010000:3.0:1783074213.251745:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783074213.251748:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144000, rc 0) 00000100:00100000:3.0:1783074213.251794:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71656:x1869685708102912:12345-192.168.204.26@tcp:101:bash.0 Request processed in 268us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.251801:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1365 00000100:00100000:2.0:1783074213.253523:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074213.253565:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074213.253567:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103168 00000100:00100000:1.0:1783074213.253574:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103168 00000100:00100000:3.0:1783074213.253609:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103040 00000100:00100000:3.0:1783074213.253614:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103040 00000100:00100000:1.0:1783074213.253623:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1366 00000100:00100000:1.0:1783074213.253632:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:71656:x1869685708103168:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1783074213.253647:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783074213.253706:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 715 00000100:00100000:3.0:1783074213.253715:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2402:x1869685708103040:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074213.253722:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158400/0x5fb609b3016e0ab1 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b361 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.253726:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074213.253743:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524e4144000/0x5fb609b3016e0aaa lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b35a expref: 13 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.253756:0:19655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524ca7b9a00) 00010000:00010000:3.0:1783074213.253760:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074213.253774:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253785:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074213.253801:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2402:x1869685708103040:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.253808:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 715 00010000:00010000:1.0:1783074213.253814:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253841:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253849:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253857:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253949:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158a00/0x5fb609b3016e0ac6 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253958:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158a00/0x5fb609b3016e0ac6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.253965:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158a00/0x5fb609b3016e0ac6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074213.254008:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:1.0:1783074213.254012:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074213.254028:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158a00/0x5fb609b3016e0ac6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254036:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158a00/0x5fb609b3016e0ac6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254043:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254066:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254072:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254080:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254086:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074213.254090:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254108:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254118:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9524ca7b9a00) 00010000:00010000:1.0:1783074213.254121:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074213.254125:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254131:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158e00/0x5fb609b3016e0ab8 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254140:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254146:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254157:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254168:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074213.254171:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254177:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254182:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff9524f08f4c00) 00010000:00010000:1.0:1783074213.254184:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074213.254186:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254189:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3159e00/0x5fb609b3016e0abf lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254215:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158400/0x5fb609b3016e0ab1 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b361 expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254246:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9524d3158a00/0x5fb609b3016e0ac6 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b361 expref: 11 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074213.254253:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9524f4710e00) 00010000:00010000:1.0:1783074213.254256:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074213.254258:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158a00, rc 0) 00000100:00100000:1.0:1783074213.254288:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:71656:x1869685708103168:12345-192.168.204.26@tcp:101:bash.0 Request processed in 658us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074213.254294:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1366 00000100:00100000:2.0:1783074213.257987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074213.258036:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103296 00000100:00100000:3.0:1783074213.258045:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103296 00000100:00100000:3.0:1783074213.258119:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4947 00000100:00100000:3.0:1783074213.258144:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708103296:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1783074213.258165:0:26178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074213.258187:0:26178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c71f8a80/0x5fb609b3016e0acd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b368 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074213.258214:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x223:0x0] initial LVB size: 0, mtime: 0x6a478d89, atime: 0x6a478d89, ctime: 0x6a478d89, blocks: 0x0 00010000:00010000:3.0:1783074213.258233:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=3052s v=(0 0) 00010000:00010000:3.0:1783074213.258238:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074213.258249:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c71f8a80/0x5fb609b3016e0acd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b368 expref: 7 pid: 26178 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.258268:0:26178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c71f8a80/0x5fb609b3016e0acd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b368 expref: 7 pid: 26178 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074213.258283:0:26178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145400, rc 0) 00000100:00100000:3.0:1783074213.258366:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2404:x1869685708103296:12345-192.168.204.26@tcp:101:bash.0 Request processed in 223us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.258375:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4947 00010000:00010000:2.0:1783074213.486465:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074213.806475:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783074213.806499:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723631104:0@lo:400:kworker.0 00000100:00100000:3.0:1783074213.806588:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074213.806664:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723631232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074213.806697:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074213.806739:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631104 00000100:00100000:3.0:1783074213.806746:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631104 00000100:00100000:3.0:1783074213.806794:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783074213.806818:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723631104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074213.806898:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723631104:12345-0@lo:400:kworker.0 Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.806906:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783074213.806941:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631232 00000100:00100000:2.0:1783074213.806947:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631232 00000100:00100000:3.0:1783074213.806964:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723631104:0@lo:400:kworker.0 00000100:00100000:2.0:1783074213.807004:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:2.0:1783074213.807013:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723631232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074213.807020:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723631360:0@lo:400:kworker.0 00002000:00000024:2.0:1783074213.807032:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074213.807052:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074213.807201:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723631488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074213.807268:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723631232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.807279:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:0.0:1783074213.807280:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074213.807300:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631488 00000100:00100000:2.0:1783074213.807305:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631488 00000100:00080000:0.0:1783074213.807344:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074213.807349:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074213.807355:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631360 00000100:00100000:3.0:1783074213.807361:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631360 00000100:00100000:0.0:1783074213.807397:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:0.0:1783074213.807410:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723631488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783074213.807415:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1783074213.807426:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869685723631360:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1783074213.807428:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074213.807485:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723631488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00080000:2.0:1783074213.807486:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783074213.807490:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869685723631360:12345-0@lo:400:kworker.0 Request processed in 64us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074213.807499:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:3.0:1783074213.807504:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1783074213.807520:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723631616:0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.807543:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723631488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074213.807550:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074213.807583:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723631232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074213.807591:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631616 00000100:00100000:2.0:1783074213.807594:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074213.807598:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631616 00000100:00100000:2.0:1783074213.807602:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723631744:0@lo:400:kworker.0 00000100:00100000:2.0:1783074213.807621:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074213.807646:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631744 00000100:00100000:2.0:1783074213.807650:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1783074213.807651:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631744 00000100:00100000:2.0:1783074213.807658:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723631616:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783074213.807668:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783074213.807674:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783074213.807686:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1783074213.807690:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723631616:12345-0@lo:400:kworker.0 Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.807696:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723631744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074213.807705:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1783074213.807732:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c49c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723631616:0@lo:400:kworker.0 00000100:00100000:3.0:1783074213.807748:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723631744:12345-0@lo:400:kworker.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.807756:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1783074213.807790:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723631360:0@lo:400:kworker.0 00000100:00100000:3.0:1783074213.807827:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723631872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783074213.807844:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723631744:0@lo:400:kworker.0 00000100:00100000:1.0:1783074213.807860:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723632000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074213.807893:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723632128:0@lo:400:kworker.0 00000100:00100000:1.0:1783074213.807919:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074213.807928:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074213.807945:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074213.807964:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632128 00000100:00100000:2.0:1783074213.807968:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632128 00000100:00100000:1.0:1783074213.807994:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632000 00000100:00100000:1.0:1783074213.808000:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632000 00000100:00100000:3.0:1783074213.808024:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723632256:0@lo:400:kworker.0 00000100:00100000:1.0:1783074213.808034:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723631872 00000100:00100000:1.0:1783074213.808040:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723631872 00000100:00100000:2.0:1783074213.808043:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1783074213.808050:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723632128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074213.808058:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074213.808078:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632256 00000100:00100000:1.0:1783074213.808095:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632256 00000100:00100000:2.0:1783074213.808109:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869685723632128:12345-0@lo:400:kworker.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.808115:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1783074213.808120:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1783074213.808131:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723632000:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074213.808139:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723632384:0@lo:400:kworker.0 00000100:00100000:2.0:1783074213.808142:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1783074213.808152:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723631872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783074213.808160:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000004:00000024:2.0:1783074213.808168:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444663296 avail 1298423808 00000100:00100000:3.0:1783074213.808178:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074213.808387:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:0.0:1783074213.808396:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3659:x1869685723632256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074213.808795:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723632000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 667us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074213.808803:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00080000:1.0:1783074213.808850:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074213.808851:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723631872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 698us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.808859:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1783074213.808884:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632384 00000100:00100000:1.0:1783074213.808885:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869685723632128:0@lo:400:kworker.0 00000100:00100000:2.0:1783074213.808890:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632384 00000100:00080000:1.0:1783074213.808918:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074213.808926:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723631872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074213.808946:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074213.808955:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723632512:0@lo:400:kworker.0 00000100:00100000:1.0:1783074213.808972:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723632640:0@lo:400:kworker.0 00000100:00100000:3.0:1783074213.808990:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074213.809008:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074213.809032:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632512 00000100:00100000:1.0:1783074213.809035:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783074213.809038:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632512 00000100:00100000:1.0:1783074213.809045:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723632768:0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809053:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723632256:12345-0@lo:400:kworker.0 Request processed in 655us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074213.809061:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1783074213.809078:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074213.809102:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1783074213.809110:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632640 00000100:00100000:3.0:1783074213.809114:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723632512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809116:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632640 00000100:00100000:3.0:1783074213.809159:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723632512:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074213.809166:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00080000:1.0:1783074213.809182:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783074213.809210:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1783074213.809217:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723632384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809220:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632768 00000100:00100000:0.0:1783074213.809225:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632768 00000100:00100000:0.0:1783074213.809246:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1783074213.809254:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723632640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074213.809266:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723632000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074213.809268:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723632512:0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809304:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723632640:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074213.809327:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723632640:0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809333:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1783074213.809354:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1783074213.809364:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723632256:0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809365:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723632768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074213.809414:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723632768:12345-0@lo:400:kworker.0 Request processed in 53us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074213.809421:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1783074213.809423:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723632768:0@lo:400:kworker.0 00000100:00100000:2.0:1783074213.810006:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723632384:12345-0@lo:400:kworker.0 Request processed in 788us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074213.810022:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:3.0:1783074213.810117:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723632384:0@lo:400:kworker.0 00000100:00100000:1.0:1783074214.318657:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783074214.318681:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723632896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074214.318747:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074214.318842:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723632896 00000100:00100000:2.0:1783074214.318849:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723632896 00000100:00100000:2.0:1783074214.318951:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:2.0:1783074214.318963:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723632896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783074214.319060:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074214.319165:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723632896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 205us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074214.319173:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:0.0:1783074214.319238:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783074214.319248:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723633024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074214.319279:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074214.319351:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723633024 00000100:00100000:0.0:1783074214.319355:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723633024 00000100:00100000:0.0:1783074214.319383:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:0.0:1783074214.319396:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723633024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074214.319409:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074214.319456:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723633024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074214.319462:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:0.0:1783074214.319512:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723633024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074214.319624:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723632896:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783074214.510592:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783074214.833565:0:9524:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968716 is committed 00000001:00080000:1.0:1783074214.835699:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968719 is committed 00010000:00010000:3.0:1783074215.534592:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074216.558508:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783074216.706981:0:95190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd297d73a0 20000000:00000080:1.0:1783074216.706999:0:95190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9523c579c800 uarg=0000000000000000 00000040:00100000:1.0:1783074216.707690:0:95190:0:(llog.c:1067:llog_reverse_process()) index 57 : idx 49 20000000:01000000:1.0:1783074216.707696:0:95190:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1783074216.707709:0:95190:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1783074216.708003:0:95191:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 55 marker 46 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1783074216.708080:0:95191:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 57 marker 46 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1783074216.708094:0:95191:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:2.0:1783074216.708238:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:2.0:1783074216.708256:0:95190:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783074216.708275:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:2.0:1783074216.708294:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:2.0:1783074216.708326:0:95190:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1783074216.708580:0:95192:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1783074216.708610:0:95192:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1783074216.708624:0:95192:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1783074216.708708:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:2.0:1783074216.708716:0:95190:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783074216.708724:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:2.0:1783074216.708738:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:2.0:1783074216.708749:0:95190:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1783074216.709397:0:95193:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 48 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1783074216.709441:0:95193:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 48 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1783074216.709454:0:95193:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:2.0:1783074216.709586:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:2.0:1783074216.709598:0:95190:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783074216.709612:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:2.0:1783074216.709626:0:95190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:2.0:1783074216.709637:0:95190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783074216.709655:0:95190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709673:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709688:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709696:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709703:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e073f expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709710:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709716:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709720:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709724:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709728:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709734:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709738:0:95190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709750:0:95190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709782:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709795:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 9 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.709809:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633152:192.168.204.26@tcp:104: 00010000:00010000:2.0:1783074216.709963:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.709971:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 9 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.709979:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633280:192.168.204.26@tcp:104: 00010000:00010000:2.0:1783074216.710010:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.710017:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 23 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.710026:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633408:0@lo:104: 00000100:00100000:2.0:1783074216.710112:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074216.710150:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074216.710163:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723633408 00010000:00010000:2.0:1783074216.710170:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 23 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074216.710179:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723633408 00000100:00100000:2.0:1783074216.710181:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633536:0@lo:104: 00000100:00100000:2.0:1783074216.710228:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074216.710247:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1783074216.710256:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074216.710259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723633536 00000100:00100000:3.0:1783074216.710265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723633536 00010000:00010000:2.0:1783074216.710267:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 23 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.710278:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633664:0@lo:104: 00000100:00100000:3.0:1783074216.710286:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1783074216.710304:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074216.710306:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95190:x1869685723633408:12345-0@lo:104: 00010000:00010000:3.0:1783074216.710342:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.710387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723633664 00000100:00100000:0.0:1783074216.710391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723633664 00000100:00100000:0.0:1783074216.710407:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1783074216.710411:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c467a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95190:x1869685723633536:12345-0@lo:104: 00010000:00010000:0.0:1783074216.710417:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.710474:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074216.710481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95190:x1869685723633408:12345-0@lo:104: Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.710487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1783074216.710503:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1783074216.710509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95190:x1869685723633664:12345-0@lo:104: 00010000:00010000:3.0:1783074216.710517:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.710557:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1783074216.710564:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783074216.710564:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c467a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95190:x1869685723633536:12345-0@lo:104: Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.710572:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95190:x1869685723633664:12345-0@lo:104: Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074216.710577:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1783074216.710588:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:1.0:1783074216.710608:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783074216.710609:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783074216.710615:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710617:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.710627:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9a00 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074216.710627:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074216.710632:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28f800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074216.710634:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.710635:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074216.710636:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.710652:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df28fc00 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:3.0:1783074216.710653:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074216.710656:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074216.710674:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710676:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.710676:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074216.710685:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074216.710697:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074216.710698:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1783074216.710699:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074216.710707:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074216.710726:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710732:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074216.710749:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710756:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28f800/0x5fb609b3016e07cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e07d2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.710762:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710766:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074216.710768:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074216.710770:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 23 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710770:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074216.710778:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633920:0@lo:104: 00000100:00100000:1.0:1783074216.710780:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723633792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074216.710802:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074216.710803:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074216.710815:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.710823:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074216.710827:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.710838:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 23 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.710845:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723633792 00000100:00100000:2.0:1783074216.710846:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634176:0@lo:104: 00000100:00100000:1.0:1783074216.710848:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723633792 00010000:00010000:3.0:1783074216.710853:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.710862:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c9a00/0x5fb609b3016e07a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e07a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710866:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.710887:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074216.710890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00010000:00010000:3.0:1783074216.710892:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074216.710896:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074216.710900:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723633792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074216.710901:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074216.710911:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e073f expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710915:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074216.710920:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e073f expref: 24 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710920:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074216.710922:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723634048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074216.710937:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634304:0@lo:104: 00010000:00010000:1.0:1783074216.710937:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.710952:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074216.710979:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.710985:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074216.710998:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.711003:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df28fc00/0x5fb609b3016e0793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e079a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.711012:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074216.711013:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074216.711014:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074216.711029:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723634432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074216.711216:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074216.711220:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723633792:12345-0@lo:103:ldlm_bl.0 Request processed in 323us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074216.711226:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00010000:00010000:2.0:1783074216.711238:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.711246:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 23 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.711255:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634560:0@lo:104: 00000100:00100000:2.0:1783074216.711277:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074216.711292:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.711300:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 23 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.711329:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634688:0@lo:104: 00000100:00100000:2.0:1783074216.711355:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074216.711376:0:95190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.711384:0:95190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 23 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074216.711398:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074216.711411:0:95190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634816:0@lo:104: 00000100:00100000:2.0:1783074216.711440:0:95190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074216.711472:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723633792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074216.711500:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783074216.711509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723633920 00000100:00100000:3.0:1783074216.711557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723633920 00000100:00100000:3.0:1783074216.711574:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634176 00000100:00100000:3.0:1783074216.711577:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634176 00000100:00100000:3.0:1783074216.711586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634304 00000100:00100000:3.0:1783074216.711588:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634304 00000100:00100000:3.0:1783074216.711593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634560 00000100:00100000:3.0:1783074216.711595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634560 00000100:00100000:3.0:1783074216.711601:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634688 00000100:00100000:3.0:1783074216.711603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634688 00000100:00100000:3.0:1783074216.711611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634816 00000100:00100000:3.0:1783074216.711619:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634816 00000100:00100000:3.0:1783074216.711633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1783074216.711640:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:95190:x1869685723633920:12345-0@lo:104: 00010000:00010000:3.0:1783074216.711719:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.711762:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783074216.711763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074216.711772:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+8:95190:x1869685723633920:12345-0@lo:104: Request processed in 131us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.711779:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1783074216.711789:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634048 00000100:00100000:1.0:1783074216.711794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634048 00000100:00100000:3.0:1783074216.711797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1783074216.711806:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+7:95190:x1869685723634176:12345-0@lo:104: 00010000:00010000:1.0:1783074216.711813:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.711817:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.711840:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103424 00000100:00100000:1.0:1783074216.711844:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103424 00010000:00010000:1.0:1783074216.711857:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.711862:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783074216.711872:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+7:95190:x1869685723634176:12345-0@lo:104: Request processed in 67us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.711879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1783074216.711884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1783074216.711894:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723634048:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074216.711898:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00010000:00010000:1.0:1783074216.711906:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783074216.711910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:95190:x1869685723634304:12345-0@lo:104: 00010000:00010000:1.0:1783074216.711914:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.711920:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.711926:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.711946:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074216.711954:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783074216.711959:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+6:95190:x1869685723634304:12345-0@lo:104: Request processed in 54us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.711964:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1783074216.711986:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1783074216.711988:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3659:x1869685723634048:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.711995:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95190:x1869685723634560:12345-0@lo:104: 00000100:00100000:1.0:1783074216.712002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00010000:00010000:3.0:1783074216.712007:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.712017:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074216.712075:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783074216.712077:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634432 00000100:00100000:0.0:1783074216.712083:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634432 00000100:00100000:1.0:1783074216.712088:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2615 00000100:00100000:1.0:1783074216.712097:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708103424:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783074216.712104:0:7930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.712106:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074216.712114:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.712126:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.712136:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00010000:00010000:1.0:1783074216.712138:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074216.712146:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723634432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074216.712156:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074216.712161:0:7930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.712170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708103424:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 73us (408us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074216.712184:0:7930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.712185:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2615 00010000:00010000:0.0:1783074216.712200:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074216.712231:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723634432:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074216.712238:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1783074216.712273:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1783074216.712280:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95190:x1869685723634688:12345-0@lo:104: 00010000:00010000:0.0:1783074216.712288:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712331:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783074216.712336:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95190:x1869685723634688:12345-0@lo:104: Request processed in 58us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074216.712342:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1783074216.712355:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1783074216.712362:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501eda850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95190:x1869685723634816:12345-0@lo:104: 00010000:00010000:0.0:1783074216.712369:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712397:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783074216.712403:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501eda850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95190:x1869685723634816:12345-0@lo:104: Request processed in 43us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.712404:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95190:x1869685723634560:12345-0@lo:104: Request processed in 90us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074216.712415:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1783074216.712422:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00010000:3.0:1783074216.712446:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783074216.712453:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712460:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074216.712464:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712473:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712473:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783074216.712481:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074216.712483:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074216.712495:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074216.712503:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074216.712507:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712516:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712519:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074216.712526:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712527:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074216.712537:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074216.712537:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783074216.712559:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6c00/0x5fb609b3016e0777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e077e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712562:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712572:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074216.712575:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783074216.712580:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712587:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712588:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074216.712594:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712600:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c9600/0x5fb609b3016e0769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0770 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712605:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.712614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1783074216.712618:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:3.0:1783074216.712619:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712623:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074216.712630:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074216.712639:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074216.712643:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712654:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712668:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074216.712668:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712678:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074216.712680:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712695:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc7a00/0x5fb609b3016e073f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0746 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074216.712696:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783074216.712710:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783074216.712716:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712724:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074216.712731:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712747:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c9c00/0x5fb609b3016e0723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e072a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712756:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074216.712759:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712765:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074216.712768:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712775:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074216.712781:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074216.712797:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074216.712812:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712818:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074216.712823:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712837:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c8c00/0x5fb609b3016e0620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0627 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.712848:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074216.712850:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074216.712852:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074216.712867:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723634944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074216.712907:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074216.712934:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723635456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074216.712941:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103552 00000100:00100000:1.0:1783074216.712946:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103552 00010000:00010000:3.0:1783074216.712959:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.712960:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783074216.712964:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.712975:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1783074216.712981:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.712984:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783074216.712993:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.712994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723634944 00000100:00100000:0.0:1783074216.712996:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723635328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074216.713000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723634944 10000000:00010000:3.0:1783074216.713010:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074216.713016:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074216.713018:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 24 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.713028:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783074216.713052:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.713058:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783074216.713063:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.713067:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e06f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e06f9 expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.713071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635456 00000100:00100000:0.0:1783074216.713071:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635328 00000100:00100000:1.0:1783074216.713077:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635456 00000100:00100000:0.0:1783074216.713078:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635328 00010000:00010000:3.0:1783074216.713079:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074216.713083:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074216.713085:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074216.713100:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2617 00010000:00010000:1.0:1783074216.713100:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 26 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.713102:0:7930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 26 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074216.713113:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708103552:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783074216.713125:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783074216.713136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00010000:00010000:3.0:1783074216.713140:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.713149:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3661:x1869685723634944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783074216.713155:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.713160:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074216.713169:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 26 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074216.713172:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074216.713181:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 26 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.713191:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074216.713204:0:95190:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074216.713208:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708103552:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 96us (598us total) trans 0 rc 0/0 00010000:00010000:2.0:1783074216.713222:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7600/0x5fb609b3016e07f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b322 expref: 10 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.713222:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3661:x1869685723634944:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074216.713234:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633152:192.168.204.26@tcp:104: 00010000:00010000:2.0:1783074216.713242:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7000/0x5fb609b3016e07e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b314 expref: 9 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.713249:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633280:192.168.204.26@tcp:104: 00010000:00010000:2.0:1783074216.713256:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6a00/0x5fb609b3016e07d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e07cb expref: 26 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.713262:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633408:0@lo:104: 00010000:00010000:2.0:1783074216.713268:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28ea00/0x5fb609b3016e07a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e07a1 expref: 25 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.713274:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633536:0@lo:104: 00010000:00010000:2.0:1783074216.713279:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28ec00/0x5fb609b3016e079a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0793 expref: 24 pid: 94276 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.713284:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633664:0@lo:104: 00010000:00010000:2.0:1783074216.713290:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df2c8800/0x5fb609b3016e077e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0777 expref: 23 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074216.713296:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723633920:0@lo:104: 00000100:00100000:2.0:1783074216.713324:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634176:0@lo:104: 00000100:00100000:2.0:1783074216.713333:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634304:0@lo:104: 00000100:00100000:2.0:1783074216.713339:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634560:0@lo:104: 00000100:00100000:2.0:1783074216.713344:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634688:0@lo:104: 00000100:00100000:2.0:1783074216.713349:0:95190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95190:1869685723634816:0@lo:104: 00010000:00010000:2.0:1783074216.713378:0:95190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.713557:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:3.0:1783074216.713568:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2617 00000100:00100000:0.0:1783074216.713569:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3661:x1869685723635456:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074216.713578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00010000:00010000:0.0:1783074216.713587:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074216.713595:0:7930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 21 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.713600:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00010000:00010000:0.0:1783074216.713611:0:7930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 21 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.713612:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723635328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074216.713626:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074216.713631:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc7400/0x5fb609b3016e0627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0620 expref: 21 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.713634:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 21 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074216.713647:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074216.713651:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 20 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.713666:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6400/0x5fb609b3016e072a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0723 expref: 20 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.713683:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074216.713684:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074216.713690:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3661:x1869685723635456:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (729us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074216.713693:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074216.713700:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:1.0:1783074216.713716:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:3661:x1869685723635328:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074216.713724:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1783074216.713743:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723635072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074216.713770:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074216.713800:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723635200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074216.713804:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723635584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074216.713824:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635072 00000100:00100000:2.0:1783074216.713829:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635072 00000100:00100000:3.0:1783074216.713843:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074216.713849:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 18 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074216.713857:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723635328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074216.713872:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635200 00000100:00100000:2.0:1783074216.713876:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635200 00010000:00010000:2.0:1783074216.713889:0:19651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e073f expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.713901:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1783074216.713905:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1783074216.713908:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3658:x1869685723635072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074216.713910:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+19:3659:x1869685723635200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074216.713916:0:19651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074216.713916:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074216.713920:0:19651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e073f expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.713920:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.713928:0:19651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e073f expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714012:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.714051:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df2c9200/0x5fb609b3016e0746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e073f expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714052:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670c00/0x5fb609b3016e0770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0769 expref: 19 pid: 94277 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714061:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074216.714063:0:19651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074216.714109:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723634944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074216.714136:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723634048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074216.714139:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723635456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074216.714144:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+17:3658:x1869685723635072:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074216.714153:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1783074216.714160:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:522b6a34-04f4-4017-ab45-61a21d19bfef+17:3659:x1869685723635200:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074216.714166:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:3.0:1783074216.714178:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723635200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074216.714192:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074216.714221:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635584 00000100:00100000:0.0:1783074216.714224:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723635072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074216.714226:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635584 00010000:00010000:1.0:1783074216.714241:0:19658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 16 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.714263:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1783074216.714270:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+16:3658:x1869685723635584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074216.714286:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783074216.714289:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723634432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074216.714293:0:19658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 16 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714305:0:19658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 16 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714333:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28e400/0x5fb609b3016e06f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e06f2 expref: 16 pid: 94278 timeout: 3155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714344:0:19658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714352:0:19658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714364:0:19658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714371:0:19658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714378:0:19658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714384:0:19658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714389:0:19658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671200 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:1.0:1783074216.714392:0:19658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714405:0:19658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714417:0:19658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074216.714427:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074216.714437:0:95190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.714445:0:95190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074216.714451:0:95190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671200/0x5fb609b3016e0ad4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074216.714458:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+15:3658:x1869685723635584:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074216.714463:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1783074216.714494:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723635584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074216.943776:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074216.943816:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074216.943841:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103680 00000100:00100000:1.0:1783074216.943850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074216.943851:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103680 00000100:00100000:2.0:1783074216.943872:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103936 00000100:00100000:2.0:1783074216.943877:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103936 00000100:00100000:1.0:1783074216.943889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074216.943913:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:2.0:1783074216.943921:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708103808 00000100:00100000:2.0:1783074216.943926:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708103808 00000100:00100000:1.0:1783074216.943926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074216.943928:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:2403:x1869685708103680:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074216.943950:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 892 00000100:00080000:1.0:1783074216.943954:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074216.943960:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2403:x1869685708103936:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1783074216.943960:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074216.943977:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104192 00000100:00100000:1.0:1783074216.943982:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104192 00000100:00100000:2.0:1783074216.944010:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2403:x1869685708103936:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074216.944011:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:2403:x1869685708103680:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074216.944019:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 892 00000100:00100000:0.0:1783074216.944037:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:2.0:1783074216.944059:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 893 00000100:00100000:3.0:1783074216.944063:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104064 00000100:00100000:3.0:1783074216.944069:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104064 00000100:00100000:2.0:1783074216.944069:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2403:x1869685708103808:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074216.944097:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2403:x1869685708103808:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074216.944112:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2201 00000100:00100000:2.0:1783074216.944121:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 893 00000100:00100000:3.0:1783074216.944126:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708104064:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074216.944192:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2403:x1869685708104064:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00080000:0.0:1783074216.944199:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074216.944202:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2201 00000100:00080000:0.0:1783074216.944205:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074216.944416:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2202 00000100:00100000:1.0:1783074216.944424:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2403:x1869685708104192:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074216.944459:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2403:x1869685708104192:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074216.944467:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2202 00010000:00010000:0.0:1783074217.582566:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074218.158975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074218.159172:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104320 00000100:00100000:3.0:1783074218.159182:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104320 00000100:00100000:3.0:1783074218.159279:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:3.0:1783074218.159289:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708104320:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074218.159347:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074218.159367:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b36f expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.159394:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.159404:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.159412:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144400, rc 0) 00000100:00100000:3.0:1783074218.159468:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708104320:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 180us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.159475:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:2.0:1783074218.162572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074218.162646:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104448 00000100:00100000:3.0:1783074218.162653:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104448 00000100:00100000:3.0:1783074218.162695:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:3.0:1783074218.162703:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708104448:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.162831:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708104448:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 129us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.162839:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1783074218.165541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074218.165582:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104576 00000100:00100000:3.0:1783074218.165588:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104576 00000100:00100000:3.0:1783074218.165636:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:3.0:1783074218.165644:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708104576:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.165756:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708104576:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.165770:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:1.0:1783074218.168118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074218.168215:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104704 00000100:00100000:0.0:1783074218.168222:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104704 00000100:00100000:0.0:1783074218.168262:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:0.0:1783074218.168271:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73237:x1869685708104704:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783074218.168426:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73237:x1869685708104704:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 156us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.168436:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:2.0:1783074218.169760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074218.169797:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104832 00000100:00100000:3.0:1783074218.169803:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104832 00000100:00100000:3.0:1783074218.169840:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:3.0:1783074218.169849:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73237:x1869685708104832:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783074218.169943:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73237:x1869685708104832:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 95us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.169951:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:2.0:1783074218.171034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074218.171108:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708104960 00000100:00100000:0.0:1783074218.171113:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708104960 00000100:00100000:0.0:1783074218.171149:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1783074218.171157:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708104960:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074218.171168:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074218.171183:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b376 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.171221:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 10 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.171231:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 10 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.171240:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299200, rc 0) 00000100:00100000:0.0:1783074218.171306:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708104960:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 149us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.171336:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:1.0:1783074218.172291:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074218.172361:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105088 00000100:00100000:2.0:1783074218.172367:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105088 00000100:00100000:2.0:1783074218.172400:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1783074218.172408:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708105088:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.172488:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708105088:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 81us (198us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074218.172505:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 10000000:01000000:0.0:1783074218.542428:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074218.542437:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6cae000 from 58 10000000:01000000:0.0:1783074218.542443:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074218.542491:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.542504:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.542515:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074218.542541:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723635712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.542603:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.542639:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e0134c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.542673:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635712 00000100:00100000:1.0:1783074218.542702:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635712 00000100:00100000:1.0:1783074218.542761:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783074218.542771:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723635712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074218.542785:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074218.542798:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0ae9 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.542829:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 16 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.542839:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 16 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.542847:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158800, rc 0) 00000100:00100000:1.0:1783074218.542885:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723635712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.542890:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783074218.542923:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723635712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074218.542936:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.542948:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074218.543013:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723635840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.543032:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.543045:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e0134c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074218.543071:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635840 00000100:00100000:2.0:1783074218.543075:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635840 00000100:00100000:2.0:1783074218.543104:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783074218.543111:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723635840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.543218:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723635840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.543222:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783074218.543260:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723635840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.543288:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723635968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.543347:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.543370:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e0134c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.543382:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723635968 00000100:00100000:1.0:1783074218.543440:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723635968 00000100:00100000:1.0:1783074218.543475:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783074218.543481:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723635968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.543722:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723635968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.543730:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783074218.543792:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723635968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.544131:0:95194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95194:1869685723636096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.544166:0:95194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.544183:0:95194:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.544213:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636096 00000100:00100000:3.0:1783074218.544219:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636096 00000100:00100000:3.0:1783074218.544292:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783074218.544301:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95194:x1869685723636096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074218.544447:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95194:x1869685723636096:12345-0@lo:502:llog_process_th.0 Request processed in 148us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.544454:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783074218.544490:0:95194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95194:1869685723636096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.544541:0:95194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95194:1869685723636224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.544578:0:95194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.544608:0:95194:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.544638:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636224 00000100:00100000:1.0:1783074218.544644:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636224 00000100:00100000:1.0:1783074218.544715:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783074218.544723:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95194:x1869685723636224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.544798:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95194:x1869685723636224:12345-0@lo:502:llog_process_th.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.544806:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783074218.544918:0:95194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95194:1869685723636224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074218.544936:0:95194:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1783074218.545165:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1783074218.545183:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074218.545192:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.545201:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074218.545209:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783074218.545212:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:1.0:1783074218.545215:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783074218.545234:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.545242:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.545249:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074218.545262:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.545287:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.545687:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636352 00000100:00100000:0.0:1783074218.545692:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636352 00000100:00100000:1.0:1783074218.545761:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.545787:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783074218.545796:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723636352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074218.545804:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074218.545814:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0af7 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.545833:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 17 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.545841:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 17 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.545859:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298600, rc 0) 00000100:00100000:0.0:1783074218.545894:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723636352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.545900:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783074218.545943:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074218.545955:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.545970:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074218.546038:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.546070:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074218.546131:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.546166:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636480 00000100:00100000:3.0:1783074218.546170:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636480 00000100:00100000:3.0:1783074218.546196:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783074218.546202:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723636480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.546358:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723636480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.546365:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783074218.546431:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.546454:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.546487:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074218.546513:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.546541:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636608 00000100:00100000:0.0:1783074218.546546:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636608 00000100:00100000:0.0:1783074218.546577:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783074218.546584:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723636608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.546655:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723636608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.546663:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783074218.546687:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.547564:0:95195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95195:1869685723636736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.547595:0:95195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.547617:0:95195:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.547640:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636736 00000100:00100000:3.0:1783074218.547645:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636736 00000100:00100000:3.0:1783074218.547680:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783074218.547693:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95195:x1869685723636736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074218.547792:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95195:x1869685723636736:12345-0@lo:502:llog_process_th.0 Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.547797:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783074218.547876:0:95195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95195:1869685723636736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074218.547894:0:95195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074218.547902:0:95195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074218.547904:0:95195:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783074218.547907:0:95195:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1783074218.547922:0:95195:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000020:01000004:0.0:1783074218.548377:0:95196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9524c6cae000 from lustre-MDT0000, refs=4 00000100:00100000:2.0:1783074218.548386:0:95195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95195:1869685723636864:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783074218.548389:0:95196:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524c6cae000 4 00000100:00100000:2.0:1783074218.548421:0:95195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.548454:0:95195:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.548505:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636864 00000100:00100000:1.0:1783074218.548510:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636864 00000100:00100000:1.0:1783074218.548589:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783074218.548597:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95195:x1869685723636864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.548695:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95195:x1869685723636864:12345-0@lo:502:llog_process_th.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.548702:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783074218.548761:0:95195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95195:1869685723636864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074218.548781:0:95195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074218.548786:0:95195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074218.548787:0:95195:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783074218.548791:0:95195:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:0.0:1783074218.548857:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:0.0:1783074218.548878:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783074218.548887:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.548897:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074218.548906:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074218.548908:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 58 10000000:01000000:0.0:1783074218.548910:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074218.548931:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.548939:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.548955:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074218.548980:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.549019:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.549039:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.549062:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723636992 00000100:00100000:3.0:1783074218.549067:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723636992 00000100:00100000:3.0:1783074218.549096:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783074218.549102:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723636992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074218.549109:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074218.549118:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b05 expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.549141:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 18 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.549152:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 18 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.549218:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145c00, rc 0) 00000100:00100000:3.0:1783074218.549276:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723636992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.549283:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723636992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.549287:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:0.0:1783074218.549302:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.549341:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074218.549386:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.549411:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074218.549438:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637120 00000100:00100000:1.0:1783074218.549443:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637120 00000100:00100000:0.0:1783074218.549445:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.549475:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783074218.549483:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723637120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.549570:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723637120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.549587:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783074218.549604:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.549707:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.549740:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.549765:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c8654a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.549807:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637248 00000100:00100000:3.0:1783074218.549811:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637248 00000100:00100000:3.0:1783074218.549841:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783074218.549848:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723637248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.549958:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723637248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.549967:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783074218.550060:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.550521:0:95197:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95197:1869685723637376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.550550:0:95197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.550567:0:95197:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.550743:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637376 00000100:00100000:1.0:1783074218.550758:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637376 00000100:00100000:1.0:1783074218.550786:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783074218.550793:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95197:x1869685723637376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.550886:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95197:x1869685723637376:12345-0@lo:502:llog_process_th.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.550893:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783074218.550915:0:95197:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95197:1869685723637376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.550963:0:95197:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95197:1869685723637504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.551006:0:95197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.551027:0:95197:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.551070:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637504 00000100:00100000:3.0:1783074218.551074:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637504 00000100:00100000:3.0:1783074218.551137:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783074218.551145:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95197:x1869685723637504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074218.551224:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95197:x1869685723637504:12345-0@lo:502:llog_process_th.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.551231:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783074218.551287:0:95197:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95197:1869685723637504:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074218.551305:0:95197:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1783074218.551407:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1783074218.551425:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783074218.551433:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.551447:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074218.551455:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783074218.551458:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:0.0:1783074218.551460:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783074218.551478:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.551486:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.551494:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074218.551507:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.551533:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.551554:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e0134c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.551575:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637632 00000100:00100000:1.0:1783074218.551580:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637632 00000100:00100000:1.0:1783074218.551607:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783074218.551613:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723637632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074218.551622:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074218.551633:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b13 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.551652:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 19 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.551662:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 19 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.551670:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158e00, rc 0) 00000100:00100000:1.0:1783074218.551806:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723637632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.551812:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783074218.551869:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074218.551881:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.551888:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.551925:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.551948:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.551971:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.552033:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637760 00000100:00100000:3.0:1783074218.552037:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637760 00000100:00100000:3.0:1783074218.552103:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783074218.552110:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723637760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.552221:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723637760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.552228:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783074218.552285:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.552334:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.552370:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.552516:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.552542:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723637888 00000100:00100000:0.0:1783074218.552547:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723637888 00000100:00100000:0.0:1783074218.552567:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783074218.552573:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723637888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.552649:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723637888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.552657:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783074218.552676:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723637888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.553059:0:95198:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95198:1869685723638016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074218.553094:0:95198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.553166:0:95198:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c62bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.553196:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638016 00000100:00100000:1.0:1783074218.553206:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638016 00000100:00100000:1.0:1783074218.553240:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783074218.553247:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95198:x1869685723638016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074218.553355:0:95198:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95198:1869685723638016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.553357:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95198:x1869685723638016:12345-0@lo:502:llog_process_th.0 Request processed in 108us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.553368:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000020:01000000:0.0:1783074218.553385:0:95198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783074218.553397:0:95198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074218.553400:0:95198:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1783074218.553407:0:95198:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1783074218.553428:0:95198:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1783074218.553448:0:95198:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95198:1869685723638144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074218.553491:0:95198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074218.553512:0:95198:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2eecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.553533:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638144 00000100:00100000:3.0:1783074218.553538:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638144 00000100:00100000:3.0:1783074218.553565:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783074218.553574:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95198:x1869685723638144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074218.553856:0:95198:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95198:1869685723638144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074218.553871:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95198:x1869685723638144:12345-0@lo:502:llog_process_th.0 Request processed in 294us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.553877:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000020:01000000:0.0:1783074218.553891:0:95198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074218.553897:0:95198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074218.553898:0:95198:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783074218.553903:0:95198:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:2.0:1783074218.553976:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:2.0:1783074218.554010:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783074218.554017:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.554032:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074218.554038:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783074218.554040:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 58 10000000:01000000:2.0:1783074218.554041:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783074218.554055:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.554060:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.554065:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.554073:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.554093:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.554113:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.554135:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638272 00000100:00100000:1.0:1783074218.554139:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638272 00000100:00100000:1.0:1783074218.554172:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783074218.554179:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723638272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074218.554187:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074218.554196:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b21 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.554214:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 20 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.554222:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 20 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074218.554230:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159e00, rc 0) 00000100:00100000:1.0:1783074218.554265:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723638272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.554271:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783074218.554350:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074218.554362:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.554371:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.554407:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.554429:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.554457:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.554494:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638400 00000100:00100000:3.0:1783074218.554499:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638400 00000100:00100000:3.0:1783074218.554535:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783074218.554543:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723638400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.554635:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723638400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.554642:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783074218.554666:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.554689:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.554729:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.554759:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.554768:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638528 00000100:00100000:1.0:1783074218.554773:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638528 00000100:00100000:1.0:1783074218.554792:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783074218.554798:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723638528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.554874:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723638528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.554879:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783074218.555029:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.555809:0:95199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95199:1869685723638656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.555905:0:95199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074218.555934:0:95199:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a3540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.556006:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638656 00000100:00100000:3.0:1783074218.556010:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638656 00000100:00100000:3.0:1783074218.556046:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783074218.556052:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95199:x1869685723638656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074218.556157:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95199:x1869685723638656:12345-0@lo:502:llog_process_th.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.556164:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783074218.556455:0:95199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95199:1869685723638656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.556491:0:95199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95199:1869685723638784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074218.556523:0:95199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074218.556572:0:95199:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c23a3540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.556605:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638784 00000100:00100000:0.0:1783074218.556609:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638784 00000100:00100000:0.0:1783074218.556638:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783074218.556644:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95199:x1869685723638784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074218.556705:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95199:x1869685723638784:12345-0@lo:502:llog_process_th.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.556712:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783074218.556785:0:95199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95199:1869685723638784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783074218.556802:0:95199:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1783074218.556910:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1783074218.556927:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074218.556934:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.556940:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074218.556946:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783074218.556948:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783074218.556950:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783074218.556965:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.556970:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.556975:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.556983:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.557030:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.557057:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.557077:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723638912 00000100:00100000:0.0:1783074218.557085:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723638912 00000100:00100000:0.0:1783074218.557121:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783074218.557130:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723638912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074218.557139:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074218.557159:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b2f expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.557182:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 21 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.557192:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 21 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.557200:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298400, rc 0) 00000100:00100000:0.0:1783074218.557242:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723638912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.557249:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783074218.557269:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723638912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074218.557283:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.557289:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.557349:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.557373:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.557389:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.557411:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639040 00000100:00100000:0.0:1783074218.557416:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639040 00000100:00100000:0.0:1783074218.557454:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783074218.557463:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723639040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.557583:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723639040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.557591:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783074218.557617:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.557641:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.557677:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.557693:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.557713:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639168 00000100:00100000:0.0:1783074218.557717:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639168 00000100:00100000:0.0:1783074218.557745:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783074218.557752:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723639168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.557820:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723639168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.557827:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783074218.557846:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783074218.558581:0:95200:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783074218.558827:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783074218.558839:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783074218.558851:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.558863:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074218.558872:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783074218.558874:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 58 10000000:01000000:2.0:1783074218.558876:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783074218.558902:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.558909:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.558915:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.558925:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.558948:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.558973:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.559021:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639296 00000100:00100000:3.0:1783074218.559025:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639296 00000100:00100000:3.0:1783074218.559047:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783074218.559052:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723639296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074218.559058:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074218.559074:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b3d expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.559091:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 22 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.559100:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 22 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.559107:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144a00, rc 0) 00000100:00100000:3.0:1783074218.559167:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723639296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.559178:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.559190:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:2.0:1783074218.559195:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.559205:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.559245:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.559271:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.559289:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.559336:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639424 00000100:00100000:0.0:1783074218.559341:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639424 00000100:00100000:0.0:1783074218.559363:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783074218.559371:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723639424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074218.559493:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723639424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.559501:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783074218.559547:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.559572:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.559782:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.559811:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783074218.559819:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639552 00000100:00100000:2.0:1783074218.559824:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639552 00000100:00100000:2.0:1783074218.559886:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783074218.559893:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723639552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.559975:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723639552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.559991:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783074218.560024:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.560423:0:95201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95201:1869685723639680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.560449:0:95201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.560473:0:95201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.560534:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639680 00000100:00100000:0.0:1783074218.560538:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639680 00000100:00100000:0.0:1783074218.560557:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783074218.560562:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95201:x1869685723639680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074218.560636:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95201:x1869685723639680:12345-0@lo:502:llog_process_th.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.560643:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783074218.560685:0:95201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95201:1869685723639680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.560733:0:95201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95201:1869685723639808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074218.560801:0:95201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.560822:0:95201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.560955:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639808 00000100:00100000:3.0:1783074218.560960:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639808 00000100:00100000:3.0:1783074218.560992:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783074218.561011:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95201:x1869685723639808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074218.561103:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95201:x1869685723639808:12345-0@lo:502:llog_process_th.0 Request processed in 93us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.561111:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783074218.561391:0:95201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95201:1869685723639808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074218.561410:0:95201:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1783074218.561535:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1783074218.561563:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074218.561572:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.561582:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074218.561590:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783074218.561592:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783074218.561595:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783074218.561614:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.561633:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.561640:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074218.561653:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.561678:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.561707:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074218.561718:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723639936 00000100:00100000:0.0:1783074218.561723:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723639936 00000100:00100000:0.0:1783074218.561757:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783074218.561764:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723639936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074218.561772:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074218.561783:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b4b expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.561814:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.561824:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074218.561843:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299000, rc 0) 00000100:00100000:0.0:1783074218.561878:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723639936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074218.561885:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783074218.562170:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723639936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074218.562182:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.562190:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074218.562228:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.562262:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.562286:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074218.562852:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640064 00000100:00100000:2.0:1783074218.562856:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640064 00000100:00100000:2.0:1783074218.562891:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783074218.562898:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723640064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.563027:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723640064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.563033:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783074218.563340:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.563373:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074218.563412:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.563443:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.563752:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640192 00000100:00100000:1.0:1783074218.563757:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640192 00000100:00100000:1.0:1783074218.563833:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783074218.563842:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723640192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.563932:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723640192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.563939:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783074218.564024:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783074218.564832:0:95202:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783074218.564910:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783074218.564929:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783074218.564936:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.564943:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074218.564958:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783074218.564960:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:2.0:1783074218.564962:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783074218.564981:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.564986:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.564992:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.565015:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.565039:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.565073:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074218.565077:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640320 00000100:00100000:3.0:1783074218.565082:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640320 00000100:00100000:3.0:1783074218.565115:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783074218.565121:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723640320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074218.565129:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074218.565140:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b59 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.565157:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.565165:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.565172:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144000, rc 0) 00000100:00100000:3.0:1783074218.565216:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723640320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.565221:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783074218.565252:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074218.565264:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.565273:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074218.565367:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074218.565460:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.565486:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c32a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1783074218.565503:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640448 00000100:00100000:1.0:1783074218.565509:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640448 00000100:00100000:1.0:1783074218.565545:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783074218.565562:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723640448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074218.565631:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723640448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (170us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783074218.565655:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783074218.565666:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723640448:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783074218.565694:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783074218.565706:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074218.565715:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074218.608195:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074218.926551:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723640704:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.926620:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.926666:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723641216:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.926705:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723640576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074218.926758:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.926784:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723641728:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.926803:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.926849:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723641088:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.926873:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.926886:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723640960:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.926903:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723642240:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.926916:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.926949:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.926968:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723641472:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.926982:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783074218.926999:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723640832:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927026:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.927035:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.927058:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723641984:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.927066:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723641344:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927093:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.927176:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723642496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074218.927199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.927218:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640576 00000100:00100000:3.0:1783074218.927226:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640576 00000100:00100000:2.0:1783074218.927230:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723641856:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.927260:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.927282:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074218.927291:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:2.0:1783074218.927292:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723642368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074218.927305:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723640576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783074218.927363:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074218.927413:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723640576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.927420:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.927425:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:3.0:1783074218.927446:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642368 00000100:00100000:3.0:1783074218.927451:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642368 00000100:00100000:2.0:1783074218.927465:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640704 00000100:00100000:2.0:1783074218.927470:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640704 00000100:00100000:3.0:1783074218.927480:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:3.0:1783074218.927490:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723642368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783074218.927508:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783074218.927514:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783074218.927523:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723640704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074218.927552:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641472 00000100:00100000:3.0:1783074218.927557:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723642368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.927557:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641472 00000100:00100000:3.0:1783074218.927564:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1783074218.927574:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723640704:12345-0@lo:400:kworker.0 Request processed in 51us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.927583:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783074218.927585:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641216 00000100:00100000:1.0:1783074218.927587:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641984 00000100:00100000:3.0:1783074218.927590:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641216 00000100:00100000:1.0:1783074218.927590:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641984 00000100:00100000:1.0:1783074218.927614:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1783074218.927621:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641728 00000100:00100000:1.0:1783074218.927622:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723641472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.927628:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641728 00000100:00100000:3.0:1783074218.927629:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640960 00000100:00100000:3.0:1783074218.927634:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640960 00000100:00100000:2.0:1783074218.927656:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642240 00000100:00100000:3.0:1783074218.927659:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723640832 00000100:00100000:2.0:1783074218.927661:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642240 00000100:00100000:3.0:1783074218.927664:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723640832 00000100:00100000:1.0:1783074218.927673:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723641472:12345-0@lo:400:kworker.0 Request processed in 53us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.927679:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1783074218.927688:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1783074218.927694:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:3.0:1783074218.927696:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1783074218.927704:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723641728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074218.927704:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723641984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074218.927740:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723641984:12345-0@lo:400:kworker.0 Request processed in 39us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.927743:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723641728:12345-0@lo:400:kworker.0 Request processed in 42us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.927746:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:3.0:1783074218.927755:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1783074218.927766:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1783074218.927772:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723641216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927777:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723640960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927817:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869685723640960:12345-0@lo:400:kworker.0 Request processed in 44us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.927821:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1783074218.927829:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1783074218.927832:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927850:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723642240:12345-0@lo:400:kworker.0 Request processed in 17us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.927853:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1783074218.927858:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1783074218.927861:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869685723640832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927875:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869685723640832:12345-0@lo:400:kworker.0 Request processed in 14us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.927878:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:3.0:1783074218.927890:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783074218.927893:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783074218.927894:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783074218.927896:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783074218.927927:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.927960:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723641600:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.927985:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.928019:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723642112:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928040:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074218.928075:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723642624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074218.928090:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.928143:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723641216:12345-0@lo:400:kworker.0 Request processed in 446us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.928151:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1783074218.928167:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641088 00000100:00100000:1.0:1783074218.928172:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641088 00000100:00100000:2.0:1783074218.928195:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641344 00000100:00100000:2.0:1783074218.928200:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641344 00000100:00100000:1.0:1783074218.928210:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1783074218.928220:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723641088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.928232:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641856 00000100:00100000:2.0:1783074218.928237:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641856 00000100:00100000:1.0:1783074218.928251:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869685723641088:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.928253:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642624 00000100:00100000:2.0:1783074218.928258:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642624 00000100:00100000:1.0:1783074218.928258:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1783074218.928283:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1783074218.928290:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723641344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928308:0:3659:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968716 gen 2 00000100:00100000:3.0:1783074218.928349:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723640576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783074218.928365:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723641344:12345-0@lo:400:kworker.0 Request processed in 73us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.928370:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869685723641088:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.928377:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1783074218.928397:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1783074218.928405:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723641856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928409:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723641600 00000100:00100000:3.0:1783074218.928414:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723641600 00000100:00100000:2.0:1783074218.928436:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723641856:12345-0@lo:400:kworker.0 Request processed in 31us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.928446:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642112 00000100:00100000:2.0:1783074218.928451:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1783074218.928452:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642112 00000100:00100000:2.0:1783074218.928474:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:1.0:1783074218.928477:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1783074218.928486:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723642624:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074218.928490:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:1.0:1783074218.928491:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723641600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928499:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723642112:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1783074218.928513:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444663296 avail 1298423808 00000100:00100000:1.0:1783074218.928531:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723641600:12345-0@lo:400:kworker.0 Request processed in 44us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.928539:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723642112:12345-0@lo:400:kworker.0 Request processed in 40us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074218.928546:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:1.0:1783074218.928553:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1783074218.928561:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723642624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074218.928569:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00080000:3.0:1783074218.928571:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783074218.928577:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783074218.928588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074218.928602:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642496 00000100:00100000:2.0:1783074218.928607:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642496 00000100:00100000:3.0:1783074218.928629:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869685723640960:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.928641:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:3.0:1783074218.928645:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723641472:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.928651:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723642496:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074218.928656:0:3658:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968719 gen 2 00000100:00100000:3.0:1783074218.928668:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723641984:0@lo:400:kworker.0 00000004:00000024:2.0:1783074218.928670:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:3.0:1783074218.928703:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c2143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723642624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074218.928710:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723641600:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928715:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723642112:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.928790:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723642496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074218.928864:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723642496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074218.928871:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723642368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074218.928886:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869685723640832:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928892:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723641344:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928898:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723641856:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928903:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723640704:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928912:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723641216:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928921:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723641728:0@lo:400:kworker.0 00000100:00100000:3.0:1783074218.928934:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723642240:0@lo:400:kworker.0 00000100:00100000:2.0:1783074218.928934:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1783074219.438431:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783074219.438450:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723642880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074219.438513:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.438548:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723642752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783074219.438563:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642880 00000100:00100000:0.0:1783074219.438571:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642880 00000100:00100000:1.0:1783074219.438576:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.438609:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723642752 00000100:00100000:1.0:1783074219.438613:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723642752 00000100:00100000:0.0:1783074219.438623:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:0.0:1783074219.438636:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723642880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074219.438659:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074219.438674:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:1.0:1783074219.438684:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723642752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783074219.438697:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074219.438717:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723642880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.438726:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00100000:1.0:1783074219.438736:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723642752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.438743:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1783074219.438788:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723642880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074219.438803:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c20c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723642752:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1783074219.508653:0:95300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffdcd24f040 20000000:00000080:0.0:1783074219.508668:0:95300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9523c467dc00 uarg=0000000000000000 00000040:00100000:0.0:1783074219.509989:0:95300:0:(llog.c:1067:llog_reverse_process()) index 60 : idx 49 20000000:01000000:0.0:1783074219.509996:0:95300:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1783074219.510011:0:95300:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783074219.510413:0:95301:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 43 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:0.0:1783074219.510467:0:95301:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 54 marker 43 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:0.0:1783074219.510495:0:95301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:2.0:1783074219.510932:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:2.0:1783074219.510947:0:95300:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783074219.510960:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:2.0:1783074219.510975:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:2.0:1783074219.511004:0:95300:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1783074219.511364:0:95302:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:2.0:1783074219.511400:0:95302:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:2.0:1783074219.511419:0:95302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:0.0:1783074219.511563:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:0.0:1783074219.511574:0:95300:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:0.0:1783074219.511596:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:0.0:1783074219.511627:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:0.0:1783074219.511643:0:95300:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783074219.512225:0:95303:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 45 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1783074219.512251:0:95303:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 45 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1783074219.512261:0:95303:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:2.0:1783074219.512403:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:2.0:1783074219.512413:0:95300:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783074219.512426:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:2.0:1783074219.512438:0:95300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:2.0:1783074219.512458:0:95300:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783074219.512475:0:95300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512498:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512506:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512514:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512521:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512527:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512533:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512540:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512547:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512553:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512560:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512573:0:95300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512581:0:95300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512615:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512628:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 23 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.512640:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524faba9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643008:0@lo:104: 00000100:00100000:2.0:1783074219.512696:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.512739:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512747:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 23 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.512754:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fabaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643136:0@lo:104: 00000100:00100000:2.0:1783074219.512770:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.512796:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512803:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 23 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.512811:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643264:0@lo:104: 00000100:00100000:2.0:1783074219.512845:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.512870:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512877:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 23 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.512884:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643392:0@lo:104: 00000100:00100000:2.0:1783074219.512899:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.512909:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512915:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 23 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.512922:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643520:0@lo:104: 00000100:00100000:2.0:1783074219.512934:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.512947:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.512954:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 23 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.512961:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643648:0@lo:104: 00000100:00100000:2.0:1783074219.512973:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.512998:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.513006:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 23 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.513023:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643008 00000100:00100000:2.0:1783074219.513024:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643776:0@lo:104: 00000100:00100000:3.0:1783074219.513029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643008 00000100:00100000:2.0:1783074219.513047:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783074219.513061:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.513066:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1783074219.513069:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 23 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.513077:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643904:0@lo:104: 00000100:00100000:3.0:1783074219.513082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643136 00000100:00100000:3.0:1783074219.513084:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643136 00000100:00100000:3.0:1783074219.513096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643264 00000100:00100000:2.0:1783074219.513096:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.513098:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643264 00000100:00100000:3.0:1783074219.513106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643392 00000100:00100000:3.0:1783074219.513108:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643392 00000100:00100000:3.0:1783074219.513118:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643520 00000100:00100000:3.0:1783074219.513120:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643520 00010000:00010000:2.0:1783074219.513123:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 23 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.513128:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643648 00000100:00100000:3.0:1783074219.513130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643648 00010000:00010000:2.0:1783074219.513131:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 23 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.513137:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643776 00000100:00100000:3.0:1783074219.513138:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643776 00000100:00100000:2.0:1783074219.513140:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723644032:0@lo:104: 00000100:00100000:3.0:1783074219.513147:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723643904 00000100:00100000:3.0:1783074219.513149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723643904 00000100:00100000:2.0:1783074219.513160:0:95300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.513162:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644032 00000100:00100000:0.0:1783074219.513164:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1783074219.513171:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644032 00010000:00010000:2.0:1783074219.513177:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513179:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:95300:x1869685723643008:12345-0@lo:104: 00000100:00100000:3.0:1783074219.513190:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00010000:00010000:2.0:1783074219.513193:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 9 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.513197:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+11:95300:x1869685723643136:12345-0@lo:104: 00010000:00010000:0.0:1783074219.513199:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.513203:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723644160:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074219.513205:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.513573:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783074219.513581:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+11:95300:x1869685723643008:12345-0@lo:104: Request processed in 407us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.513588:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1783074219.513610:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1783074219.513617:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:95300:x1869685723643264:12345-0@lo:104: 00010000:00010000:0.0:1783074219.513625:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.513661:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783074219.513666:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+10:95300:x1869685723643264:12345-0@lo:104: Request processed in 51us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.513672:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:1.0:1783074219.513684:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783074219.513685:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00010000:00010000:1.0:1783074219.513690:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513691:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:95300:x1869685723643392:12345-0@lo:104: 00010000:00010000:1.0:1783074219.513698:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074219.513698:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074219.513702:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513710:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074219.513717:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.513728:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074219.513738:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783074219.513742:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+9:95300:x1869685723643392:12345-0@lo:104: Request processed in 53us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.513748:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:1.0:1783074219.513755:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513760:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00010000:00010000:1.0:1783074219.513761:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783074219.513765:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:95300:x1869685723643520:12345-0@lo:104: 00010000:00010000:0.0:1783074219.513771:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513780:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513786:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671a00/0x5fb609b3016e0b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b60 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513798:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074219.513799:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1783074219.513801:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513804:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+8:95300:x1869685723643520:12345-0@lo:104: Request processed in 39us (869us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074219.513808:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671e00 already unused, calling callback (ffffffffc125cc20) 00000100:00100000:0.0:1783074219.513810:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 10000000:00010000:1.0:1783074219.513811:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513817:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513820:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 10000000:00010000:1.0:1783074219.513824:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513826:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:95300:x1869685723643648:12345-0@lo:104: 10000000:01000000:1.0:1783074219.513829:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074219.513832:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513841:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513846:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783074219.513854:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783074219.513858:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+7:95300:x1869685723643648:12345-0@lo:104: Request processed in 33us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.513863:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:1.0:1783074219.513866:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513872:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671e00/0x5fb609b3016e0b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b44 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513874:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783074219.513879:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952501eda450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:95300:x1869685723643776:12345-0@lo:104: 00010000:00010000:1.0:1783074219.513881:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783074219.513884:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.513885:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513889:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074219.513892:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513898:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074219.513904:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.513910:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074219.513912:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783074219.513916:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952501eda450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+6:95300:x1869685723643776:12345-0@lo:104: Request processed in 38us (869us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074219.513922:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513922:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00010000:1.0:1783074219.513927:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783074219.513932:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00010000:00010000:1.0:1783074219.513933:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513938:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95300:x1869685723643904:12345-0@lo:104: 00010000:00010000:1.0:1783074219.513940:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b36 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.513944:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513948:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783074219.513955:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.513961:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074219.513964:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.513965:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783074219.513969:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+5:95300:x1869685723643904:12345-0@lo:104: Request processed in 32us (873us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074219.513971:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.513974:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 10000000:00010000:1.0:1783074219.513990:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.513996:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783074219.513997:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1783074219.514003:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95300:x1869685723644032:12345-0@lo:104: 00010000:00010000:1.0:1783074219.514010:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514010:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514017:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074219.514023:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514029:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb671600/0x5fb609b3016e0b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b28 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514033:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783074219.514037:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:95300:x1869685723644032:12345-0@lo:104: Request processed in 36us (878us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074219.514038:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783074219.514041:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514043:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00010000:00010000:1.0:1783074219.514047:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074219.514049:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514059:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783074219.514063:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514065:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074219.514072:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.514079:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783074219.514079:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074219.514082:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514087:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514091:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783074219.514094:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514096:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1783074219.514099:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074219.514101:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514107:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b1a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514110:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514115:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074219.514116:0:8460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074219.514119:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514120:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514125:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159800 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074219.514127:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b0c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074219.514128:0:8460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514135:0:8460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514136:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074219.514138:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074219.514141:0:8460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514143:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1783074219.514146:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.514150:0:8460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074219.514161:0:8460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514161:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514167:0:8460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1783074219.514168:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514172:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074219.514174:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783074219.514178:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524d3159800/0x5fb609b3016e0af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0afe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514183:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514186:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074219.514188:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074219.514189:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074219.514190:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074219.514193:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514199:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3298800/0x5fb609b3016e0ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0af0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514206:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074219.514207:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c47b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723644288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074219.514208:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074219.514209:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074219.514227:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723644416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074219.514237:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.514257:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644288 00000100:00100000:0.0:1783074219.514261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644288 00000100:00100000:1.0:1783074219.514272:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723644800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074219.514279:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 24 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514291:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.514298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644800 00000100:00100000:0.0:1783074219.514301:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644800 00000100:00100000:1.0:1783074219.514308:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:0.0:1783074219.514331:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 25 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514335:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723644672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074219.514356:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.514358:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1783074219.514365:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3661:x1869685723644288:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074219.514375:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723645184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074219.514377:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074219.514382:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 25 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514392:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 25 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514394:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074219.514406:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074219.514419:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644672 00000100:00100000:1.0:1783074219.514422:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644672 00000100:00100000:0.0:1783074219.514431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3661:x1869685723644288:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074219.514435:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514438:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1783074219.514448:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645184 00000100:00100000:0.0:1783074219.514450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645184 00010000:00010000:0.0:1783074219.514460:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514462:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1783074219.514467:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3661:x1869685723644800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.514474:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074219.514479:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514487:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514490:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1783074219.514495:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3661:x1869685723644672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.514497:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074219.514502:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074219.514506:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514514:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3661:x1869685723644800:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.514523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00010000:00010000:0.0:1783074219.514523:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074219.514535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1783074219.514540:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3661:x1869685723645184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074219.514546:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3661:x1869685723644672:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074219.514547:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074219.514551:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 25 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514552:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00010000:00010000:1.0:1783074219.514559:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 25 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514568:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074219.514587:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723645184:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.514593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1783074219.514597:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.514603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644416 00000100:00100000:1.0:1783074219.514612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644416 00000100:00100000:0.0:1783074219.514612:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723644928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.514626:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 24 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514633:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.514645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644928 00000100:00100000:1.0:1783074219.514648:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644928 00000100:00100000:0.0:1783074219.514654:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:1.0:1783074219.514658:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 25 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514659:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723644544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074219.514675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1783074219.514680:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.514682:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3658:x1869685723644416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.514690:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074219.514694:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 25 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514694:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723645056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.514702:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 25 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514711:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074219.514732:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.514735:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+25:3658:x1869685723644416:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.514742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00010000:00010000:3.0:1783074219.514744:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783074219.514753:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+3:95300:x1869685723643136:12345-0@lo:104: Request processed in 1555us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.514754:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723644416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074219.514768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1783074219.514783:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723644544 00000100:00100000:1.0:1783074219.514784:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645056 00000100:00100000:1.0:1783074219.514787:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645056 00000100:00100000:0.0:1783074219.514787:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723644544 00010000:00010000:1.0:1783074219.514803:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514803:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 26 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.514820:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783074219.514823:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00010000:00010000:3.0:1783074219.514827:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.514828:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1783074219.514831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3658:x1869685723644928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074219.514836:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3658:x1869685723645056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074219.514837:0:95300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514839:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074219.514845:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074219.514850:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 26 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.514850:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.514866:0:95300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514876:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 26 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.514878:0:95300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723645312:192.168.204.26@tcp:104: 00010000:00010000:3.0:1783074219.514897:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144200 already unused, calling callback (ffffffffc125cc20) 00010000:00010000:0.0:1783074219.514899:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 26 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074219.514903:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.514913:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074219.514913:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074219.514915:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783074219.514924:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.514926:0:95300:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46a80 going to sleep for 11 seconds 10000000:01000000:3.0:1783074219.514933:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783074219.514946:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144000/0x5fb609b3016e0b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b59 expref: 26 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514949:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3658:x1869685723644928:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.514950:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+26:3658:x1869685723645056:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (214us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074219.514960:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.514964:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1783074219.514967:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524faba9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643008:0@lo:104: 00000100:00100000:0.0:1783074219.514974:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00010000:00010000:3.0:1783074219.514989:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783074219.514995:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00010000:00010000:3.0:1783074219.515001:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.515003:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fabaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643136:0@lo:104: 00000100:00100000:1.0:1783074219.515005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723644544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074219.515017:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144a00/0x5fb609b3016e0b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b3d expref: 23 pid: 94276 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.515019:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074219.515021:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524e4144200/0x5fb609b3016e0b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0b52 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.515025:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723645056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.515027:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 23 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.515032:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643264:0@lo:104: 00000100:00100000:0.0:1783074219.515041:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723644928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.515047:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 22 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.515052:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c458ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643392:0@lo:104: 00010000:00010000:3.0:1783074219.515057:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074219.515062:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074219.515065:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074219.515067:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b2f expref: 22 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.515069:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3159e00/0x5fb609b3016e0b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b21 expref: 22 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.515075:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074219.515090:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723645440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074219.515090:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643520:0@lo:104: 00010000:00010000:1.0:1783074219.515091:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074219.515100:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723644672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074219.515115:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158e00/0x5fb609b3016e0b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b13 expref: 20 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.515116:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723645184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074219.515129:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:3658:x1869685723644544:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.515131:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c47b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723644288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074219.515135:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643648:0@lo:104: 00000100:00100000:3.0:1783074219.515141:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.515142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:0.0:1783074219.515143:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723644800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074219.515160:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4145c00/0x5fb609b3016e0b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b05 expref: 18 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.515160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645440 00000100:00100000:1.0:1783074219.515165:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645440 00010000:00010000:1.0:1783074219.515183:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 18 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.515189:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643776:0@lo:104: 00010000:00010000:3.0:1783074219.515190:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074219.515198:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524e71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723644544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074219.515218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00010000:00010000:2.0:1783074219.515227:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3298600/0x5fb609b3016e0afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0af7 expref: 18 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.515227:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+18:3660:x1869685723645440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783074219.515236:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074219.515240:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783074219.515247:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723643904:0@lo:104: 00010000:00010000:1.0:1783074219.515248:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 17 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.515262:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 17 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.515267:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524d3158800/0x5fb609b3016e0af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0ae9 expref: 17 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.515278:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0b4b expref: 16 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.515289:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723644032:0@lo:104: 00010000:00010000:1.0:1783074219.515290:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074219.515330:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723644160:192.168.204.26@tcp:104: 00000100:00100000:1.0:1783074219.515345:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+15:3660:x1869685723645440:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.515353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1783074219.515716:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723645440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783074219.515829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074219.516102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105216 00000100:00100000:1.0:1783074219.516107:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105216 00010000:00010000:1.0:1783074219.516122:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 10 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.516151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2633 00000100:00100000:1.0:1783074219.516158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708105216:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783074219.516165:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074219.516170:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 10 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.516190:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 10 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.516203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b376 expref: 10 pid: 94277 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.516213:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074219.516248:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:2405:x1869685708105216:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 90us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.516254:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2633 00000100:00100000:3.0:1783074219.517531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074219.517556:0:95300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95300:1869685723645312:192.168.204.26@tcp:104: 00010000:00010000:0.0:1783074219.517637:0:95300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.517728:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105344 00000100:00100000:2.0:1783074219.517733:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105344 00010000:00010000:2.0:1783074219.517757:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.517784:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2634 00000100:00100000:2.0:1783074219.517791:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f1623620-a4b0-4769-84e0-0d08c968afe8+9:2405:x1869685708105344:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783074219.517800:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074219.517804:0:19655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517812:0:19655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517824:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144400/0x5fb609b3016e0adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b36f expref: 9 pid: 94278 timeout: 3158 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517849:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517857:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517871:0:19655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517879:0:19655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517886:0:19655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517893:0:19655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517898:0:19655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670a00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074219.517902:0:19655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517909:0:19655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517934:0:19655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.517944:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074219.517995:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f1623620-a4b0-4769-84e0-0d08c968afe8+8:2405:x1869685708105344:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 203us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.518015:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2634 00010000:00010000:1.0:1783074219.518039:0:95300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.518049:0:95300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.518056:0:95300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb670a00/0x5fb609b3016e0b67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.630493:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074219.752227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074219.752363:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105472 00000100:00100000:1.0:1783074219.752372:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105472 00000100:00100000:1.0:1783074219.752426:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:1.0:1783074219.752436:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+8:70871:x1869685708105472:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074219.752452:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074219.752469:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3159800/0x5fb609b3016e0b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b37d expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.752492:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159800/0x5fb609b3016e0b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b37d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.752515:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3159800/0x5fb609b3016e0b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b37d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.752524:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159800, rc 0) 00000100:00100000:1.0:1783074219.752611:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708105472:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 177us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.752618:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:3.0:1783074219.758773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074219.758851:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105600 00000100:00100000:0.0:1783074219.758861:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105600 00000100:00100000:0.0:1783074219.758917:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:0.0:1783074219.758927:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708105600:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.759080:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708105600:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 154us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.759087:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:3.0:1783074219.760360:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074219.760473:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105728 00000100:00100000:2.0:1783074219.760479:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105728 00000100:00100000:2.0:1783074219.760519:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:2.0:1783074219.760527:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708105728:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.760632:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708105728:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.760639:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1783074219.763411:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074219.763472:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105856 00000100:00100000:0.0:1783074219.763480:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105856 00000100:00100000:0.0:1783074219.763593:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:0.0:1783074219.763604:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73255:x1869685708105856:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783074219.763734:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73255:x1869685708105856:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 126us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.763743:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:3.0:1783074219.766952:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074219.767118:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708105984 00000100:00100000:1.0:1783074219.767126:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708105984 00000100:00100000:1.0:1783074219.767187:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:1.0:1783074219.767197:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73255:x1869685708105984:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783074219.767358:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:73255:x1869685708105984:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 161us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.767365:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1783074219.770475:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074219.770526:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708106112 00000100:00100000:0.0:1783074219.770532:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708106112 00000100:00100000:0.0:1783074219.770580:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:0.0:1783074219.770589:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708106112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074219.770603:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074219.770618:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298800/0x5fb609b3016e0b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b384 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.770643:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298800/0x5fb609b3016e0b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b384 expref: 10 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.770653:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298800/0x5fb609b3016e0b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b384 expref: 10 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.770663:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298800, rc 0) 00000100:00100000:0.0:1783074219.770713:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708106112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.770721:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:3.0:1783074219.772004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074219.772084:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708106240 00000100:00100000:2.0:1783074219.772090:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708106240 00000100:00100000:2.0:1783074219.772122:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:2.0:1783074219.772130:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708106240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.772224:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708106240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 94us (221us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783074219.772232:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 10000000:01000000:0.0:1783074219.774460:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074219.774467:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524c6cae000 from 61 10000000:01000000:0.0:1783074219.774473:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074219.774524:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.774537:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.774559:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.774585:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723645568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.774637:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.774677:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c460fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074219.774725:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645568 00000100:00100000:1.0:1783074219.774731:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645568 00000100:00100000:1.0:1783074219.774779:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783074219.774788:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+15:6527:x1869685723645568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074219.774799:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074219.774812:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524d3159600/0x5fb609b3016e0b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b7c expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.774832:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524d3159600/0x5fb609b3016e0b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b7c expref: 16 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.774842:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524d3159600/0x5fb609b3016e0b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b7c expref: 16 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.774857:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159600, rc 0) 00000100:00100000:1.0:1783074219.774946:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723645568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.774952:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783074219.775072:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723645568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074219.775087:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b83 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.775095:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b83 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.775152:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723645696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.775177:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.775209:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46480 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.775261:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645696 00000100:00100000:0.0:1783074219.775265:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645696 00000100:00100000:0.0:1783074219.775370:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783074219.775377:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723645696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.775477:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723645696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.775484:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783074219.775571:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723645696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.775596:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723645824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.775641:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.775887:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46480 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.775948:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645824 00000100:00100000:3.0:1783074219.775952:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645824 00000100:00100000:3.0:1783074219.775981:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783074219.775989:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723645824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.776096:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723645824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.776103:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783074219.776181:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723645824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.776640:0:95304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95304:1869685723645952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.776673:0:95304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.776698:0:95304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.776743:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723645952 00000100:00100000:3.0:1783074219.776747:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723645952 00000100:00100000:3.0:1783074219.776764:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783074219.776770:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95304:x1869685723645952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.776856:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95304:x1869685723645952:12345-0@lo:502:llog_process_th.0 Request processed in 85us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.776863:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783074219.776934:0:95304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95304:1869685723645952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.776967:0:95304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95304:1869685723646080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.777009:0:95304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.777027:0:95304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.777073:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646080 00000100:00100000:3.0:1783074219.777076:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646080 00000100:00100000:3.0:1783074219.777092:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783074219.777097:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95304:x1869685723646080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.777168:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:95304:x1869685723646080:12345-0@lo:502:llog_process_th.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.777174:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783074219.777242:0:95304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95304:1869685723646080:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074219.777260:0:95304:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1783074219.777425:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1783074219.777465:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074219.777474:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b83 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.777483:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b83 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074219.777492:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783074219.777494:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:3.0:1783074219.777497:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783074219.777517:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.777525:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.777540:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.777554:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.777579:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.777615:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.777658:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646208 00000100:00100000:2.0:1783074219.777662:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646208 00000100:00100000:2.0:1783074219.777679:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783074219.777685:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+16:6527:x1869685723646208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074219.777693:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074219.777704:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b8a expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.777722:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b8a expref: 17 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.777742:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b8a expref: 17 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.777750:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671c00, rc 0) 00000100:00100000:2.0:1783074219.777785:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723646208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.777792:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783074219.777852:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074219.777863:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b91 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.777872:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b91 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.777911:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.777934:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.777961:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.778013:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646336 00000100:00100000:2.0:1783074219.778017:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646336 00000100:00100000:2.0:1783074219.778033:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783074219.778038:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723646336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.778122:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723646336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.778129:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783074219.778306:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.778358:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.778390:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.778411:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.778474:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646464 00000100:00100000:2.0:1783074219.778478:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646464 00000100:00100000:2.0:1783074219.778507:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783074219.778513:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723646464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.778568:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723646464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.778575:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783074219.778656:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.778936:0:95305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95305:1869685723646592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.778989:0:95305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.779021:0:95305:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524f4712540 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.779070:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646592 00000100:00100000:2.0:1783074219.779074:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646592 00000100:00100000:2.0:1783074219.779101:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783074219.779107:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95305:x1869685723646592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.779170:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95305:x1869685723646592:12345-0@lo:502:llog_process_th.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.779182:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783074219.779302:0:95305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95305:1869685723646592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783074219.779354:0:95305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074219.779363:0:95305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074219.779366:0:95305:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1783074219.779371:0:95305:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1783074219.779869:0:95305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95305:1869685723646720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.779896:0:95305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.779922:0:95305:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.780151:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646720 00000100:00100000:2.0:1783074219.780156:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646720 00000100:00100000:2.0:1783074219.780184:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783074219.780192:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95305:x1869685723646720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.780260:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+17:95305:x1869685723646720:12345-0@lo:502:llog_process_th.0 Request processed in 68us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.780266:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783074219.780338:0:95305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95305:1869685723646720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783074219.780358:0:95305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783074219.780363:0:95305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783074219.780387:0:95305:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:0.0:1783074219.780392:0:95305:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1783074219.780552:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:2.0:1783074219.780575:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783074219.780583:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b91 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.780594:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b91 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074219.780602:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783074219.780605:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c6b72800 from 61 10000000:01000000:2.0:1783074219.780607:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783074219.780626:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.780634:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.780643:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.780653:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.780683:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.780806:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.780831:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646848 00000100:00100000:0.0:1783074219.780834:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646848 00000100:00100000:0.0:1783074219.780883:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783074219.780889:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+17:6527:x1869685723646848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074219.780905:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074219.780916:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298a00/0x5fb609b3016e0b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0b98 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.780934:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298a00/0x5fb609b3016e0b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0b98 expref: 18 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.780943:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298a00/0x5fb609b3016e0b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b98 expref: 18 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.780951:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298a00, rc 0) 00000100:00100000:0.0:1783074219.781025:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723646848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.781030:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783074219.781098:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074219.781110:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b9f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.781118:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b9f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.781162:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.781187:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.781233:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.781262:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723646976 00000100:00100000:0.0:1783074219.781266:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723646976 00000100:00100000:0.0:1783074219.781331:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783074219.781338:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723646976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.781409:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723646976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.781415:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783074219.781464:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723646976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.781486:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.781513:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.781648:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498540 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.781692:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647104 00000100:00100000:3.0:1783074219.781696:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647104 00000100:00100000:3.0:1783074219.781713:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783074219.781719:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723647104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.781795:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723647104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.781802:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783074219.781858:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.782119:0:95306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95306:1869685723647232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074219.782149:0:95306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.782169:0:95306:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.782209:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647232 00000100:00100000:3.0:1783074219.782213:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647232 00000100:00100000:3.0:1783074219.782230:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783074219.782236:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95306:x1869685723647232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.782330:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95306:x1869685723647232:12345-0@lo:502:llog_process_th.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.782337:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783074219.782401:0:95306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95306:1869685723647232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074219.782436:0:95306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95306:1869685723647360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074219.782461:0:95306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.782483:0:95306:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3900d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.782520:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647360 00000100:00100000:3.0:1783074219.782523:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647360 00000100:00100000:3.0:1783074219.782537:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783074219.782542:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95306:x1869685723647360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.782603:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+18:95306:x1869685723647360:12345-0@lo:502:llog_process_th.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.782614:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783074219.782669:0:95306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95306:1869685723647360:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783074219.782686:0:95306:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1783074219.782800:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1783074219.782817:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783074219.782823:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b9f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.782831:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0b9f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074219.782840:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783074219.782842:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:3.0:1783074219.782844:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783074219.782863:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.782870:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.782876:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.782888:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.782912:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.782941:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.783005:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647488 00000100:00100000:0.0:1783074219.783009:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647488 00000100:00100000:0.0:1783074219.783030:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783074219.783036:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+18:6527:x1869685723647488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074219.783044:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074219.783053:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0ba6 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.783081:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0ba6 expref: 19 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.783090:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0ba6 expref: 19 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.783098:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299200, rc 0) 00000100:00100000:0.0:1783074219.783125:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723647488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.783131:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783074219.783202:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074219.783214:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bad expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.783232:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bad expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074219.783271:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.783294:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.783344:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074219.783400:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647616 00000100:00100000:1.0:1783074219.783404:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647616 00000100:00100000:1.0:1783074219.783422:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783074219.783427:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723647616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.783558:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723647616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.783562:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783074219.783596:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.783613:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.783635:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.783661:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c456b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.783724:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647744 00000100:00100000:2.0:1783074219.783728:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647744 00000100:00100000:2.0:1783074219.783755:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783074219.783762:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e4112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723647744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.783829:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e4112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723647744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.783836:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783074219.783852:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723647744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.784454:0:95307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95307:1869685723647872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074219.784493:0:95307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.784534:0:95307:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2cec900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074219.784566:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723647872 00000100:00100000:1.0:1783074219.784569:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723647872 00000100:00100000:1.0:1783074219.784608:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783074219.784612:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95307:x1869685723647872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074219.784668:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95307:x1869685723647872:12345-0@lo:502:llog_process_th.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.784674:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783074219.784744:0:95307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95307:1869685723647872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074219.784763:0:95307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783074219.784771:0:95307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074219.784773:0:95307:0:(obd_config.c:1561:class_process_config()) marker 52 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:2.0:1783074219.784778:0:95307:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1783074219.784935:0:95307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95307:1869685723648000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.784964:0:95307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074219.785040:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648000 00000100:00100000:2.0:1783074219.785041:0:95307:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.785044:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648000 00000100:00100000:3.0:1783074219.785095:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783074219.785102:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95307:x1869685723648000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.785183:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+19:95307:x1869685723648000:12345-0@lo:502:llog_process_th.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.785190:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783074219.785249:0:95307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95307:1869685723648000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783074219.785266:0:95307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783074219.785270:0:95307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783074219.785271:0:95307:0:(obd_config.c:1561:class_process_config()) marker 52 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:2.0:1783074219.785274:0:95307:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:1.0:1783074219.785393:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:1.0:1783074219.785406:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783074219.785412:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bad expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.785418:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bad expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.785432:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783074219.785433:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f49f9000 from 61 10000000:01000000:1.0:1783074219.785435:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783074219.785449:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.785454:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.785460:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.785467:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.785487:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.785622:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.785646:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648128 00000100:00100000:0.0:1783074219.785652:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648128 00000100:00100000:0.0:1783074219.785672:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783074219.785678:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+19:6527:x1869685723648128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074219.785685:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074219.785695:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0bb4 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.785712:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0bb4 expref: 20 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.785721:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bb4 expref: 20 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.785742:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299000, rc 0) 00000100:00100000:0.0:1783074219.785777:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723648128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.785783:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783074219.785860:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074219.785871:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bbb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.785879:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bbb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.785923:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.785946:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.785960:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.785991:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648256 00000100:00100000:3.0:1783074219.785995:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648256 00000100:00100000:3.0:1783074219.786012:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783074219.786018:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723648256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.786106:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.786107:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723648256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.786121:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783074219.786128:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.786225:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.786251:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad900 going to sleep for 11 seconds 00000100:00100000:1.0:1783074219.786258:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648384 00000100:00100000:1.0:1783074219.786261:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648384 00000100:00100000:1.0:1783074219.786292:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783074219.786298:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723648384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.786375:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723648384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.786382:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783074219.786383:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.786761:0:95308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95308:1869685723648512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783074219.786785:0:95308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.786838:0:95308:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.786860:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648512 00000100:00100000:0.0:1783074219.786863:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648512 00000100:00100000:0.0:1783074219.786901:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783074219.786906:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95308:x1869685723648512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074219.786963:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95308:x1869685723648512:12345-0@lo:502:llog_process_th.0 Request processed in 56us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.786969:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783074219.787237:0:95308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8fff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95308:1869685723648512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.787264:0:95308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95308:1869685723648640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.787286:0:95308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.787300:0:95308:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.787397:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648640 00000100:00100000:3.0:1783074219.787400:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648640 00000100:00100000:3.0:1783074219.787441:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783074219.787446:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95308:x1869685723648640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.787508:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+20:95308:x1869685723648640:12345-0@lo:502:llog_process_th.0 Request processed in 61us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.787514:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783074219.787517:0:95308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95308:1869685723648640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783074219.787532:0:95308:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1783074219.787596:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1783074219.787613:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783074219.787619:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bbb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.787629:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bbb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.787637:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783074219.787640:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783074219.787642:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783074219.787659:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.787666:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.787674:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.787685:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.787714:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.787739:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498540 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.787775:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648768 00000100:00100000:0.0:1783074219.787779:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648768 00000100:00100000:0.0:1783074219.787805:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783074219.787811:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+20:6527:x1869685723648768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074219.787818:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074219.787828:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0bc2 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.787845:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0bc2 expref: 21 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.787854:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bc2 expref: 21 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.787867:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298400, rc 0) 00000100:00100000:0.0:1783074219.787906:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723648768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.787912:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783074219.788006:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074219.788016:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bc9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.788024:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bc9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.788062:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.788085:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.788107:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad900 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.788161:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723648896 00000100:00100000:3.0:1783074219.788165:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723648896 00000100:00100000:3.0:1783074219.788222:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783074219.788228:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723648896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.788344:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723648896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.788348:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783074219.788396:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723648896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.788412:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.788441:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.788575:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d0bad900 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.788606:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649024 00000100:00100000:0.0:1783074219.788608:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649024 00000100:00100000:0.0:1783074219.788621:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783074219.788626:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723649024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.788694:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723649024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.788700:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783074219.788758:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074219.789602:0:95309:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783074219.789736:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783074219.789752:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783074219.789760:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bc9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.789769:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bc9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783074219.789777:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783074219.789779:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9524f4a91000 from 61 10000000:01000000:0.0:1783074219.789782:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783074219.789801:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.789809:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.789817:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.789841:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.789872:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.789900:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.789947:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649152 00000100:00100000:2.0:1783074219.789951:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649152 00000100:00100000:2.0:1783074219.789992:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783074219.789999:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:6527:x1869685723649152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074219.790007:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074219.790016:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0bd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0bd0 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.790033:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0bd0 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.790042:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bd0 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.790049:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671600, rc 0) 00000100:00100000:2.0:1783074219.790167:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723649152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.790174:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783074219.790217:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783074219.790228:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074219.790236:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074219.790271:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.790294:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.790364:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.790393:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649280 00000100:00100000:3.0:1783074219.790397:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649280 00000100:00100000:3.0:1783074219.790421:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783074219.790427:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723649280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783074219.790560:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723649280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.790566:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783074219.790617:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.790639:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.790662:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.790756:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b840 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.790768:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649408 00000100:00100000:2.0:1783074219.790771:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649408 00000100:00100000:2.0:1783074219.790796:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783074219.790802:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723649408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.790878:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723649408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.790884:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783074219.790948:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.791143:0:95310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95310:1869685723649536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074219.791173:0:95310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.791221:0:95310:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.791456:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649536 00000100:00100000:3.0:1783074219.791463:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649536 00000100:00100000:3.0:1783074219.791493:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783074219.791499:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95310:x1869685723649536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783074219.791640:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95310:x1869685723649536:12345-0@lo:502:llog_process_th.0 Request processed in 141us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.791647:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783074219.791705:0:95310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95310:1869685723649536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074219.791748:0:95310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95310:1869685723649664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783074219.791779:0:95310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074219.791831:0:95310:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.791860:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649664 00000100:00100000:2.0:1783074219.791863:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649664 00000100:00100000:2.0:1783074219.791883:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783074219.791889:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95310:x1869685723649664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783074219.792001:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:95310:x1869685723649664:12345-0@lo:502:llog_process_th.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.792008:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783074219.792051:0:95310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:522b6a34-04f4-4017-ab45-61a21d19bfef:95310:1869685723649664:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783074219.792066:0:95310:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783074219.792202:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783074219.792222:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783074219.792230:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.792239:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074219.792247:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783074219.792250:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783074219.792252:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783074219.792268:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.792276:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.792284:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.792297:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.792446:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.792508:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783074219.792535:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649792 00000100:00100000:3.0:1783074219.792539:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649792 00000100:00100000:3.0:1783074219.792563:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783074219.792569:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723649792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783074219.792576:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074219.792586:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524e4144600/0x5fb609b3016e0be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0bde expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.792603:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524e4144600/0x5fb609b3016e0be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0bde expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.792613:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524e4144600/0x5fb609b3016e0be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bde expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074219.792620:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144600, rc 0) 00000100:00100000:3.0:1783074219.792694:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723649792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074219.792700:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783074219.792749:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074219.792759:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.792775:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074219.792815:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.792837:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.792886:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.792913:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723649920 00000100:00100000:0.0:1783074219.792917:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723649920 00000100:00100000:0.0:1783074219.792985:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783074219.792993:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723649920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.793116:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723649920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074219.793123:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783074219.793187:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723649920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.793210:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723650048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783074219.793241:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074219.793263:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c39003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783074219.793327:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650048 00000100:00100000:1.0:1783074219.793332:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650048 00000100:00100000:1.0:1783074219.793395:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783074219.793403:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723650048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.793468:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723650048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074219.793474:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783074219.793557:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723650048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783074219.794364:0:95311:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1783074219.794474:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1783074219.794493:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783074219.794500:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.794510:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074219.794519:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783074219.794521:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9524e69d19c0 from 1 10000000:01000000:1.0:1783074219.794523:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783074219.794542:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.794550:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.794559:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.794572:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723650176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.794608:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.794639:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783074219.794678:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650176 00000100:00100000:2.0:1783074219.794683:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650176 00000100:00100000:2.0:1783074219.794712:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783074219.794719:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723650176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074219.794729:0:94278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074219.794739:0:94278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e0bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e0bec expref: -99 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.794754:0:94278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e0bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e0bec expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.794762:0:94278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e0bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bec expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074219.794779:0:94278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671e00, rc 0) 00000100:00100000:2.0:1783074219.794813:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723650176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074219.794819:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783074219.794876:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723650176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074219.794887:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.794895:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074219.794936:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723650304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783074219.794961:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074219.794990:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4498e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783074219.795032:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650304 00000100:00100000:0.0:1783074219.795037:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650304 00000100:00100000:0.0:1783074219.795067:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783074219.795075:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723650304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783074219.795171:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723650304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (208us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783074219.795178:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783074219.795296:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c8ffc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723650304:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783074219.798051:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783074219.798067:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074219.798079:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074220.654472:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783074221.624088:0:95408:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 06:23:40 (1783074220) 00000100:00100000:3.0:1783074221.652122:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074221.652172:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708106496 00000100:00100000:2.0:1783074221.652182:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708106496 00000100:00080000:3.0:1783074221.652230:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074221.652258:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1367 00000100:00100000:2.0:1783074221.652271:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:73432:x1869685708106496:12345-192.168.204.26@tcp:36:mkdir.0 00010000:00010000:2.0:1783074221.652356:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074221.652386:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0a17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b329 expref: 10 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.652405:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:2.0:1783074221.652410:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074221.652467:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.652483:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.652494:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.652509:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.652516:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.652528:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653030:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653039:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653046:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074221.653060:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007db5d32b reply state 00000000781d0ae0 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653070:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653075:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074221.653078:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074221.653081:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783074221.653086:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1783074221.653092:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653099:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653104:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653110:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653123:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074221.653128:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653134:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653142:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:2.0:1783074221.653145:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074221.653147:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653153:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0bfa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074221.653163:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007db5d32b reply state 00000000781d0ae0 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653170:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.653176:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9524f4575f00) 00010000:00010000:2.0:1783074221.653179:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074221.653181:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783074221.653272:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73432:x1869685708106496:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 1003us (1157us total) trans 124554051585 rc 0/0 00000100:00100000:2.0:1783074221.653279:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1367 00000100:00100000:3.0:1783074221.663259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.663335:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708106624 00000100:00100000:0.0:1783074221.663348:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708106624 00000100:00100000:0.0:1783074221.663407:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1368 00000100:00100000:0.0:1783074221.663419:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73434:x1869685708106624:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074221.663443:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.663550:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b38b expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.663624:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0c16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.663638:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.663713:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074221.663758:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783074221.663762:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074221.663782:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.663803:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b38b expref: 13 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.663818:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b38b expref: 12 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.663826:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:0.0:1783074221.663829:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783074221.663833:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298600, rc 0) 00000100:00100000:0.0:1783074221.663888:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:73434:x1869685708106624:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 474us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.663894:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1368 00000100:00100000:3.0:1783074221.665362:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.665396:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708106880 00000100:00100000:1.0:1783074221.665404:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708106880 00000100:00100000:1.0:1783074221.665453:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1369 00000100:00100000:1.0:1783074221.665463:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:73434:x1869685708106880:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1783074221.665477:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.665480:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783074221.665501:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0c16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b38b expref: 12 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665523:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074221.665528:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074221.665540:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0c1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b392 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665653:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665665:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665674:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665687:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665694:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665702:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665761:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665770:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665777:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074221.665791:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1783074221.665805:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665812:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665819:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665825:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.665829:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665837:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665847:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.665850:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.665854:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665861:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c32 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665878:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665884:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665890:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665904:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665910:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.665914:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665921:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665931:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074221.665934:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.665950:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665957:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665970:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665976:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665982:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.665999:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3159a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.666003:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.666019:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.666029:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9524f4575f00) 00010000:00010000:1.0:1783074221.666032:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.666035:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.666041:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0c2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.666073:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0c1d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b392 expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.666083:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074221.666086:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.666089:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0c1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b392 expref: 12 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.666099:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158600, rc 0) 00000100:00100000:1.0:1783074221.666149:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73434:x1869685708106880:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 689us (792us total) trans 0 rc 301/301 00000100:00100000:1.0:1783074221.666155:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1369 00000100:00100000:0.0:1783074221.668572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074221.669056:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708107008 00000100:00100000:2.0:1783074221.669065:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708107008 00000100:00100000:2.0:1783074221.669117:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1370 00000100:00100000:2.0:1783074221.669136:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73434:x1869685708107008:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1783074221.669156:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074221.669175:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0c39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b399 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.669232:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e0c40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.669245:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e0c40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.669256:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e0c40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074221.669296:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074221.669299:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074221.669334:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e0c40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.669357:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0c39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b399 expref: 13 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.669374:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e0c40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b399 expref: 12 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.669382:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:2.0:1783074221.669385:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074221.669388:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671a00, rc 0) 00000100:00100000:2.0:1783074221.669440:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:73434:x1869685708107008:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 308us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074221.669456:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1370 00000100:00100000:3.0:1783074221.673919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.673988:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708107264 00000100:00100000:0.0:1783074221.674004:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708107264 00000100:00100000:0.0:1783074221.674068:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1371 00000100:00100000:0.0:1783074221.674079:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:73434:x1869685708107264:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1783074221.674098:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.674117:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0c47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3a0 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674184:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674199:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674210:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674220:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674227:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674234:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074221.674359:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1783074221.674428:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674434:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674445:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674451:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674458:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.674462:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674470:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674482:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:0.0:1783074221.674485:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.674489:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674496:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0c4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674507:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674513:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674520:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674524:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.674533:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674539:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674547:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9524f4575f00) 00010000:00010000:0.0:1783074221.674550:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.674554:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674559:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0c55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674591:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0c47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3a0 expref: 14 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674601:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:0.0:1783074221.674604:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783074221.674607:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0c47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3a0 expref: 14 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.674617:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298200, rc 0) 00000100:00100000:0.0:1783074221.674669:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:73434:x1869685708107264:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 592us (756us total) trans 124554051586 rc 301/301 00000100:00100000:0.0:1783074221.674677:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1371 00000100:00100000:0.0:1783074221.676519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.676642:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708107520 00000100:00100000:1.0:1783074221.676650:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708107520 00000100:00100000:1.0:1783074221.676699:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1372 00000100:00100000:1.0:1783074221.676716:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:73434:x1869685708107520:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:1.0:1783074221.676791:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.676806:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.676815:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.676948:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000350d160a reply state 000000000aff6808 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.676962:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.676969:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.676972:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1783074221.676975:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783074221.676981:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:1.0:1783074221.677059:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524e71af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:73434:x1869685708107520:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 347us (543us total) trans 124554051587 rc 0/0 00000100:00100000:1.0:1783074221.677067:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1372 00000100:00100000:3.0:1783074221.677977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.678137:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708107776 00000100:00100000:1.0:1783074221.678143:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708107776 00000100:00100000:1.0:1783074221.678185:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 243 00000100:00100000:1.0:1783074221.678195:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:73434:x1869685708107776:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1783074221.678357:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:73434:x1869685708107776:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 162us (379us total) trans 124554051588 rc 0/0 00000100:00100000:1.0:1783074221.678365:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 243 00010000:00010000:3.0:1783074221.678399:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074221.684960:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.685011:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708107904 00000100:00100000:1.0:1783074221.685030:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708107904 00000100:00100000:1.0:1783074221.685088:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1373 00000100:00100000:1.0:1783074221.685099:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:73438:x1869685708107904:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.685123:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.685141:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0c6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3a7 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685190:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685200:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685208:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685215:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685220:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685226:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685297:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53000/0x5fb609b3016e0c7f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685306:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53000/0x5fb609b3016e0c7f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685350:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53000/0x5fb609b3016e0c7f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074221.685383:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1783074221.685388:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783074221.685422:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53000/0x5fb609b3016e0c7f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685432:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685436:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685440:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685444:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685448:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.685451:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685455:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685465:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074221.685468:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.685472:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685490:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685503:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685508:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685513:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685518:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.685522:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685527:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685535:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9524f4575f00) 00010000:00010000:1.0:1783074221.685538:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.685541:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685546:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0c78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685567:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0c6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3a7 expref: 18 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685592:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53000/0x5fb609b3016e0c7f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3a7 expref: 17 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.685599:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.685601:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783074221.685603:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53000, rc 0) 00000100:00100000:1.0:1783074221.685662:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:73438:x1869685708107904:12345-192.168.204.26@tcp:101:touch.0 Request processed in 565us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.685670:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1373 00000100:00100000:0.0:1783074221.686760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.686813:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708108160 00000100:00100000:1.0:1783074221.686818:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708108160 00000100:00100000:1.0:1783074221.686858:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1374 00000100:00100000:1.0:1783074221.686867:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:73438:x1869685708108160:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.686877:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.686889:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0c86 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3ae expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.686966:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.686978:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.686998:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687016:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687031:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687037:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.687355:0:66200:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x724:0x0], count =94 00000004:00080000:1.0:1783074221.687363:0:66200:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x724:0x0]+94 in llog 00000004:00080000:1.0:1783074221.687383:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x782:0x0], index 0: 0 00010000:00010000:1.0:1783074221.687522:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0c9b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687531:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0c9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687539:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0c9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687571:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687579:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687584:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687591:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687597:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.687606:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687613:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687625:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.687629:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.687632:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687639:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0c8d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.687653:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c808154 reply state 000000005d1bd532 transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687665:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687672:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff9524f4710300) 00010000:00010000:1.0:1783074221.687675:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.687678:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.687705:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0c86 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ae expref: 20 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687725:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0c9b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ae expref: 19 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.687732:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:1.0:1783074221.687735:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.687744:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53a00, rc 0) 00000100:00100000:1.0:1783074221.687788:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:73438:x1869685708108160:12345-192.168.204.26@tcp:101:touch.0 Request processed in 922us (1030us total) trans 124554051589 rc 0/0 00000100:00100000:1.0:1783074221.687796:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1374 00000100:00100000:3.0:1783074221.689770:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.690069:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708108416 00000100:00100000:0.0:1783074221.690082:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708108416 00000100:00100000:0.0:1783074221.690135:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1375 00000100:00100000:0.0:1783074221.690147:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:73438:x1869685708108416:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.690189:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.690211:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0c9b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ae expref: 20 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.690229:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074221.690243:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.690286:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.690301:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.690337:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.690425:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e0f9b0d reply state 00000000e7662119 transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.690438:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.690445:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:0.0:1783074221.690448:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.690452:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.690520:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:73438:x1869685708108416:12345-192.168.204.26@tcp:36:touch.0 Request processed in 376us (754us total) trans 124554051590 rc 0/0 00000100:00100000:0.0:1783074221.690529:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1375 00000100:00100000:0.0:1783074221.691738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074221.691765:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708108544 00000100:00100000:2.0:1783074221.691771:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708108544 00000100:00100000:2.0:1783074221.691809:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1376 00000100:00100000:2.0:1783074221.691817:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:73438:x1869685708108544:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:2.0:1783074221.691831:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074221.691846:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0cb0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3b5 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.691883:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0cb0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3b5 expref: 22 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.691896:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671200/0x5fb609b3016e0cb0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3b5 expref: 22 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.691913:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:2.0:1783074221.691916:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783074221.691919:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671200, rc 0) 00000100:00100000:2.0:1783074221.691973:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:73438:x1869685708108544:12345-192.168.204.26@tcp:101:touch.0 Request processed in 156us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074221.691980:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1376 00000100:00100000:0.0:1783074221.693909:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.693958:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708108672 00000100:00100000:1.0:1783074221.693965:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708108672 00000100:00080000:2.0:1783074221.693988:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783074221.694010:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4948 00000100:00100000:1.0:1783074221.694019:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2402:x1869685708108672:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:1.0:1783074221.694182:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2402:x1869685708108672:12345-192.168.204.26@tcp:2:touch.0 Request processed in 164us (277us total) trans 4294968720 rc 0/0 00000100:00100000:1.0:1783074221.694190:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4948 00000100:00100000:0.0:1783074221.695038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.695080:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708108928 00000100:00100000:1.0:1783074221.695085:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708108928 00000100:00100000:1.0:1783074221.695158:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 244 00000100:00100000:1.0:1783074221.695167:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:73438:x1869685708108928:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.695378:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:73438:x1869685708108928:12345-192.168.204.26@tcp:35:touch.0 Request processed in 211us (339us total) trans 124554051591 rc 0/0 00000100:00100000:1.0:1783074221.695386:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 244 00000100:00100000:0.0:1783074221.697010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.697139:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708109184 00000100:00100000:1.0:1783074221.697144:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708109184 00000100:00100000:1.0:1783074221.697181:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1377 00000100:00100000:1.0:1783074221.697188:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:73438:x1869685708109184:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.697202:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.697218:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0cb7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3bc expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697306:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697335:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697346:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697359:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697366:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697372:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.697596:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x783:0x0], index 0: 0 00010000:00010000:1.0:1783074221.697691:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0ccc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697700:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0ccc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697706:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0ccc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697732:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697747:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697753:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697760:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697766:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.697770:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697777:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697787:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.697790:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.697794:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697800:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0cbe lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.697811:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c143677b reply state 00000000a31b5798 transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697820:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697826:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff9524d30b3d00) 00010000:00010000:1.0:1783074221.697832:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.697835:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.697858:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0cb7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3bc expref: 26 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697872:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0ccc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3bc expref: 25 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.697879:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:1.0:1783074221.697881:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.697884:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52400, rc 0) 00000100:00100000:1.0:1783074221.697931:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:73438:x1869685708109184:12345-192.168.204.26@tcp:101:touch.0 Request processed in 743us (923us total) trans 124554051592 rc 0/0 00000100:00100000:1.0:1783074221.697949:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1377 00000100:00100000:0.0:1783074221.702798:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.703108:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708109440 00000100:00100000:3.0:1783074221.703118:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708109440 00000100:00100000:3.0:1783074221.703168:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1378 00000100:00100000:3.0:1783074221.703180:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:73438:x1869685708109440:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:3.0:1783074221.703230:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074221.703253:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0ccc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3bc expref: 26 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.703269:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:3.0:1783074221.703278:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074221.703365:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.703378:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.703388:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.703483:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c86e718 reply state 00000000eb0d7a70 transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.703495:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.703502:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:3.0:1783074221.703513:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.703516:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074221.703598:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:73438:x1869685708109440:12345-192.168.204.26@tcp:36:touch.0 Request processed in 420us (804us total) trans 124554051593 rc 0/0 00000100:00100000:3.0:1783074221.703605:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1378 00000100:00100000:0.0:1783074221.705003:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074221.705053:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708109568 00000100:00100000:2.0:1783074221.705059:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708109568 00000100:00100000:2.0:1783074221.705098:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1379 00000100:00100000:2.0:1783074221.705107:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:73438:x1869685708109568:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:2.0:1783074221.705132:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074221.705144:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0ce1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3c3 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.705181:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0ce1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3c3 expref: 28 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.705194:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670000/0x5fb609b3016e0ce1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3c3 expref: 28 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.705210:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:2.0:1783074221.705212:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783074221.705215:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670000, rc 0) 00000100:00100000:2.0:1783074221.705253:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:73438:x1869685708109568:12345-192.168.204.26@tcp:101:touch.0 Request processed in 147us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074221.705260:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1379 00000100:00100000:0.0:1783074221.706493:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.706581:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708109696 00000100:00100000:3.0:1783074221.706587:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708109696 00000100:00100000:3.0:1783074221.706661:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4949 00000100:00100000:3.0:1783074221.706670:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2402:x1869685708109696:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.706827:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708109696:12345-192.168.204.26@tcp:2:touch.0 Request processed in 158us (336us total) trans 4294968721 rc 0/0 00000100:00100000:3.0:1783074221.706835:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4949 00000100:00100000:0.0:1783074221.707676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.707715:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708109952 00000100:00100000:1.0:1783074221.707720:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708109952 00000100:00100000:1.0:1783074221.707764:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 245 00000100:00100000:1.0:1783074221.707772:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:73438:x1869685708109952:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.707973:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:73438:x1869685708109952:12345-192.168.204.26@tcp:35:touch.0 Request processed in 201us (296us total) trans 124554051594 rc 0/0 00000100:00100000:1.0:1783074221.707980:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 245 00000100:00100000:1.0:1783074221.709860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.709908:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708110208 00000100:00100000:0.0:1783074221.709913:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708110208 00000100:00100000:0.0:1783074221.709960:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1380 00000100:00100000:0.0:1783074221.709967:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:73438:x1869685708110208:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.709987:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.710004:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0ce8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3ca expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710089:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710103:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710115:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710128:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710133:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710152:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.710467:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x784:0x0], index 0: 0 00000001:00080000:3.0:1783074221.710498:0:94271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051594 is committed 00010000:00010000:1.0:1783074221.710529:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710540:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710558:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710566:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.710571:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710577:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0cfd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710578:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710596:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0cfd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710601:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9524f4575f00) 00010000:00010000:0.0:1783074221.710603:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0cfd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710605:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.710611:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710619:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0c01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710628:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710636:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710643:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710662:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710663:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710680:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710686:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710687:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.710694:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.710694:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710701:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710706:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710735:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710739:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.710745:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.710749:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710753:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.710757:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.710761:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710765:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0cef lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710768:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0c08 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.710777:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cab08e3 reply state 000000006040dfad transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710789:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710795:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff9524e0374d00) 00010000:00010000:0.0:1783074221.710797:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.710799:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.710802:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710807:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710811:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710815:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.710820:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710822:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0ce8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ca expref: 21 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710827:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710834:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.710838:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074221.710840:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710853:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0cfd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ca expref: 20 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710855:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0c63 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710872:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524e0374700) 00010000:00010000:0.0:1783074221.710875:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.710876:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.710878:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299800, rc 0) 00010000:00010000:1.0:1783074221.710883:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710888:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710891:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.710893:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710896:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710901:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff9524f4710300) 00010000:00010000:1.0:1783074221.710903:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.710905:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710909:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0c94 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710918:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710922:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710932:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074221.710932:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:73438:x1869685708110208:12345-192.168.204.26@tcp:101:touch.0 Request processed in 963us (1071us total) trans 124554051595 rc 0/0 00010000:00010000:1.0:1783074221.710953:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299a00 already unused, calling callback (ffffffffc186d4f0) 00000100:00100000:0.0:1783074221.710954:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1380 00010000:00010000:1.0:1783074221.710956:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710962:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710971:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:1.0:1783074221.710973:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.710976:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710980:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0ca9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710988:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710992:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710996:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.710999:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.711000:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711011:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711017:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff9524d30b3d00) 00010000:00010000:1.0:1783074221.711018:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.711020:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711024:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0cc5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711039:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711043:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711046:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711049:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.711050:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711053:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711057:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:1.0:1783074221.711058:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.711060:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.711066:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0cda lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074221.712749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.712789:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708110464 00000100:00100000:3.0:1783074221.712797:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708110464 00000100:00100000:3.0:1783074221.712840:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1381 00000100:00100000:3.0:1783074221.712849:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:73438:x1869685708110464:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:3.0:1783074221.712892:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074221.712910:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0cfd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ca expref: 16 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.712923:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524e0374700) 00010000:00010000:3.0:1783074221.712931:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074221.712981:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.713003:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.713024:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.713107:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013bde5f1 reply state 0000000080251323 transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.713118:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.713124:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:3.0:1783074221.713127:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.713129:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074221.713204:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:73438:x1869685708110464:12345-192.168.204.26@tcp:36:touch.0 Request processed in 355us (456us total) trans 124554051596 rc 0/0 00000100:00100000:3.0:1783074221.713211:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1381 00000100:00100000:2.0:1783074221.714889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.714932:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708110592 00000100:00100000:1.0:1783074221.714949:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708110592 00000100:00100000:1.0:1783074221.714992:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1382 00000100:00100000:1.0:1783074221.715002:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:73438:x1869685708110592:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.715028:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.715039:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0d12 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3d1 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.715074:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0d12 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3d1 expref: 18 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.715087:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52a00/0x5fb609b3016e0d12 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3d1 expref: 18 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.715103:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:1.0:1783074221.715107:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.715110:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52a00, rc 0) 00000100:00100000:1.0:1783074221.715155:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:73438:x1869685708110592:12345-192.168.204.26@tcp:101:touch.0 Request processed in 155us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.715162:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1382 00000100:00100000:1.0:1783074221.716404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.716439:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708110720 00000100:00100000:3.0:1783074221.716445:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708110720 00000100:00100000:3.0:1783074221.716479:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4950 00000100:00100000:3.0:1783074221.716488:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708110720:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.716644:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2405:x1869685708110720:12345-192.168.204.26@tcp:2:touch.0 Request processed in 158us (239us total) trans 4294968722 rc 0/0 00000100:00100000:3.0:1783074221.716652:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4950 00000100:00100000:0.0:1783074221.717704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.717744:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708110976 00000100:00100000:1.0:1783074221.717750:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708110976 00000100:00100000:1.0:1783074221.717794:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 246 00000100:00100000:1.0:1783074221.717821:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:73438:x1869685708110976:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.718024:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:73438:x1869685708110976:12345-192.168.204.26@tcp:35:touch.0 Request processed in 205us (319us total) trans 124554051597 rc 0/0 00000100:00100000:1.0:1783074221.718032:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 246 00000100:00100000:2.0:1783074221.719388:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.719435:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708111232 00000100:00100000:1.0:1783074221.719441:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708111232 00000100:00100000:1.0:1783074221.719490:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1383 00000100:00100000:1.0:1783074221.719498:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:73438:x1869685708111232:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.719513:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.719529:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0d19 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3d8 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.719595:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.719605:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.719613:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.719622:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.719626:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.719630:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.719894:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x785:0x0], index 0: 0 00010000:00010000:1.0:1783074221.720018:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0d2e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720028:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0d2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720035:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0d2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720064:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720071:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720077:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720083:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720089:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.720094:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720103:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720115:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.720118:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.720129:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720133:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d20 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.720143:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000739640c2 reply state 000000006162e5ed transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720150:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720153:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff9524d30b3d00) 00010000:00010000:1.0:1783074221.720155:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.720156:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.720185:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0d19 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3d8 expref: 22 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720198:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0d2e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3d8 expref: 21 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.720205:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524d30b3900) 00010000:00010000:1.0:1783074221.720207:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.720209:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53800, rc 0) 00000100:00100000:1.0:1783074221.720254:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:73438:x1869685708111232:12345-192.168.204.26@tcp:101:touch.0 Request processed in 757us (870us total) trans 124554051598 rc 0/0 00000100:00100000:1.0:1783074221.720262:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1383 00000100:00100000:0.0:1783074221.721805:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.721841:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708111488 00000100:00100000:3.0:1783074221.721847:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708111488 00000100:00100000:3.0:1783074221.721881:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1384 00000100:00100000:3.0:1783074221.721887:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:73438:x1869685708111488:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:3.0:1783074221.721923:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074221.721962:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0d2e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3d8 expref: 22 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.721975:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524d30b3900) 00010000:00010000:3.0:1783074221.721983:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074221.722024:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.722035:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.722044:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.722117:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e4ef5ea reply state 00000000c1045e7d transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.722133:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.722139:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:3.0:1783074221.722141:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.722144:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074221.722197:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:73438:x1869685708111488:12345-192.168.204.26@tcp:36:touch.0 Request processed in 310us (397us total) trans 124554051599 rc 0/0 00000100:00100000:3.0:1783074221.722202:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1384 00000100:00100000:2.0:1783074221.723825:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.723865:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708111616 00000100:00100000:1.0:1783074221.723872:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708111616 00000100:00100000:0.0:1783074221.723970:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1385 00000100:00100000:0.0:1783074221.723983:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:73438:x1869685708111616:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.723998:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.724012:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0d43 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3df expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.724052:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0d43 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3df expref: 24 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.724066:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299a00/0x5fb609b3016e0d43 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3df expref: 24 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.724082:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:0.0:1783074221.724086:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.724088:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299a00, rc 0) 00000100:00100000:0.0:1783074221.724134:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:73438:x1869685708111616:12345-192.168.204.26@tcp:101:touch.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.724141:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1385 00000100:00100000:2.0:1783074221.725463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.725524:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708111744 00000100:00100000:0.0:1783074221.725528:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708111744 00000100:00100000:0.0:1783074221.725556:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4951 00000100:00100000:0.0:1783074221.725561:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2404:x1869685708111744:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.725705:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2404:x1869685708111744:12345-192.168.204.26@tcp:2:touch.0 Request processed in 143us (244us total) trans 4294968723 rc 0/0 00000100:00100000:0.0:1783074221.725727:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4951 00000100:00100000:1.0:1783074221.728435:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074221.728524:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708112000 00000100:00100000:2.0:1783074221.728531:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708112000 00000100:00100000:2.0:1783074221.728596:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 247 00000100:00100000:2.0:1783074221.728603:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:73438:x1869685708112000:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:2.0:1783074221.728831:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:73438:x1869685708112000:12345-192.168.204.26@tcp:35:touch.0 Request processed in 228us (402us total) trans 124554051600 rc 0/0 00000100:00100000:2.0:1783074221.728847:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 247 00000100:00100000:2.0:1783074221.731214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.732302:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708112256 00000100:00100000:1.0:1783074221.732333:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708112256 00000100:00100000:1.0:1783074221.732384:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1386 00000100:00100000:1.0:1783074221.732394:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:73438:x1869685708112256:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.732416:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.732433:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0d4a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3e6 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732524:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732538:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732549:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732563:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732570:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732577:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.732843:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x786:0x0], index 0: 0 00010000:00010000:1.0:1783074221.732972:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0d5f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732982:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0d5f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.732999:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0d5f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733030:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733038:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733044:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733051:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733057:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.733062:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733070:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733081:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.733084:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.733088:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733095:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0d51 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.733107:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abaaca35 reply state 00000000f64f728e transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733123:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733130:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff9524d30b3100) 00010000:00010000:1.0:1783074221.733132:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.733135:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.733159:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0d4a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3e6 expref: 28 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733173:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0d5f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3e6 expref: 27 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.733195:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:1.0:1783074221.733197:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.733200:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52000, rc 0) 00000100:00100000:1.0:1783074221.733256:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:73438:x1869685708112256:12345-192.168.204.26@tcp:101:touch.0 Request processed in 864us (2047us total) trans 124554051601 rc 0/0 00000100:00100000:1.0:1783074221.733264:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1386 00000100:00100000:0.0:1783074221.736560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.736635:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708112512 00000100:00100000:3.0:1783074221.736641:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708112512 00000100:00100000:3.0:1783074221.736683:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1387 00000100:00100000:3.0:1783074221.736690:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:73438:x1869685708112512:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:3.0:1783074221.736743:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074221.736761:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0d5f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3e6 expref: 28 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.736774:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:3.0:1783074221.736782:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074221.736815:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.736823:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.736829:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.736903:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000659fa66f reply state 00000000f51f4cf5 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.736911:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.736915:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:3.0:1783074221.736916:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.736918:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074221.737003:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:73438:x1869685708112512:12345-192.168.204.26@tcp:36:touch.0 Request processed in 312us (447us total) trans 124554051602 rc 0/0 00000100:00100000:3.0:1783074221.737010:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1387 00000100:00100000:2.0:1783074221.740051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.740141:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708112640 00000100:00100000:0.0:1783074221.740149:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708112640 00000100:00100000:0.0:1783074221.740207:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1388 00000100:00100000:0.0:1783074221.740217:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:73438:x1869685708112640:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.740238:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.740255:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0d74 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3ed expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.740344:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0d74 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ed expref: 30 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.740359:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298c00/0x5fb609b3016e0d74 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3ed expref: 30 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.740377:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:0.0:1783074221.740380:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.740384:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298c00, rc 0) 00000100:00100000:0.0:1783074221.740438:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:73438:x1869685708112640:12345-192.168.204.26@tcp:101:touch.0 Request processed in 223us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.740443:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1388 00000100:00100000:2.0:1783074221.742100:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.742176:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708112768 00000100:00100000:1.0:1783074221.742184:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708112768 00000100:00100000:1.0:1783074221.742230:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4952 00000100:00100000:1.0:1783074221.742240:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2405:x1869685708112768:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:1.0:1783074221.742485:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2405:x1869685708112768:12345-192.168.204.26@tcp:2:touch.0 Request processed in 246us (390us total) trans 4294968724 rc 0/0 00000100:00100000:1.0:1783074221.742492:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4952 00000100:00100000:2.0:1783074221.743674:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.743735:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708113024 00000100:00100000:1.0:1783074221.743753:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708113024 00000100:00100000:1.0:1783074221.743795:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 248 00000100:00100000:1.0:1783074221.743802:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4205050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:73438:x1869685708113024:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.744073:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4205050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:73438:x1869685708113024:12345-192.168.204.26@tcp:35:touch.0 Request processed in 270us (400us total) trans 124554051603 rc 0/0 00000100:00100000:1.0:1783074221.744081:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 248 00000100:00100000:2.0:1783074221.745289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.745346:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708113280 00000100:00100000:0.0:1783074221.745352:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708113280 00000100:00100000:0.0:1783074221.745398:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1389 00000100:00100000:0.0:1783074221.745407:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:73438:x1869685708113280:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.745440:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.745460:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0d7b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3f4 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.745554:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.745568:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.745578:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.745592:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.745598:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.745604:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.745944:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x787:0x0], index 0: 0 00010000:00010000:0.0:1783074221.746082:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0d90 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746091:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0d90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746098:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0d90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746159:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746166:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746172:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746178:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.746182:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746189:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746201:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.746204:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.746209:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746214:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0d82 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.746227:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec43db34 reply state 00000000cd7d376b transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746238:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746244:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff9524e0374300) 00010000:00010000:0.0:1783074221.746252:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.746254:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074221.746277:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0d7b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3f4 expref: 34 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746286:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0d90 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3f4 expref: 33 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.746294:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524e0374700) 00010000:00010000:0.0:1783074221.746296:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074221.746298:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dbc00, rc 0) 00000100:00100000:0.0:1783074221.746380:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73438:x1869685708113280:12345-192.168.204.26@tcp:101:touch.0 Request processed in 975us (1093us total) trans 124554051604 rc 0/0 00000100:00100000:0.0:1783074221.746385:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1389 00000100:00100000:2.0:1783074221.748433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.748491:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708113536 00000100:00100000:3.0:1783074221.748499:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708113536 00000100:00100000:3.0:1783074221.748562:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1390 00000100:00100000:3.0:1783074221.748586:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73438:x1869685708113536:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:3.0:1783074221.748638:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074221.748662:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0d90 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3f4 expref: 34 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.748679:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524e0374700) 00010000:00010000:3.0:1783074221.748690:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074221.748737:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.748750:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.748759:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.748852:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd16e270 reply state 000000009bd866cc transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.748863:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.748868:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:3.0:1783074221.748871:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.748873:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074221.748953:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:73438:x1869685708113536:12345-192.168.204.26@tcp:36:touch.0 Request processed in 370us (527us total) trans 124554051605 rc 0/0 00000100:00100000:3.0:1783074221.748960:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1390 00000100:00100000:2.0:1783074221.750463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.750904:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708113664 00000100:00100000:0.0:1783074221.750910:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708113664 00000100:00100000:0.0:1783074221.750960:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1391 00000100:00100000:0.0:1783074221.750971:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:73438:x1869685708113664:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.750989:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.751005:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db000/0x5fb609b3016e0da5 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b3fb expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.751052:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db000/0x5fb609b3016e0da5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3fb expref: 36 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.751065:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db000/0x5fb609b3016e0da5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b3fb expref: 36 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.751098:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:0.0:1783074221.751101:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.751104:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021db000, rc 0) 00000100:00100000:0.0:1783074221.751148:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:73438:x1869685708113664:12345-192.168.204.26@tcp:101:touch.0 Request processed in 179us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.751154:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1391 00000100:00100000:2.0:1783074221.756105:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.756497:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708113792 00000100:00100000:1.0:1783074221.756508:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708113792 00000100:00100000:1.0:1783074221.756573:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4953 00000100:00100000:1.0:1783074221.756583:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2404:x1869685708113792:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:1.0:1783074221.756802:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2404:x1869685708113792:12345-192.168.204.26@tcp:2:touch.0 Request processed in 220us (711us total) trans 4294968725 rc 0/0 00000100:00100000:1.0:1783074221.756810:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4953 00000100:00100000:2.0:1783074221.758967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.759068:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708114048 00000100:00100000:1.0:1783074221.759076:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708114048 00000100:00100000:1.0:1783074221.759130:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 249 00000100:00100000:1.0:1783074221.759139:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:73438:x1869685708114048:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.759439:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:73438:x1869685708114048:12345-192.168.204.26@tcp:35:touch.0 Request processed in 299us (476us total) trans 124554051606 rc 0/0 00000100:00100000:1.0:1783074221.759446:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 249 00000100:00100000:2.0:1783074221.761262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.761338:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708114304 00000100:00100000:0.0:1783074221.761345:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708114304 00000100:00100000:0.0:1783074221.761410:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1392 00000100:00100000:0.0:1783074221.761418:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:73438:x1869685708114304:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.761434:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.761450:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dae00/0x5fb609b3016e0dac lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b402 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.761539:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.761553:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.761564:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.761580:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.761586:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.761612:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.761925:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x788:0x0], index 0: 0 00010000:00010000:0.0:1783074221.762066:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0dc1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762075:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0dc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762081:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0dc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762110:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762116:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762121:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762127:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762133:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.762138:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762145:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762169:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.762172:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.762176:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762183:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0db3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.762197:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061dc76d6 reply state 000000006c8d078c transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762207:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762213:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff9524e0374700) 00010000:00010000:0.0:1783074221.762216:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.762218:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074221.762246:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dae00/0x5fb609b3016e0dac lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b402 expref: 40 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762261:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0dc1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b402 expref: 39 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.762268:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:0.0:1783074221.762270:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074221.762272:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da000, rc 0) 00000100:00100000:0.0:1783074221.762367:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:73438:x1869685708114304:12345-192.168.204.26@tcp:101:touch.0 Request processed in 949us (1109us total) trans 124554051607 rc 0/0 00000100:00100000:0.0:1783074221.762376:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1392 00000100:00100000:2.0:1783074221.764268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.764705:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708114560 00000100:00100000:3.0:1783074221.764714:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708114560 00000100:00100000:3.0:1783074221.764774:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1393 00000100:00100000:3.0:1783074221.764785:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:73438:x1869685708114560:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:3.0:1783074221.765024:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074221.765060:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0dc1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b402 expref: 40 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.765078:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:3.0:1783074221.765088:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074221.765131:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.765144:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.765153:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.765239:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000656161a reply state 0000000019c34730 transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.765251:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.765258:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:3.0:1783074221.765261:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.765263:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074221.765666:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:73438:x1869685708114560:12345-192.168.204.26@tcp:36:touch.0 Request processed in 881us (1402us total) trans 124554051608 rc 0/0 00000100:00100000:3.0:1783074221.765675:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1393 00000100:00100000:2.0:1783074221.767589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.767670:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708114688 00000100:00100000:0.0:1783074221.767678:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708114688 00000100:00100000:0.0:1783074221.767731:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1394 00000100:00100000:0.0:1783074221.767740:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:73438:x1869685708114688:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.767771:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.767789:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dae00/0x5fb609b3016e0dd6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b409 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.767952:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dae00/0x5fb609b3016e0dd6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b409 expref: 42 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.767967:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dae00/0x5fb609b3016e0dd6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b409 expref: 42 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.768194:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:0.0:1783074221.768198:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.768202:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dae00, rc 0) 00000100:00100000:0.0:1783074221.768258:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:73438:x1869685708114688:12345-192.168.204.26@tcp:101:touch.0 Request processed in 519us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.768266:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1394 00000100:00100000:2.0:1783074221.770168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.770219:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708114816 00000100:00100000:3.0:1783074221.770235:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708114816 00000100:00100000:3.0:1783074221.770282:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4954 00000100:00100000:3.0:1783074221.770292:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2405:x1869685708114816:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.770587:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2405:x1869685708114816:12345-192.168.204.26@tcp:2:touch.0 Request processed in 296us (422us total) trans 4294968726 rc 0/0 00000100:00100000:3.0:1783074221.770595:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4954 00000100:00100000:2.0:1783074221.772885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.772978:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708115072 00000100:00100000:1.0:1783074221.772986:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708115072 00000100:00100000:1.0:1783074221.773038:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 250 00000100:00100000:1.0:1783074221.773047:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:73438:x1869685708115072:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.773300:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:73438:x1869685708115072:12345-192.168.204.26@tcp:35:touch.0 Request processed in 252us (422us total) trans 124554051609 rc 0/0 00000100:00100000:1.0:1783074221.773342:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 250 00000100:00100000:2.0:1783074221.775416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.775490:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708115328 00000100:00100000:0.0:1783074221.775498:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708115328 00000100:00100000:0.0:1783074221.775546:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1395 00000100:00100000:0.0:1783074221.775555:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:73438:x1869685708115328:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.775575:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.775594:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0ddd lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b410 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.775714:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.775728:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.775738:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.775751:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.775758:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.775764:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.776100:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x789:0x0], index 0: 0 00010000:00010000:0.0:1783074221.776225:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0df2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776234:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0df2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776241:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0df2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776273:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776296:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776302:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776353:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776361:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.776366:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776384:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776396:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.776398:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.776403:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776409:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0de4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.776423:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060d28ea0 reply state 00000000d502c064 transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776433:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776439:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff9524d0b7dc00) 00010000:00010000:0.0:1783074221.776447:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.776449:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074221.776474:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0ddd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b410 expref: 46 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776485:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0df2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b410 expref: 45 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.776490:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:0.0:1783074221.776491:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074221.776492:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da000, rc 0) 00000100:00100000:0.0:1783074221.776539:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+46:73438:x1869685708115328:12345-192.168.204.26@tcp:101:touch.0 Request processed in 986us (1130us total) trans 124554051610 rc 0/0 00000100:00100000:0.0:1783074221.776543:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1395 00000100:00100000:2.0:1783074221.778614:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.778753:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708115584 00000100:00100000:3.0:1783074221.778761:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708115584 00000100:00100000:1.0:1783074221.778891:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1396 00000100:00100000:1.0:1783074221.778904:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+46:73438:x1869685708115584:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:1.0:1783074221.778967:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074221.778990:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0df2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b410 expref: 46 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.779007:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:1.0:1783074221.779017:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074221.779066:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.779078:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.779087:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.779171:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f6c3dbd reply state 00000000b77a22a6 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.779180:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.779184:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:1.0:1783074221.779185:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.779187:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074221.779258:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:73438:x1869685708115584:12345-192.168.204.26@tcp:36:touch.0 Request processed in 357us (651us total) trans 124554051611 rc 0/0 00000100:00100000:1.0:1783074221.779282:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1396 00000100:00100000:2.0:1783074221.780697:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.780736:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708115712 00000100:00100000:0.0:1783074221.780752:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708115712 00000100:00100000:0.0:1783074221.780801:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1397 00000100:00100000:0.0:1783074221.780810:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:73438:x1869685708115712:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.780838:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.780852:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0e07 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b417 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.780899:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0e07 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b417 expref: 48 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.780912:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbc00/0x5fb609b3016e0e07 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b417 expref: 48 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.780959:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:0.0:1783074221.780962:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.780965:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dbc00, rc 0) 00000100:00100000:0.0:1783074221.781016:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+48:73438:x1869685708115712:12345-192.168.204.26@tcp:101:touch.0 Request processed in 207us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.781023:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1397 00000100:00100000:2.0:1783074221.783044:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.783085:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708115840 00000100:00100000:1.0:1783074221.783092:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708115840 00000100:00100000:1.0:1783074221.783144:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4955 00000100:00100000:1.0:1783074221.783155:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2404:x1869685708115840:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:1.0:1783074221.783372:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:2404:x1869685708115840:12345-192.168.204.26@tcp:2:touch.0 Request processed in 219us (332us total) trans 4294968727 rc 0/0 00000100:00100000:1.0:1783074221.783380:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4955 00000100:00100000:2.0:1783074221.784762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.784849:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708116096 00000100:00100000:1.0:1783074221.784855:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708116096 00000100:00100000:1.0:1783074221.784901:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 251 00000100:00100000:1.0:1783074221.784909:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+48:73438:x1869685708116096:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.785131:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:73438:x1869685708116096:12345-192.168.204.26@tcp:35:touch.0 Request processed in 222us (371us total) trans 124554051612 rc 0/0 00000100:00100000:1.0:1783074221.785139:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 251 00000100:00100000:2.0:1783074221.787133:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.787186:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708116352 00000100:00100000:0.0:1783074221.787194:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708116352 00000100:00100000:0.0:1783074221.787241:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1398 00000100:00100000:0.0:1783074221.787250:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:73438:x1869685708116352:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.787270:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.787289:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0e0e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b41e expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.787511:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.787526:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.787538:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.787553:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.787560:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.787585:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.787921:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78a:0x0], index 0: 0 00010000:00010000:0.0:1783074221.788058:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0e23 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788067:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0e23 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788075:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0e23 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788105:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788112:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788119:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788125:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788132:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.788136:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788143:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788166:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.788168:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.788173:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788180:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e15 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.788192:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070d005c1 reply state 00000000be8ad3ff transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788202:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788208:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff9524d0b7d700) 00010000:00010000:0.0:1783074221.788210:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.788212:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074221.788237:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0e0e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b41e expref: 52 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788251:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0e23 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b41e expref: 51 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.788258:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:0.0:1783074221.788261:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074221.788263:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299800, rc 0) 00000100:00100000:0.0:1783074221.788361:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:73438:x1869685708116352:12345-192.168.204.26@tcp:101:touch.0 Request processed in 1112us (1234us total) trans 124554051613 rc 0/0 00000100:00100000:0.0:1783074221.788370:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1398 00000100:00100000:2.0:1783074221.790241:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.790303:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708116608 00000100:00100000:1.0:1783074221.790336:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708116608 00000100:00100000:1.0:1783074221.790388:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1399 00000100:00100000:1.0:1783074221.790400:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:73438:x1869685708116608:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:1.0:1783074221.790447:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074221.790469:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0e23 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b41e expref: 52 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.790484:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:1.0:1783074221.790494:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074221.790549:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.790561:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.790569:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.790672:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000583b3d10 reply state 0000000006c57015 transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.790686:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.790692:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:1.0:1783074221.790695:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.790697:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074221.790771:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+53:73438:x1869685708116608:12345-192.168.204.26@tcp:36:touch.0 Request processed in 373us (535us total) trans 124554051614 rc 0/0 00000100:00100000:1.0:1783074221.790778:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1399 00000100:00100000:2.0:1783074221.793249:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.793419:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708116736 00000100:00100000:0.0:1783074221.793427:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708116736 00000100:00100000:0.0:1783074221.793487:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1400 00000100:00100000:0.0:1783074221.793496:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+53:73438:x1869685708116736:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.793515:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.793531:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0e38 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b425 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.793587:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0e38 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b425 expref: 54 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.793602:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298600/0x5fb609b3016e0e38 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b425 expref: 54 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.793619:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:0.0:1783074221.793621:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.793624:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3298600, rc 0) 00000100:00100000:0.0:1783074221.793669:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+54:73438:x1869685708116736:12345-192.168.204.26@tcp:101:touch.0 Request processed in 174us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.793676:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1400 00000100:00100000:2.0:1783074221.795111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.795249:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708116864 00000100:00100000:3.0:1783074221.795256:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708116864 00000100:00100000:3.0:1783074221.795298:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4956 00000100:00100000:3.0:1783074221.795307:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:2405:x1869685708116864:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.795496:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2405:x1869685708116864:12345-192.168.204.26@tcp:2:touch.0 Request processed in 189us (388us total) trans 4294968728 rc 0/0 00000100:00100000:3.0:1783074221.795503:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4956 00000100:00100000:2.0:1783074221.796511:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.796565:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708117120 00000100:00100000:1.0:1783074221.796571:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708117120 00000100:00100000:1.0:1783074221.796608:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 252 00000100:00100000:1.0:1783074221.796616:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+54:73438:x1869685708117120:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.796992:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+55:73438:x1869685708117120:12345-192.168.204.26@tcp:35:touch.0 Request processed in 376us (482us total) trans 124554051615 rc 0/0 00000100:00100000:1.0:1783074221.797000:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 252 00000100:00100000:2.0:1783074221.800139:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.800249:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708117376 00000100:00100000:0.0:1783074221.800257:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708117376 00000100:00100000:0.0:1783074221.800384:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1401 00000100:00100000:0.0:1783074221.800396:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+55:73438:x1869685708117376:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.800416:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.800435:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0e3f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b42c expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.800605:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.800618:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.800628:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.800642:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.800648:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.800655:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.800906:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78b:0x0], index 0: 0 00010000:00010000:0.0:1783074221.801031:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e54 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801040:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e54 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801047:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e54 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801077:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801094:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801100:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801106:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801112:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.801116:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801123:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801133:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.801136:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.801140:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801146:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0e46 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.801158:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000469725bc reply state 00000000a68c78fc transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801168:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801174:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff9524d0b7d900) 00010000:00010000:0.0:1783074221.801181:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.801183:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074221.801207:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0e3f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b42c expref: 58 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801220:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e54 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b42c expref: 57 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.801227:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074221.801229:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074221.801231:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9c00, rc 0) 00000100:00100000:0.0:1783074221.801292:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+58:73438:x1869685708117376:12345-192.168.204.26@tcp:101:touch.0 Request processed in 900us (1160us total) trans 124554051616 rc 0/0 00000100:00100000:0.0:1783074221.801305:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1401 00000100:00100000:2.0:1783074221.803052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.803230:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708117632 00000100:00100000:1.0:1783074221.803239:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708117632 00000100:00100000:0.0:1783074221.803374:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1402 00000100:00100000:0.0:1783074221.803387:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+58:73438:x1869685708117632:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.803437:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.803457:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e54 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b42c expref: 58 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.803476:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074221.803485:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.803536:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.803547:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.803555:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.803653:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008c82db0 reply state 000000001d3b3cbb transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.803664:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.803670:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:0.0:1783074221.803672:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.803674:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.803740:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+59:73438:x1869685708117632:12345-192.168.204.26@tcp:36:touch.0 Request processed in 356us (692us total) trans 124554051617 rc 0/0 00000100:00100000:0.0:1783074221.803747:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1402 00000100:00100000:2.0:1783074221.804835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.804889:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708117760 00000100:00100000:3.0:1783074221.804895:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708117760 00000100:00100000:3.0:1783074221.804933:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1403 00000100:00100000:3.0:1783074221.804955:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+59:73438:x1869685708117760:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:3.0:1783074221.804970:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074221.804982:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016e0e69 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b433 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.805019:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016e0e69 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b433 expref: 60 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.805030:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145c00/0x5fb609b3016e0e69 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b433 expref: 60 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.805142:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:3.0:1783074221.805145:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783074221.805149:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4145c00, rc 0) 00000100:00100000:3.0:1783074221.805252:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+60:73438:x1869685708117760:12345-192.168.204.26@tcp:101:touch.0 Request processed in 299us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074221.805261:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1403 00000100:00100000:2.0:1783074221.807017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.807067:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708117888 00000100:00100000:3.0:1783074221.807074:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708117888 00000100:00100000:3.0:1783074221.807121:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4957 00000100:00100000:3.0:1783074221.807130:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2404:x1869685708117888:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.807299:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2404:x1869685708117888:12345-192.168.204.26@tcp:2:touch.0 Request processed in 170us (285us total) trans 4294968729 rc 0/0 00000100:00100000:3.0:1783074221.807306:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4957 00000100:00100000:2.0:1783074221.808831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.808892:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708118144 00000100:00100000:1.0:1783074221.808899:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708118144 00000100:00100000:1.0:1783074221.808946:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 253 00000100:00100000:1.0:1783074221.808957:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+60:73438:x1869685708118144:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.809177:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+61:73438:x1869685708118144:12345-192.168.204.26@tcp:35:touch.0 Request processed in 222us (348us total) trans 124554051618 rc 0/0 00000100:00100000:1.0:1783074221.809184:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 253 00000100:00100000:2.0:1783074221.813023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.813099:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708118400 00000100:00100000:0.0:1783074221.813109:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708118400 00000100:00100000:0.0:1783074221.813163:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1404 00000100:00100000:0.0:1783074221.813173:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+61:73438:x1869685708118400:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.813194:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.813212:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0e70 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b43a expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.813302:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.813424:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.813437:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.813466:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.813473:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.813479:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783074221.813970:0:66200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78c:0x0], index 0: 0 00010000:00010000:0.0:1783074221.814090:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0e85 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814099:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0e85 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814107:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0e85 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814136:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814143:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814149:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814155:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814160:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074221.814170:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814177:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814189:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074221.814192:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074221.814195:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814202:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0e77 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.814213:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001622c91b reply state 000000006c626eab transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814223:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814229:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074221.814231:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.814233:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074221.814258:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0e70 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b43a expref: 64 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814271:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0e85 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b43a expref: 63 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.814278:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074221.814280:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074221.814287:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9a00, rc 0) 00000100:00100000:0.0:1783074221.814753:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+64:73438:x1869685708118400:12345-192.168.204.26@tcp:101:touch.0 Request processed in 1581us (1738us total) trans 124554051619 rc 0/0 00000100:00100000:0.0:1783074221.814762:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1404 00000100:00100000:2.0:1783074221.817766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.817848:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708118656 00000100:00100000:0.0:1783074221.817856:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708118656 00000100:00100000:0.0:1783074221.817945:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1405 00000100:00100000:0.0:1783074221.817955:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+64:73438:x1869685708118656:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.818004:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.818038:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0e85 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b43a expref: 64 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.818055:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074221.818064:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.818108:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.818120:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.818129:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.818220:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007edd4220 reply state 000000004c5fb252 transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.818231:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.818237:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:0.0:1783074221.818245:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.818248:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.818365:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+65:73438:x1869685708118656:12345-192.168.204.26@tcp:36:touch.0 Request processed in 411us (605us total) trans 124554051620 rc 0/0 00000100:00100000:0.0:1783074221.818373:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1405 00000100:00100000:2.0:1783074221.819799:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.819859:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708118784 00000100:00100000:3.0:1783074221.819865:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708118784 00000100:00100000:3.0:1783074221.819902:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1406 00000100:00100000:3.0:1783074221.819911:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+65:73438:x1869685708118784:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:3.0:1783074221.819926:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074221.819954:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016e0e9a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b441 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.819994:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016e0e9a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b441 expref: 66 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.820006:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144a00/0x5fb609b3016e0e9a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b441 expref: 66 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.820030:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:3.0:1783074221.820034:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783074221.820037:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144a00, rc 0) 00000100:00100000:3.0:1783074221.820077:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+66:73438:x1869685708118784:12345-192.168.204.26@tcp:101:touch.0 Request processed in 167us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074221.820084:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1406 00000100:00100000:3.0:1783074221.821373:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.821428:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708118912 00000100:00100000:0.0:1783074221.821434:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708118912 00000100:00100000:0.0:1783074221.821486:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4958 00000100:00100000:0.0:1783074221.821494:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2405:x1869685708118912:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.821663:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:2405:x1869685708118912:12345-192.168.204.26@tcp:2:touch.0 Request processed in 170us (292us total) trans 4294968730 rc 0/0 00000100:00100000:0.0:1783074221.821671:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4958 00000100:00100000:2.0:1783074221.823456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.823634:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708119168 00000100:00100000:1.0:1783074221.823641:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708119168 00000100:00100000:1.0:1783074221.823716:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 254 00000100:00100000:1.0:1783074221.823725:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4205450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+66:73438:x1869685708119168:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.823952:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4205450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+67:73438:x1869685708119168:12345-192.168.204.26@tcp:35:touch.0 Request processed in 227us (498us total) trans 124554051621 rc 0/0 00000100:00100000:1.0:1783074221.823960:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 254 00000100:00100000:2.0:1783074221.825502:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.825544:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708119424 00000100:00100000:0.0:1783074221.825551:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708119424 00000100:00100000:2.0:1783074221.825648:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1407 00000100:00100000:2.0:1783074221.825679:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+67:73438:x1869685708119424:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:2.0:1783074221.825696:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074221.825715:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0ea1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b448 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.825799:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.825810:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.825817:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.825826:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.825830:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.825834:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783074221.827201:0:67186:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78d:0x0], index 0: 0 00010000:00010000:2.0:1783074221.827356:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0eb6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827368:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0eb6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827376:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0eb6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827407:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827413:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827419:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827426:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827432:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074221.827436:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827442:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827464:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074221.827467:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074221.827477:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827484:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e0ea8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074221.827498:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097f7421a reply state 000000001eddec35 transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827509:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827515:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff9524f4575c00) 00010000:00010000:2.0:1783074221.827517:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074221.827520:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783074221.827568:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e0ea1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b448 expref: 70 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827582:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0eb6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b448 expref: 69 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074221.827589:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524f4575b00) 00010000:00010000:2.0:1783074221.827591:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074221.827593:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7c00, rc 0) 00000100:00100000:2.0:1783074221.827658:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+70:73438:x1869685708119424:12345-192.168.204.26@tcp:101:touch.0 Request processed in 1984us (2160us total) trans 124554051622 rc 0/0 00000100:00100000:2.0:1783074221.827667:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1407 00000100:00100000:2.0:1783074221.830593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.830800:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708119680 00000100:00100000:0.0:1783074221.830813:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708119680 00000100:00100000:0.0:1783074221.830881:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1408 00000100:00100000:0.0:1783074221.830894:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+70:73438:x1869685708119680:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.830954:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.830976:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e0eb6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b448 expref: 70 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.830993:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524f4575b00) 00010000:00010000:0.0:1783074221.831004:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.831202:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.831215:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.831232:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.831360:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002524b42b reply state 000000009d3a3797 transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.831377:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.831383:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:0.0:1783074221.831386:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.831389:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.831983:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+71:73438:x1869685708119680:12345-192.168.204.26@tcp:36:touch.0 Request processed in 1091us (1395us total) trans 124554051623 rc 0/0 00000100:00100000:0.0:1783074221.831990:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1408 00000100:00100000:0.0:1783074221.833560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.833619:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708119808 00000100:00100000:3.0:1783074221.833633:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708119808 00000100:00100000:3.0:1783074221.833685:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1409 00000100:00100000:3.0:1783074221.833706:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+71:73438:x1869685708119808:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:3.0:1783074221.833726:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074221.833744:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016e0ecb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b44f expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.833787:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016e0ecb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b44f expref: 72 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.833800:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144000/0x5fb609b3016e0ecb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b44f expref: 72 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.833816:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:3.0:1783074221.833819:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783074221.833822:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524e4144000, rc 0) 00000100:00100000:3.0:1783074221.833869:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+72:73438:x1869685708119808:12345-192.168.204.26@tcp:101:touch.0 Request processed in 165us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074221.833885:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1409 00000100:00100000:2.0:1783074221.835490:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.838023:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708119936 00000100:00100000:0.0:1783074221.838032:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708119936 00000100:00100000:0.0:1783074221.838100:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4959 00000100:00100000:0.0:1783074221.838110:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:2404:x1869685708119936:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.838325:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:2404:x1869685708119936:12345-192.168.204.26@tcp:2:touch.0 Request processed in 199us (2821us total) trans 4294968731 rc 0/0 00000100:00100000:0.0:1783074221.838335:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4959 00000100:00100000:2.0:1783074221.839812:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.839884:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708120192 00000100:00100000:1.0:1783074221.839891:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708120192 00000100:00100000:1.0:1783074221.839931:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 255 00000100:00100000:1.0:1783074221.839951:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+72:73438:x1869685708120192:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.840189:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+73:73438:x1869685708120192:12345-192.168.204.26@tcp:35:touch.0 Request processed in 240us (390us total) trans 124554051624 rc 0/0 00000100:00100000:1.0:1783074221.840194:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 255 00000100:00100000:2.0:1783074221.841393:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.841427:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708120448 00000100:00100000:1.0:1783074221.841431:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708120448 00000100:00100000:1.0:1783074221.841469:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1410 00000100:00100000:1.0:1783074221.841477:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+73:73438:x1869685708120448:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.841501:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.841517:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016e0ed2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b456 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.841580:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.841591:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.841600:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.841613:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.841620:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.841639:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.841873:0:67186:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78e:0x0], index 0: 0 00010000:00010000:1.0:1783074221.841999:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0ee7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842009:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0ee7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842017:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0ee7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842056:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842061:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842064:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842068:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842072:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.842074:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842079:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842087:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.842089:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.842100:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842106:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0ed9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.842119:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac2d080f reply state 0000000051d96eed transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842129:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842142:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff9524d30b3800) 00010000:00010000:1.0:1783074221.842144:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.842146:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.842167:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016e0ed2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b456 expref: 76 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842177:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0ee7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b456 expref: 75 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.842182:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d30b3f00) 00010000:00010000:1.0:1783074221.842183:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.842185:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52000, rc 0) 00000100:00100000:1.0:1783074221.842223:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+76:73438:x1869685708120448:12345-192.168.204.26@tcp:101:touch.0 Request processed in 748us (833us total) trans 124554051625 rc 0/0 00000100:00100000:1.0:1783074221.842228:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1410 00000100:00100000:2.0:1783074221.844150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.844199:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708120704 00000100:00100000:0.0:1783074221.844206:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708120704 00000100:00100000:0.0:1783074221.844249:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1411 00000100:00100000:0.0:1783074221.844259:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+76:73438:x1869685708120704:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.844334:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.844354:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0ee7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b456 expref: 76 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.844370:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d30b3f00) 00010000:00010000:0.0:1783074221.844380:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.844417:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.844428:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.844435:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.844517:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a753735 reply state 0000000044d07cc7 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.844529:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.844535:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074221.844538:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.844540:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.844601:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+77:73438:x1869685708120704:12345-192.168.204.26@tcp:36:touch.0 Request processed in 344us (453us total) trans 124554051626 rc 0/0 00000100:00100000:0.0:1783074221.844610:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1411 00000100:00100000:2.0:1783074221.846492:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.846591:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708120832 00000100:00100000:0.0:1783074221.846598:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708120832 00000100:00100000:0.0:1783074221.846638:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1412 00000100:00100000:0.0:1783074221.846657:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+77:73438:x1869685708120832:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:0.0:1783074221.846671:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074221.846683:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9000/0x5fb609b3016e0efc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b45d expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.846716:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9000/0x5fb609b3016e0efc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b45d expref: 78 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.846724:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9000/0x5fb609b3016e0efc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b45d expref: 78 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.846735:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074221.846737:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783074221.846739:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9000, rc 0) 00000100:00100000:0.0:1783074221.846776:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+78:73438:x1869685708120832:12345-192.168.204.26@tcp:101:touch.0 Request processed in 123us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074221.846781:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1412 00000100:00100000:2.0:1783074221.848752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.848803:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708120960 00000100:00100000:3.0:1783074221.848811:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708120960 00000100:00100000:3.0:1783074221.848859:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4960 00000100:00100000:3.0:1783074221.848870:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:2405:x1869685708120960:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.849075:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:2405:x1869685708120960:12345-192.168.204.26@tcp:2:touch.0 Request processed in 206us (326us total) trans 4294968732 rc 0/0 00000100:00100000:3.0:1783074221.849084:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4960 00000100:00100000:2.0:1783074221.850437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.850459:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708121216 00000100:00100000:1.0:1783074221.850466:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708121216 00000100:00100000:1.0:1783074221.850499:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 256 00000100:00100000:1.0:1783074221.850512:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+78:73438:x1869685708121216:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.850918:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+79:73438:x1869685708121216:12345-192.168.204.26@tcp:35:touch.0 Request processed in 412us (483us total) trans 124554051627 rc 0/0 00000100:00100000:1.0:1783074221.850923:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 256 00000100:00100000:2.0:1783074221.852691:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.852774:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708121472 00000100:00100000:3.0:1783074221.852781:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708121472 00000100:00100000:3.0:1783074221.852824:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1413 00000100:00100000:3.0:1783074221.852833:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+79:73438:x1869685708121472:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:3.0:1783074221.852853:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074221.852870:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016e0f03 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b464 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.852968:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.852982:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.852992:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853004:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853028:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853035:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783074221.853303:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78f:0x0], index 0: 0 00010000:00010000:3.0:1783074221.853457:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e0f18 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853466:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e0f18 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853474:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e0f18 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853505:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853511:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853517:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853523:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074221.853528:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853534:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853559:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:3.0:1783074221.853562:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074221.853567:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853573:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144c00/0x5fb609b3016e0f0a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074221.853591:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091ec06c6 reply state 0000000099572b8e transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853600:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853604:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff9524f44eea00) 00010000:00010000:3.0:1783074221.853606:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074221.853607:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783074221.853635:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145800/0x5fb609b3016e0f03 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b464 expref: 82 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853651:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e0f18 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b464 expref: 81 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074221.853659:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524f44ee800) 00010000:00010000:3.0:1783074221.853661:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783074221.853663:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bda00, rc 0) 00000100:00100000:3.0:1783074221.853717:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+82:73438:x1869685708121472:12345-192.168.204.26@tcp:101:touch.0 Request processed in 882us (1027us total) trans 124554051628 rc 0/0 00000100:00100000:3.0:1783074221.853723:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1413 00000100:00100000:2.0:1783074221.855443:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.855496:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708121728 00000100:00100000:0.0:1783074221.855504:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708121728 00000100:00100000:0.0:1783074221.855560:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1414 00000100:00100000:0.0:1783074221.855571:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+82:73438:x1869685708121728:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.855617:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.855651:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e0f18 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b464 expref: 82 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.855669:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524f44ee800) 00010000:00010000:0.0:1783074221.855678:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.855733:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.855744:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.855761:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.855852:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c40fa9e reply state 000000001a0bb6f3 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.855862:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.855868:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:0.0:1783074221.855870:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.855873:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.855954:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+83:73438:x1869685708121728:12345-192.168.204.26@tcp:36:touch.0 Request processed in 385us (514us total) trans 124554051629 rc 0/0 00000100:00100000:0.0:1783074221.855962:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1414 00000100:00100000:2.0:1783074221.857086:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.857127:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708121856 00000100:00100000:1.0:1783074221.857134:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708121856 00000100:00100000:1.0:1783074221.857173:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1415 00000100:00100000:1.0:1783074221.857182:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+83:73438:x1869685708121856:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.857208:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.857222:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016e0f2d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b46b expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.857262:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016e0f2d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b46b expref: 84 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.857305:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53400/0x5fb609b3016e0f2d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b46b expref: 84 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.857353:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:1.0:1783074221.857356:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.857359:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53400, rc 0) 00000100:00100000:1.0:1783074221.857397:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+84:73438:x1869685708121856:12345-192.168.204.26@tcp:101:touch.0 Request processed in 217us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.857404:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1415 00000100:00100000:2.0:1783074221.858814:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.858916:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708121984 00000100:00100000:3.0:1783074221.858923:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708121984 00000100:00100000:3.0:1783074221.858975:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4961 00000100:00100000:3.0:1783074221.858986:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:2404:x1869685708121984:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.859217:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:2404:x1869685708121984:12345-192.168.204.26@tcp:2:touch.0 Request processed in 233us (405us total) trans 4294968733 rc 0/0 00000100:00100000:3.0:1783074221.859226:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4961 00000100:00100000:2.0:1783074221.860666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.860718:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708122240 00000100:00100000:1.0:1783074221.860725:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708122240 00000100:00100000:1.0:1783074221.860769:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 257 00000100:00100000:1.0:1783074221.860778:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+84:73438:x1869685708122240:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.861023:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+85:73438:x1869685708122240:12345-192.168.204.26@tcp:35:touch.0 Request processed in 245us (361us total) trans 124554051630 rc 0/0 00000100:00100000:1.0:1783074221.861031:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 257 00000100:00100000:2.0:1783074221.862374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.862682:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708122496 00000100:00100000:1.0:1783074221.862688:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708122496 00000100:00100000:1.0:1783074221.862746:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1416 00000100:00100000:1.0:1783074221.862757:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+85:73438:x1869685708122496:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.862786:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.862805:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0f34 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b472 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.862927:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.862953:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.862964:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.862978:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.862985:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.862992:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.863248:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x790:0x0], index 0: 0 00010000:00010000:1.0:1783074221.863393:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f49 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863402:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f49 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863409:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f49 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863451:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863458:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863465:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863470:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.863474:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863481:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.863491:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.864224:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.864232:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.864239:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f3b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.864255:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c30b153 reply state 0000000078526dc6 transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.864267:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.864274:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff9524d30b3f00) 00010000:00010000:1.0:1783074221.864283:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.864286:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.864338:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0f34 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b472 expref: 88 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.864354:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f49 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b472 expref: 87 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.864362:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:1.0:1783074221.864364:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.864366:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52c00, rc 0) 00000100:00100000:1.0:1783074221.864432:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+88:73438:x1869685708122496:12345-192.168.204.26@tcp:101:touch.0 Request processed in 1677us (2060us total) trans 124554051631 rc 0/0 00000100:00100000:1.0:1783074221.864440:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1416 00000100:00100000:2.0:1783074221.866907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.866987:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708122752 00000100:00100000:0.0:1783074221.866996:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708122752 00000100:00100000:0.0:1783074221.867188:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1417 00000100:00100000:0.0:1783074221.867200:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+88:73438:x1869685708122752:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.867256:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.867280:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f49 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b472 expref: 88 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.867299:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:0.0:1783074221.867358:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.867427:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.867451:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.867465:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.867559:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc03f619 reply state 0000000029b0fd78 transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.867571:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.867578:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:0.0:1783074221.867581:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.867584:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.867676:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+89:73438:x1869685708122752:12345-192.168.204.26@tcp:36:touch.0 Request processed in 479us (774us total) trans 124554051632 rc 0/0 00000100:00100000:0.0:1783074221.867684:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1417 00000100:00100000:2.0:1783074221.872092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.872206:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708122880 00000100:00100000:1.0:1783074221.872215:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708122880 00000100:00100000:1.0:1783074221.872269:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1418 00000100:00100000:1.0:1783074221.872280:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+89:73438:x1869685708122880:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.872346:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.872365:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0f5e lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b479 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.872419:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0f5e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b479 expref: 90 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.872434:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53600/0x5fb609b3016e0f5e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b479 expref: 90 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.872465:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:1.0:1783074221.872469:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.872473:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53600, rc 0) 00000100:00100000:1.0:1783074221.872529:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+90:73438:x1869685708122880:12345-192.168.204.26@tcp:101:touch.0 Request processed in 251us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.872537:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1418 00000100:00100000:2.0:1783074221.874694:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.874762:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708123008 00000100:00100000:1.0:1783074221.874769:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708123008 00000100:00100000:1.0:1783074221.874813:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4962 00000100:00100000:1.0:1783074221.874822:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:2405:x1869685708123008:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:1.0:1783074221.875034:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:2405:x1869685708123008:12345-192.168.204.26@tcp:2:touch.0 Request processed in 212us (346us total) trans 4294968734 rc 0/0 00000100:00100000:1.0:1783074221.875042:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4962 00000100:00100000:2.0:1783074221.876879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.877007:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708123264 00000100:00100000:1.0:1783074221.877013:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708123264 00000100:00100000:1.0:1783074221.877057:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 258 00000100:00100000:1.0:1783074221.877066:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+90:73438:x1869685708123264:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.877293:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+91:73438:x1869685708123264:12345-192.168.204.26@tcp:35:touch.0 Request processed in 228us (418us total) trans 124554051633 rc 0/0 00000100:00100000:1.0:1783074221.877301:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 258 00000100:00100000:2.0:1783074221.878912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.878970:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708123520 00000100:00100000:1.0:1783074221.878977:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708123520 00000100:00100000:1.0:1783074221.879018:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1419 00000100:00100000:1.0:1783074221.879028:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+91:73438:x1869685708123520:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.879180:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.879200:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f65 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b480 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.879289:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.879303:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.879705:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.879718:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.879723:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.879727:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.880272:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x791:0x0], index 0: 0 00010000:00010000:1.0:1783074221.880422:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0f7a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880430:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0f7a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880486:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0f7a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880520:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880525:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880529:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880532:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.880535:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880539:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880547:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.880549:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.880552:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880555:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f6c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.880563:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0f5db3c reply state 0000000026b71646 transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880574:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880578:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff9524d30b3900) 00010000:00010000:1.0:1783074221.880583:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.880585:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.880607:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f65 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b480 expref: 94 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880617:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0f7a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b480 expref: 93 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.880622:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:1.0:1783074221.880623:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.880625:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa53a00, rc 0) 00000100:00100000:1.0:1783074221.880674:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+94:73438:x1869685708123520:12345-192.168.204.26@tcp:101:touch.0 Request processed in 1650us (1767us total) trans 124554051634 rc 0/0 00000100:00100000:1.0:1783074221.880679:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1419 00000100:00100000:2.0:1783074221.883279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.883354:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708123776 00000100:00100000:0.0:1783074221.883362:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708123776 00000100:00100000:0.0:1783074221.883426:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1420 00000100:00100000:0.0:1783074221.883446:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+94:73438:x1869685708123776:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.883913:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.883949:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0f7a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b480 expref: 94 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.883979:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d30b3000) 00010000:00010000:0.0:1783074221.883989:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.884042:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.884054:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.884247:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.884534:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d898243f reply state 000000009484488a transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.884547:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.884555:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:0.0:1783074221.884558:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.884560:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.884716:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+95:73438:x1869685708123776:12345-192.168.204.26@tcp:36:touch.0 Request processed in 1281us (1441us total) trans 124554051635 rc 0/0 00000100:00100000:0.0:1783074221.884724:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1420 00000100:00100000:2.0:1783074221.888524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.888597:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708123904 00000100:00100000:1.0:1783074221.888605:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708123904 00000100:00100000:1.0:1783074221.888743:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1421 00000100:00100000:1.0:1783074221.888752:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+95:73438:x1869685708123904:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.888772:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.888789:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f8f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b487 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.888838:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f8f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b487 expref: 96 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.888851:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52c00/0x5fb609b3016e0f8f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b487 expref: 96 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.888886:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:1.0:1783074221.888889:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.888892:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524faa52c00, rc 0) 00000100:00100000:1.0:1783074221.888957:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+96:73438:x1869685708123904:12345-192.168.204.26@tcp:101:touch.0 Request processed in 206us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.888964:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1421 00000100:00100000:2.0:1783074221.890865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.890909:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708124032 00000100:00100000:0.0:1783074221.890916:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708124032 00000100:00100000:0.0:1783074221.890979:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4963 00000100:00100000:0.0:1783074221.890990:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:2404:x1869685708124032:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.891282:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2404:x1869685708124032:12345-192.168.204.26@tcp:2:touch.0 Request processed in 294us (420us total) trans 4294968735 rc 0/0 00000100:00100000:0.0:1783074221.891301:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4963 00000100:00100000:2.0:1783074221.892663:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.892727:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708124288 00000100:00100000:1.0:1783074221.892733:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708124288 00000100:00100000:1.0:1783074221.892805:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 259 00000100:00100000:1.0:1783074221.892814:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+96:73438:x1869685708124288:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.893034:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+97:73438:x1869685708124288:12345-192.168.204.26@tcp:35:touch.0 Request processed in 221us (373us total) trans 124554051636 rc 0/0 00000100:00100000:1.0:1783074221.893042:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 259 00000100:00100000:2.0:1783074221.894499:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.894577:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708124544 00000100:00100000:1.0:1783074221.894584:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708124544 00000100:00100000:1.0:1783074221.894652:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1422 00000100:00100000:1.0:1783074221.894660:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+97:73438:x1869685708124544:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.894675:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.894692:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f96 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b48e expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.894777:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.894791:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.894814:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.894828:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.894835:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.894841:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074221.895049:0:94288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f4af5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94288:1869685723650432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783074221.895088:0:94288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783074221.895127:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x792:0x0], index 0: 0 00000100:00100000:3.0:1783074221.895131:0:94288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5758240 going to sleep for 11 seconds 00010000:00010000:1.0:1783074221.895235:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0fab lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895244:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0fab lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895251:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0fab lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895279:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895285:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895291:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895297:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.895307:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895335:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895351:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.895354:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.895359:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895365:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e0f9d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.895379:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1605a03 reply state 00000000c74806bc transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895389:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895395:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff9524d30b3b00) 00010000:00010000:1.0:1783074221.895398:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.895400:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.895424:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e0f96 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b48e expref: 100 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895437:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0fab lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b48e expref: 99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.895444:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:1.0:1783074221.895447:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.895454:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c3299800, rc 0) 00000100:00100000:1.0:1783074221.895497:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+100:73438:x1869685708124544:12345-192.168.204.26@tcp:101:touch.0 Request processed in 838us (1002us total) trans 124554051637 rc 0/0 00000100:00100000:1.0:1783074221.895505:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1422 00000100:00100000:0.0:1783074221.895554:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650432 00000100:00100000:0.0:1783074221.895559:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650432 00000100:00100000:0.0:1783074221.895659:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964 00000100:00100000:0.0:1783074221.895667:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:94288:x1869685723650432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783074221.895697:0:26168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1954 00000100:00100000:0.0:1783074221.897180:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:94288:x1869685723650432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1510us (2086us total) trans 4294968736 rc 0/0 00000100:00100000:0.0:1783074221.897189:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964 00000100:00100000:1.0:1783074221.897223:0:94288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f4af5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94288:1869685723650432:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783074221.897237:0:94288:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x792:0x0]-[0x280000401:0x7c1:0x0] 00000100:00080000:3.0:1783074221.897464:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783074221.897555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.897601:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708124800 00000100:00100000:0.0:1783074221.897607:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708124800 00000100:00100000:0.0:1783074221.897656:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1423 00000100:00100000:0.0:1783074221.897665:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+100:73438:x1869685708124800:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.897705:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.897725:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3299800/0x5fb609b3016e0fab lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b48e expref: 100 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.897740:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d30b3200) 00010000:00010000:0.0:1783074221.897751:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.897789:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.897799:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.897806:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.897895:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000055eb95b reply state 0000000017092270 transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.897907:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.897913:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:0.0:1783074221.897916:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.897918:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.897986:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+101:73438:x1869685708124800:12345-192.168.204.26@tcp:36:touch.0 Request processed in 323us (433us total) trans 124554051638 rc 0/0 00000100:00100000:0.0:1783074221.897991:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1423 00000100:00100000:2.0:1783074221.899115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.899159:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708124928 00000100:00100000:1.0:1783074221.899166:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708124928 00000100:00100000:1.0:1783074221.899214:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1424 00000100:00100000:1.0:1783074221.899222:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+101:73438:x1869685708124928:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.899237:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.899251:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0fc0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b495 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.899298:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0fc0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b495 expref: 102 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.899332:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158600/0x5fb609b3016e0fc0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b495 expref: 102 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.899349:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:1.0:1783074221.899352:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.899355:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3158600, rc 0) 00000100:00100000:1.0:1783074221.899409:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+102:73438:x1869685708124928:12345-192.168.204.26@tcp:101:touch.0 Request processed in 188us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.899416:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1424 00000100:00100000:2.0:1783074221.900743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.900786:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708125056 00000100:00100000:0.0:1783074221.900792:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708125056 00000100:00100000:0.0:1783074221.900836:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4965 00000100:00100000:0.0:1783074221.900845:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2405:x1869685708125056:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.901030:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2405:x1869685708125056:12345-192.168.204.26@tcp:2:touch.0 Request processed in 186us (289us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1783074221.901037:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4965 00000100:00100000:2.0:1783074221.903366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.904004:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708125312 00000100:00100000:1.0:1783074221.904025:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708125312 00000100:00100000:1.0:1783074221.904078:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 260 00000100:00100000:1.0:1783074221.904086:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4206850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+102:73438:x1869685708125312:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.904348:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4206850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+103:73438:x1869685708125312:12345-192.168.204.26@tcp:35:touch.0 Request processed in 262us (988us total) trans 124554051639 rc 0/0 00000100:00100000:1.0:1783074221.904357:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 260 00000100:00100000:2.0:1783074221.906531:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.906968:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708125568 00000100:00100000:1.0:1783074221.906976:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708125568 00000100:00100000:1.0:1783074221.907022:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1425 00000100:00100000:1.0:1783074221.907031:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+103:73438:x1869685708125568:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.907051:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.907070:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0fc7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b49c expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907154:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907168:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907178:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907193:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907200:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907206:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.907494:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x793:0x0], index 0: 0 00010000:00010000:1.0:1783074221.907604:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e0fdc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907613:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e0fdc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907620:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e0fdc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907646:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907653:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907659:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907665:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524d3158400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.907669:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907675:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907686:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.907689:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.907693:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907708:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e0fce lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.907721:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025dcca5a reply state 000000001ec107c4 transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907731:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907736:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff9524d30b3000) 00010000:00010000:1.0:1783074221.907739:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.907741:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.907764:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e0fc7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b49c expref: 106 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907778:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e0fdc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b49c expref: 105 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.907785:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524f4710300) 00010000:00010000:1.0:1783074221.907787:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.907789:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24200, rc 0) 00000100:00100000:1.0:1783074221.907849:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+106:73438:x1869685708125568:12345-192.168.204.26@tcp:101:touch.0 Request processed in 819us (1324us total) trans 124554051640 rc 0/0 00000100:00100000:1.0:1783074221.907856:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1425 00000100:00100000:2.0:1783074221.910027:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.910409:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708125824 00000100:00100000:0.0:1783074221.910418:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708125824 00000100:00100000:0.0:1783074221.910476:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1426 00000100:00100000:0.0:1783074221.910488:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+106:73438:x1869685708125824:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.910543:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.910566:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e0fdc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b49c expref: 106 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.910600:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524f4710300) 00010000:00010000:0.0:1783074221.910612:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.910663:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.910675:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.910684:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.910779:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004acd9ca4 reply state 000000006d98b6ff transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.910790:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.910796:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:0.0:1783074221.910799:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.910801:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.910885:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+107:73438:x1869685708125824:12345-192.168.204.26@tcp:36:touch.0 Request processed in 399us (863us total) trans 124554051641 rc 0/0 00000100:00100000:0.0:1783074221.910892:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1426 00000100:00100000:2.0:1783074221.912514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.912592:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708125952 00000100:00100000:1.0:1783074221.912599:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708125952 00000100:00100000:1.0:1783074221.912639:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1427 00000100:00100000:1.0:1783074221.912646:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+107:73438:x1869685708125952:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.912668:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.912682:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25e00/0x5fb609b3016e0ff1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4a3 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.912723:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25e00/0x5fb609b3016e0ff1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4a3 expref: 108 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.912735:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25e00/0x5fb609b3016e0ff1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4a3 expref: 108 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.912750:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:1.0:1783074221.912752:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.912755:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25e00, rc 0) 00000100:00100000:1.0:1783074221.912833:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+108:73438:x1869685708125952:12345-192.168.204.26@tcp:101:touch.0 Request processed in 187us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.912841:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1427 00000100:00100000:2.0:1783074221.915165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.915368:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708126080 00000100:00100000:0.0:1783074221.915381:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708126080 00000100:00100000:0.0:1783074221.915423:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4966 00000100:00100000:0.0:1783074221.915432:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2404:x1869685708126080:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.915687:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:2404:x1869685708126080:12345-192.168.204.26@tcp:2:touch.0 Request processed in 257us (529us total) trans 4294968738 rc 0/0 00000100:00100000:0.0:1783074221.915706:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4966 00000100:00100000:2.0:1783074221.918562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.918987:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708126336 00000100:00100000:1.0:1783074221.918995:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708126336 00000100:00100000:1.0:1783074221.919050:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 261 00000100:00100000:1.0:1783074221.919059:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+108:73438:x1869685708126336:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.919306:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+109:73438:x1869685708126336:12345-192.168.204.26@tcp:35:touch.0 Request processed in 246us (748us total) trans 124554051642 rc 0/0 00000100:00100000:1.0:1783074221.919339:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 261 00000100:00100000:2.0:1783074221.920826:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.920926:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708126592 00000100:00100000:1.0:1783074221.920941:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708126592 00000100:00100000:1.0:1783074221.921021:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1428 00000100:00100000:1.0:1783074221.921031:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+109:73438:x1869685708126592:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.921059:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.921085:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25000/0x5fb609b3016e0ff8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4aa expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921164:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921175:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921182:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921194:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921201:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921207:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.921522:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x794:0x0], index 0: 0 00010000:00010000:1.0:1783074221.921655:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e100d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921664:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e100d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921671:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e100d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921713:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921724:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921732:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921738:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.921742:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921750:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921763:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.921766:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.921770:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921777:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e0fff lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.921789:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cb8001b reply state 000000009147ad5f transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921800:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921807:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff9524f4710300) 00010000:00010000:1.0:1783074221.921814:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.921817:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.921845:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25000/0x5fb609b3016e0ff8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4aa expref: 112 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921858:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e100d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4aa expref: 111 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.921864:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524ca7b9c00) 00010000:00010000:1.0:1783074221.921867:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.921869:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24400, rc 0) 00000100:00100000:1.0:1783074221.921925:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+112:73438:x1869685708126592:12345-192.168.204.26@tcp:101:touch.0 Request processed in 896us (1101us total) trans 124554051643 rc 0/0 00000100:00100000:1.0:1783074221.921942:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1428 00000100:00100000:2.0:1783074221.923734:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.923794:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708126848 00000100:00100000:0.0:1783074221.923801:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708126848 00000100:00100000:0.0:1783074221.923846:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1429 00000100:00100000:0.0:1783074221.923855:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+112:73438:x1869685708126848:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.923899:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.923918:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e100d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4aa expref: 112 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.923942:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524ca7b9c00) 00010000:00010000:0.0:1783074221.923953:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.924011:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.924023:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.924033:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.924117:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f2ebcaa reply state 000000001faea4f4 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.924129:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.924135:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:0.0:1783074221.924137:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.924149:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.924223:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+113:73438:x1869685708126848:12345-192.168.204.26@tcp:36:touch.0 Request processed in 368us (493us total) trans 124554051644 rc 0/0 00000100:00100000:0.0:1783074221.924230:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1429 00000100:00100000:2.0:1783074221.929847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.929893:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708126976 00000100:00100000:1.0:1783074221.929903:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708126976 00000100:00100000:1.0:1783074221.929972:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1430 00000100:00100000:1.0:1783074221.929982:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+113:73438:x1869685708126976:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.930005:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.930023:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25000/0x5fb609b3016e1022 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4b1 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.930078:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25000/0x5fb609b3016e1022 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4b1 expref: 114 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.930356:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25000/0x5fb609b3016e1022 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4b1 expref: 114 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.930505:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:1.0:1783074221.930509:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.930513:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25000, rc 0) 00000100:00100000:1.0:1783074221.930569:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+114:73438:x1869685708126976:12345-192.168.204.26@tcp:101:touch.0 Request processed in 587us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.930773:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1430 00000100:00100000:2.0:1783074221.933499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074221.933635:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708127104 00000100:00100000:3.0:1783074221.933643:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708127104 00000100:00100000:3.0:1783074221.933696:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4967 00000100:00100000:3.0:1783074221.933705:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:2405:x1869685708127104:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:3.0:1783074221.933889:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:2405:x1869685708127104:12345-192.168.204.26@tcp:2:touch.0 Request processed in 184us (397us total) trans 4294968739 rc 0/0 00000100:00100000:3.0:1783074221.933896:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4967 00000100:00100000:2.0:1783074221.936125:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.936222:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708127360 00000100:00100000:1.0:1783074221.936229:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708127360 00000100:00100000:1.0:1783074221.936271:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 262 00000100:00100000:1.0:1783074221.936285:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+114:73438:x1869685708127360:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.936713:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+115:73438:x1869685708127360:12345-192.168.204.26@tcp:35:touch.0 Request processed in 430us (594us total) trans 124554051645 rc 0/0 00000100:00100000:1.0:1783074221.936718:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 262 00000100:00100000:2.0:1783074221.939413:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.939965:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708127616 00000100:00100000:1.0:1783074221.939974:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708127616 00000100:00100000:1.0:1783074221.940030:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1431 00000100:00100000:1.0:1783074221.940039:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+115:73438:x1869685708127616:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.940058:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.940076:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1029 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4b8 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940167:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940180:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940201:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940214:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940221:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940227:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783074221.940617:0:66201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x795:0x0], index 0: 0 00010000:00010000:1.0:1783074221.940745:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e103e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940755:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e103e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940762:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e103e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940794:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940801:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940808:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940814:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074221.940824:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940831:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940841:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074221.940843:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074221.940846:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.940859:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e1030 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074221.941012:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006ad7082 reply state 00000000c0e03858 transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.941025:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.941032:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff9524ca7b9300) 00010000:00010000:1.0:1783074221.941034:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074221.941036:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074221.941065:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1029 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4b8 expref: 118 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.941079:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e103e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4b8 expref: 117 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.941086:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524ca7b9500) 00010000:00010000:1.0:1783074221.941088:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074221.941096:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25a00, rc 0) 00000100:00100000:1.0:1783074221.941163:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+118:73438:x1869685708127616:12345-192.168.204.26@tcp:101:touch.0 Request processed in 1124us (1756us total) trans 124554051646 rc 0/0 00000100:00100000:1.0:1783074221.941171:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1431 00000100:00100000:2.0:1783074221.943618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.943708:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708127872 00000100:00100000:0.0:1783074221.943715:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708127872 00000100:00100000:0.0:1783074221.943758:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1432 00000100:00100000:0.0:1783074221.943768:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+118:73438:x1869685708127872:12345-192.168.204.26@tcp:36:touch.0 00010000:00010000:0.0:1783074221.943819:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074221.943837:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e103e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4b8 expref: 118 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.943852:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524ca7b9500) 00010000:00010000:0.0:1783074221.943863:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074221.943912:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.943923:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.943942:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074221.944033:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086926de7 reply state 00000000bbb84072 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.944042:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074221.944046:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:0.0:1783074221.944181:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074221.944183:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074221.944263:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+119:73438:x1869685708127872:12345-192.168.204.26@tcp:36:touch.0 Request processed in 496us (652us total) trans 124554051647 rc 0/0 00000100:00100000:0.0:1783074221.944270:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1432 00000100:00100000:2.0:1783074221.946277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.946349:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128000 00000100:00100000:1.0:1783074221.946356:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128000 00000100:00100000:1.0:1783074221.946409:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1433 00000100:00100000:1.0:1783074221.946418:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+119:73438:x1869685708128000:12345-192.168.204.26@tcp:101:touch.0 00010000:00010000:1.0:1783074221.946437:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074221.946558:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016e1053 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4bf expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.946610:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016e1053 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4bf expref: 120 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.946623:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25200/0x5fb609b3016e1053 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4bf expref: 120 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074221.946651:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:1.0:1783074221.946654:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783074221.946657:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25200, rc 0) 00000100:00100000:1.0:1783074221.946704:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+120:73438:x1869685708128000:12345-192.168.204.26@tcp:101:touch.0 Request processed in 288us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074221.946712:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1433 00000100:00100000:2.0:1783074221.949004:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074221.949134:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128128 00000100:00100000:0.0:1783074221.949142:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128128 00000100:00100000:0.0:1783074221.949193:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4968 00000100:00100000:0.0:1783074221.949202:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:2405:x1869685708128128:12345-192.168.204.26@tcp:2:touch.0 00000100:00100000:0.0:1783074221.949441:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:2405:x1869685708128128:12345-192.168.204.26@tcp:2:touch.0 Request processed in 239us (443us total) trans 4294968740 rc 0/0 00000100:00100000:0.0:1783074221.949450:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4968 00000100:00100000:2.0:1783074221.952266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074221.952389:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128384 00000100:00100000:1.0:1783074221.952397:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128384 00000100:00100000:1.0:1783074221.952447:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 263 00000100:00100000:1.0:1783074221.952456:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+120:73438:x1869685708128384:12345-192.168.204.26@tcp:35:touch.0 00000100:00100000:1.0:1783074221.952731:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+121:73438:x1869685708128384:12345-192.168.204.26@tcp:35:touch.0 Request processed in 274us (469us total) trans 124554051648 rc 0/0 00000100:00100000:1.0:1783074221.952739:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 263 00000100:00100000:2.0:1783074222.063397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074222.063436:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074222.063439:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128512 00000100:00100000:0.0:1783074222.063448:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128512 00000100:00100000:0.0:1783074222.063504:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:0.0:1783074222.063514:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708128512:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074222.063592:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708128512:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074222.063599:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:1.0:1783074222.063979:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128640 00000100:00100000:1.0:1783074222.063984:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128640 00000100:00100000:1.0:1783074222.064034:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 900 00000100:00100000:1.0:1783074222.064041:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2404:x1869685708128640:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074222.064082:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2404:x1869685708128640:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074222.064088:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 900 00000100:00080000:3.0:1783074222.064133:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074222.064149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074222.064186:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128768 00000100:00100000:3.0:1783074222.064191:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128768 00000100:00100000:3.0:1783074222.064301:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2207 00000100:00100000:3.0:1783074222.064329:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708128768:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074222.064390:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708128768:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074222.064399:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2207 00000100:00080000:2.0:1783074222.064661:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783074222.702528:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074223.316085:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074223.320103:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708128896 00000100:00100000:0.0:1783074223.320116:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708128896 00000100:00100000:0.0:1783074223.320203:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1434 00000100:00100000:0.0:1783074223.320214:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+121:73465:x1869685708128896:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:0.0:1783074223.320257:0:66202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444683776 avail 1298444288 00000100:00100000:0.0:1783074223.320353:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+121:73465:x1869685708128896:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 141us (4277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074223.320377:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1434 00000100:00080000:2.0:1783074223.320642:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783074223.325025:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074223.327994:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708129024 00000100:00100000:1.0:1783074223.328007:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708129024 00000100:00100000:1.0:1783074223.328083:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1435 00000100:00100000:1.0:1783074223.328098:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73465:x1869685708129024:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1783074223.328137:0:67186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:1.0:1783074223.328214:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73465:x1869685708129024:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 121us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074223.328221:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1435 00000100:00100000:1.0:1783074223.332008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074223.332992:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708129152 00000100:00100000:0.0:1783074223.333003:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708129152 00000100:00100000:0.0:1783074223.333139:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1773 00000100:00100000:0.0:1783074223.333152:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:73465:x1869685708129152:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074223.333178:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783074223.333251:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:73465:x1869685708129152:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 103us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074223.333259:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1773 00000100:00080000:2.0:1783074223.333445:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783074223.335169:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074223.335307:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708129280 00000100:00100000:0.0:1783074223.335336:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708129280 00000100:00100000:0.0:1783074223.335413:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1774 00000100:00100000:0.0:1783074223.335423:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:73465:x1869685708129280:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1783074223.335448:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074223.335519:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:73465:x1869685708129280:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074223.335526:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1774 00010000:00010000:0.0:1783074223.727863:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783074223.750258:0:94271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:0.0:1783074223.750292:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750305:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750344:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750357:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3298200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.750362:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750368:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750383:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff9524e0374d00) 00010000:00010000:0.0:1783074223.750386:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.750390:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750395:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c3298200/0x5fb609b3016e0cf6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750418:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750526:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750532:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750537:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.750540:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750546:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750564:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:0.0:1783074223.750566:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.750569:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750576:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144200/0x5fb609b3016e0d0b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750595:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750602:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750672:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750685:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.750689:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750696:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750770:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff9524d30b3d00) 00010000:00010000:0.0:1783074223.750774:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.750778:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750784:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53c00/0x5fb609b3016e0d27 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750813:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750820:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750826:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750830:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.750832:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750838:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750846:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:0.0:1783074223.750848:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.750851:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750857:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144800/0x5fb609b3016e0d3c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750868:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750874:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750879:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750891:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.750894:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750913:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750923:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff9524d30b3100) 00010000:00010000:0.0:1783074223.750926:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.750928:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750934:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52800/0x5fb609b3016e0d58 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750954:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750960:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750967:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750972:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.750974:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750980:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.750999:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:0.0:1783074223.751001:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751004:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751010:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145200/0x5fb609b3016e0d6d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751024:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751031:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751036:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751041:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751044:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751050:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751058:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff9524e0374300) 00010000:00010000:0.0:1783074223.751059:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751062:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751067:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e0d89 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751092:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751098:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751104:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751109:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751112:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751118:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751126:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:0.0:1783074223.751128:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751131:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751136:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145a00/0x5fb609b3016e0d9e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751147:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751153:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751159:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751169:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751172:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751178:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751185:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff9524e0374700) 00010000:00010000:0.0:1783074223.751187:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751189:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751195:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e0dba lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751206:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751212:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751217:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751221:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4144400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751223:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751229:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751243:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:0.0:1783074223.751245:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751248:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751254:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4144400/0x5fb609b3016e0dcf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751264:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751269:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751275:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751279:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dba00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751282:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751287:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751294:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff9524d0b7dc00) 00010000:00010000:0.0:1783074223.751297:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751299:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751305:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e0deb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751699:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751763:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751772:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751777:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751780:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751786:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751794:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:0.0:1783074223.751797:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751800:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751805:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52200/0x5fb609b3016e0e00 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751816:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751821:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751827:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751838:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.751842:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751848:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751856:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff9524d0b7d700) 00010000:00010000:0.0:1783074223.751859:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.751863:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751869:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da000/0x5fb609b3016e0e1c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751885:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.751892:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074223.751972:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968740 is committed 00000001:00080000:3.0:1783074223.751992:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968736 is committed 00010000:00010000:0.0:1783074223.752075:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752082:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752085:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752092:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752110:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:0.0:1783074223.752112:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752115:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752120:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53e00/0x5fb609b3016e0e31 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752132:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752138:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752144:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752149:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752151:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752156:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752163:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff9524d0b7d900) 00010000:00010000:0.0:1783074223.752164:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752167:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752172:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8c00/0x5fb609b3016e0e4d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752192:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752198:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752203:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752208:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752210:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752216:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752222:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:0.0:1783074223.752224:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752227:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752232:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9600/0x5fb609b3016e0e62 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752240:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752246:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752251:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752261:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752264:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752269:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752276:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074223.752278:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752280:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752286:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e0e7e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752299:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752306:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752333:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752338:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752341:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752347:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752364:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:0.0:1783074223.752366:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752370:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752375:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e0e93 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752386:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752392:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752398:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752402:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752405:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752411:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752418:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff9524f4575c00) 00010000:00010000:0.0:1783074223.752420:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752423:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752428:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e0eaf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752446:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752452:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752469:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752474:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752477:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752483:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752490:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:0.0:1783074223.752493:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752495:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752501:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e0ec4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752515:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752520:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752526:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752536:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752539:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752545:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752553:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff9524d30b3800) 00010000:00010000:0.0:1783074223.752556:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752558:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752564:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53200/0x5fb609b3016e0ee0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752580:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752586:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752591:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752597:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752600:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752618:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752636:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074223.752638:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752641:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752648:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e0ef5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752659:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752665:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752671:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752675:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524e4145e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752678:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752683:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752690:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff9524f44eea00) 00010000:00010000:0.0:1783074223.752692:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752695:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752700:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524e4145e00/0x5fb609b3016e0f11 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752731:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752736:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752742:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752747:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752750:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752756:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752763:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:0.0:1783074223.752765:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752768:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752773:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e0f26 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752783:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752788:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752794:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752803:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752806:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752812:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752819:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff9524d30b3f00) 00010000:00010000:0.0:1783074223.752821:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752823:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752829:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52600/0x5fb609b3016e0f42 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752845:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752851:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752856:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752861:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752864:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752870:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752886:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:0.0:1783074223.752889:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752891:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752907:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e0f57 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752919:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752926:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752931:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752936:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752939:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752945:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752952:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff9524d30b3900) 00010000:00010000:0.0:1783074223.752954:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.752957:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752963:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52e00/0x5fb609b3016e0f73 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752980:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752984:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752987:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752990:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021da400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.752991:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752995:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.752999:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:0.0:1783074223.753000:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753001:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753004:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021da400/0x5fb609b3016e0f88 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753010:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753014:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753019:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753029:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753032:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753037:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753045:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff9524d30b3b00) 00010000:00010000:0.0:1783074223.753048:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753051:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753058:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52000/0x5fb609b3016e0fa4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753077:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753083:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753089:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753094:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021db400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753096:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753102:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753121:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:0.0:1783074223.753124:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753127:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753133:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db400/0x5fb609b3016e0fb9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753147:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753153:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753159:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753164:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753168:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753174:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753181:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff9524d30b3000) 00010000:00010000:0.0:1783074223.753184:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753187:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753192:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e0fd5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753210:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753213:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753217:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753220:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753221:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753225:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753229:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:0.0:1783074223.753230:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753231:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753234:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53a00/0x5fb609b3016e0fea lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753240:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753244:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753247:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753253:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753255:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753258:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753262:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff9524f4710300) 00010000:00010000:0.0:1783074223.753263:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753265:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753268:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e1006 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753276:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753279:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753284:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753288:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa53800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753290:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753295:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753332:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:0.0:1783074223.753335:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753337:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753341:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa53800/0x5fb609b3016e101b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753351:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753355:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753359:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753362:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753364:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753368:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753372:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff9524ca7b9300) 00010000:00010000:0.0:1783074223.753373:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753375:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753378:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e1037 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753395:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753399:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753402:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753405:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524faa52400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.753407:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753410:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753414:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:0.0:1783074223.753416:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.753418:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.753423:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524faa52400/0x5fb609b3016e104c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074223.800197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074223.800251:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708129536 00000100:00100000:1.0:1783074223.800261:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708129536 00000100:00100000:1.0:1783074223.800456:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1436 00000100:00100000:1.0:1783074223.800469:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:73506:x1869685708129536:12345-192.168.204.26@tcp:36:mcreate.0 00010000:00010000:1.0:1783074223.800526:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074223.800562:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e0c40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b399 expref: 31 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.800584:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074223.800589:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074223.800645:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.800666:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.800687:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.800702:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.800711:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.800719:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801085:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801094:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801102:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801108:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074223.801119:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801127:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801138:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074223.801142:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074223.801145:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801153:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e105a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783074223.801164:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fce01591 reply state 00000000bb7a2c34 transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801175:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.801181:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff952502077300) 00010000:00010000:1.0:1783074223.801184:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074223.801187:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074223.801264:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:73506:x1869685708129536:12345-192.168.204.26@tcp:36:mcreate.0 Request processed in 797us (1076us total) trans 124554051649 rc 0/0 00000100:00100000:1.0:1783074223.801273:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1436 00000100:00100000:1.0:1783074223.810858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074223.810913:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708129664 00000100:00100000:3.0:1783074223.810922:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708129664 00000100:00100000:3.0:1783074223.810976:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1437 00000100:00100000:3.0:1783074223.810988:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:73509:x1869685708129664:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1783074223.811011:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074223.811030:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e1068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4c6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.811092:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e106f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.811105:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e106f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.811116:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e106f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074223.811174:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074223.811178:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074223.811200:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e106f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.811225:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e1068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4c6 expref: 34 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.811244:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e106f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4c6 expref: 33 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.811261:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:3.0:1783074223.811264:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074223.811267:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd800, rc 0) 00000100:00100000:3.0:1783074223.811355:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:73509:x1869685708129664:12345-192.168.204.26@tcp:101:rm.0 Request processed in 369us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074223.811364:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1437 00000100:00100000:3.0:1783074223.812958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074223.812995:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708129792 00000100:00100000:0.0:1783074223.813003:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708129792 00000100:00100000:0.0:1783074223.813079:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1438 00000100:00100000:0.0:1783074223.813090:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:73509:x1869685708129792:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:0.0:1783074223.813106:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074223.813123:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e1076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4cd expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813186:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813199:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813209:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813220:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813227:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813235:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813342:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813351:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813358:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074223.813398:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1783074223.813402:0:66200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783074223.813417:0:66200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813438:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813448:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813455:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813461:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813468:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813474:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.813479:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813486:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813498:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:0.0:1783074223.813501:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.813505:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813512:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e107d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813525:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813538:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813544:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813550:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074223.813553:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813560:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813569:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff952502077300) 00010000:00010000:0.0:1783074223.813572:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074223.813575:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813581:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e1084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813608:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e1076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4cd expref: 35 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813635:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4cd expref: 34 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074223.813642:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff9523c43bc800) 00010000:00010000:0.0:1783074223.813645:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074223.813654:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868800, rc 0) 00000100:00100000:0.0:1783074223.813708:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73509:x1869685708129792:12345-192.168.204.26@tcp:101:rm.0 Request processed in 620us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074223.813716:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1438 00000100:00100000:0.0:1783074223.818689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074223.818769:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708130048 00000100:00100000:1.0:1783074223.818779:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708130048 00000100:00100000:1.0:1783074223.818837:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1439 00000100:00100000:1.0:1783074223.818850:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73509:x1869685708130048:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:1.0:1783074223.818920:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783074223.818945:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e108b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4cd expref: 34 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.818964:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff9523c43bc800) 00010000:00010000:1.0:1783074223.818991:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e106f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4c6 expref: 33 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819010:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074223.819014:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074223.819040:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819053:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819062:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819072:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819079:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819099:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819193:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819213:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819220:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819438:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819446:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819452:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819457:0:66201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819472:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819479:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819497:0:66201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783074223.819518:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819524:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074223.819526:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819534:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819536:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819544:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25600 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:3.0:1783074223.819551:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819553:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074223.819560:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819565:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819567:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819587:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff952502077900) 00010000:00010000:1.0:1783074223.819589:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783074223.819592:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819597:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e10a0 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819600:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff952502077900) 00010000:00010000:3.0:1783074223.819605:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783074223.819611:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819616:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819623:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819626:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074223.819629:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819630:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819633:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819650:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25600/0x5fb609b3016e10a7 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819670:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:1.0:1783074223.819674:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074223.819678:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819680:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074223.819684:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074223.819687:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1092 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074223.819688:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1783074223.819701:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088d50517 reply state 00000000abd058d1 transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819712:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074223.819719:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff952502077300) 00010000:00010000:1.0:1783074223.819721:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074223.819724:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074223.819794:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73509:x1869685708130048:12345-192.168.204.26@tcp:36:rm.0 Request processed in 947us (1111us total) trans 124554051650 rc 0/0 00000100:00100000:1.0:1783074223.819803:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1439 00000100:00100000:0.0:1783074224.046614:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723650560:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.046679:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.046715:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723651072:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.046753:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074224.046756:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723650688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074224.046780:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723651584:0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.046798:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.046814:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074224.047008:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650560 00000100:00100000:2.0:1783074224.047015:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650560 00000100:00100000:2.0:1783074224.047063:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783074224.047074:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723650560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.047143:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c76c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723652096:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.047167:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.047188:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723652608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074224.047208:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.047234:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723650944:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.047257:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.047278:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723651456:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047286:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651072 00000100:00100000:1.0:1783074224.047292:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651072 00000100:00100000:0.0:1783074224.047298:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.047336:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723651968:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047355:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650944 00000100:00100000:0.0:1783074224.047361:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074224.047362:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650944 00000100:00100000:0.0:1783074224.047383:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723652480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074224.047389:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1783074224.047399:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723651072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.047408:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.047429:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1783074224.047443:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723650816:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047450:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723651072:12345-0@lo:400:kworker.0 Request processed in 51us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074224.047457:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1783074224.047471:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074224.047490:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650816 00000100:00100000:0.0:1783074224.047490:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723651328:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047496:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650816 00000100:00100000:0.0:1783074224.047515:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074224.047522:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1783074224.047532:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723650944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047564:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869685723650944:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074224.047570:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1783074224.047582:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1783074224.047588:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723650816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047614:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869685723650816:12345-0@lo:400:kworker.0 Request processed in 27us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074224.047621:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723651840:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047622:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1783074224.047652:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074224.047759:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723651200:0@lo:400:kworker.0 00000100:00100000:2.0:1783074224.047772:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723650560:12345-0@lo:400:kworker.0 Request processed in 700us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074224.047780:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783074224.047794:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074224.047821:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723650688 00000100:00100000:2.0:1783074224.047825:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723650688 00000100:00100000:3.0:1783074224.047830:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723651712:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.047833:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651200 00000100:00100000:1.0:1783074224.047838:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651200 00000100:00100000:3.0:1783074224.047859:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074224.047865:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1783074224.047874:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723651200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.047878:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c76c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723652224:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.047914:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723652352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074224.047926:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074224.047931:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723651200:12345-0@lo:400:kworker.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074224.047939:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1783074224.047954:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651712 00000100:00100000:1.0:1783074224.047957:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651712 00000100:00100000:2.0:1783074224.047963:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652608 00000100:00100000:2.0:1783074224.047973:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652608 00000100:00100000:1.0:1783074224.047974:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652224 00000100:00100000:1.0:1783074224.047979:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652224 00000100:00100000:2.0:1783074224.047995:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651328 00000100:00100000:1.0:1783074224.048000:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1783074224.048004:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651328 00000100:00100000:1.0:1783074224.048009:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723651712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074224.048025:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651840 00000100:00100000:2.0:1783074224.048029:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651840 00000100:00100000:2.0:1783074224.048040:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:2.0:1783074224.048046:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1869685723650688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783074224.048068:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:0.0:1783074224.049147:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074224.049174:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723651200:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.049191:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869685723650944:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.049192:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723651712:12345-0@lo:400:kworker.0 Request processed in 1182us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074224.049197:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723651712:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.049218:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1783074224.049224:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869685723650816:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.049242:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1783074224.049251:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723652224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.049259:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651584 00000100:00100000:0.0:1783074224.049265:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651584 00000100:00100000:3.0:1783074224.049269:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:3.0:1783074224.049281:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3658:x1869685723652608:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074224.049296:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723652224:12345-0@lo:400:kworker.0 Request processed in 45us (1369us total) trans 0 rc 0/0 00000004:00000024:3.0:1783074224.049305:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444683776 avail 1298444288 00000100:00100000:1.0:1783074224.049305:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1783074224.049307:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652096 00000100:00100000:0.0:1783074224.049336:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652096 00000100:00100000:0.0:1783074224.049371:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651456 00000100:00100000:3.0:1783074224.049374:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3658:x1869685723652608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074224.049375:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651456 00000100:00100000:3.0:1783074224.049386:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1783074224.049402:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723651968 00000100:00100000:0.0:1783074224.049406:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723651968 00000100:00100000:3.0:1783074224.049410:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1783074224.049419:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723651328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.049436:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:0.0:1783074224.049447:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.049468:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723651328:12345-0@lo:400:kworker.0 Request processed in 49us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074224.049477:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:0.0:1783074224.049492:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723651584:12345-0@lo:400:kworker.0 Request processed in 47us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074224.049497:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:0.0:1783074224.049504:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:3.0:1783074224.049509:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723651840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.049559:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723651840:12345-0@lo:400:kworker.0 Request processed in 53us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074224.049566:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1783074224.049622:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723650688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1574us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074224.049629:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00080000:2.0:1783074224.049649:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783074224.049652:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074224.049655:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783074224.049657:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074224.049708:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723650688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074224.049723:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c76c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723652224:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.049774:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:0.0:1783074224.049785:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723652096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.049819:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723652096:12345-0@lo:400:kworker.0 Request processed in 37us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074224.050075:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652480 00000100:00100000:1.0:1783074224.050080:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652480 00000100:00100000:1.0:1783074224.050104:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652352 00000100:00100000:1.0:1783074224.050107:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652352 00000100:00100000:1.0:1783074224.050125:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1783074224.050132:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723652480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783074224.050145:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783074224.050173:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:1.0:1783074224.050177:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723652480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074224.050185:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:3.0:1783074224.050190:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723651456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.050190:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:0.0:1783074224.050197:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1783074224.050201:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723651968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.050211:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1783074224.050221:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723652352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783074224.050239:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783074224.050258:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723651456:12345-0@lo:400:kworker.0 Request processed in 72us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074224.050258:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723651968:12345-0@lo:400:kworker.0 Request processed in 61us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074224.050278:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:1.0:1783074224.050279:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869685723652352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074224.050288:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:1.0:1783074224.050292:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:3.0:1783074224.050370:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723651328:0@lo:400:kworker.0 00000100:00100000:2.0:1783074224.050383:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723652608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074224.050391:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723651840:0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.050409:0:3661:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968736 gen 2 00000100:00100000:3.0:1783074224.050429:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723652352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783074224.050445:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723651456:0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.050457:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723651968:0@lo:400:kworker.0 00000100:00100000:3.0:1783074224.050470:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723652480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074224.050517:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723650560:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.050532:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723651072:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.050545:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723651584:0@lo:400:kworker.0 00000100:00100000:1.0:1783074224.050565:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c76c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723652096:0@lo:400:kworker.0 00000100:00100000:0.0:1783074224.558692:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c76c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723652736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074224.558761:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.558812:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652736 00000100:00100000:0.0:1783074224.558820:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652736 00000100:00100000:0.0:1783074224.558878:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1783074224.558896:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723652736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074224.558919:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074224.558963:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723652736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074224.558970:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1783074224.559016:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c76c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723652736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783074224.560451:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783074224.560465:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723652864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783074224.560509:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074224.560559:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652864 00000100:00100000:0.0:1783074224.560564:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652864 00000100:00100000:0.0:1783074224.560604:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1783074224.560613:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723652864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783074224.560629:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:0.0:1783074224.560642:0:9041:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f091b100 x1869685723652864/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:550/0 lens 224/368 e 0 to 0 dl 1783074235 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074224.560688:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869685723652864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074224.560694:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:3.0:1783074224.560766:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723652864:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783074224.751582:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074225.775707:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074226.798476:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074226.838147:0:95803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:1.0:1783074226.936988:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074226.937083:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708130176 00000100:00100000:3.0:1783074226.937093:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708130176 00000100:00100000:3.0:1783074226.937184:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1440 00000100:00100000:3.0:1783074226.937196:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73587:x1869685708130176:12345-192.168.204.26@tcp:101:dd.0 00000100:00080000:2.0:1783074226.937213:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783074226.937220:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.937258:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e10ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4d4 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.937360:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e10b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.937374:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e10b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.937386:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e10b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074226.937430:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783074226.937435:0:68632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783074226.937469:0:68632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e10b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.937508:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e10ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4d4 expref: 36 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.937524:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bca00/0x5fb609b3016e10b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4d4 expref: 35 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.937532:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:3.0:1783074226.937534:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783074226.937537:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bca00, rc 0) 00000100:00100000:3.0:1783074226.937603:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:73587:x1869685708130176:12345-192.168.204.26@tcp:101:dd.0 Request processed in 410us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074226.937611:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1440 00000100:00100000:3.0:1783074226.938601:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.938667:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708130304 00000100:00100000:2.0:1783074226.938673:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708130304 00000100:00100000:2.0:1783074226.938729:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1441 00000100:00100000:2.0:1783074226.938739:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:73588:x1869685708130304:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.938752:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.938764:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e10bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4db expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.938804:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e10c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.938815:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e10c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.938825:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e10c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074226.938864:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783074226.938868:0:67186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783074226.938894:0:67186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e10c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.938913:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e10bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4db expref: 37 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.938930:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e10c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4db expref: 36 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.938937:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:2.0:1783074226.938940:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783074226.938942:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6c00, rc 0) 00000100:00100000:2.0:1783074226.938983:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:73588:x1869685708130304:12345-192.168.204.26@tcp:101:dd.0 Request processed in 246us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074226.938995:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1441 00000100:00100000:0.0:1783074226.939451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.939595:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708130560 00000100:00100000:2.0:1783074226.939600:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708130560 00000100:00100000:2.0:1783074226.939632:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1442 00000100:00100000:2.0:1783074226.939639:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:73587:x1869685708130560:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.939648:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.939658:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7800/0x5fb609b3016e10ca lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4e2 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939746:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939756:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939764:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939777:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939785:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939792:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939829:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e10df lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939862:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e10df lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939882:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e10df lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074226.939892:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1783074226.939964:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939972:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939984:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939991:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.939996:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.940001:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940007:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940016:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074226.940018:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.940022:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940028:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7600/0x5fb609b3016e10d1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940047:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940053:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940059:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940063:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.940065:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940069:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940076:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff9524fc299900) 00010000:00010000:2.0:1783074226.940078:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.940081:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940086:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e10d8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940114:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7800/0x5fb609b3016e10ca lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4e2 expref: 39 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940173:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e10df lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4e2 expref: 38 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.940192:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:2.0:1783074226.940194:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074226.940196:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7000, rc 0) 00000100:00100000:2.0:1783074226.940229:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:73587:x1869685708130560:12345-192.168.204.26@tcp:101:dd.0 Request processed in 590us (779us total) trans 124554051651 rc 0/0 00000100:00100000:2.0:1783074226.940236:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1442 00000100:00100000:1.0:1783074226.941128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.941212:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708130688 00000100:00100000:0.0:1783074226.941218:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708130688 00000100:00100000:0.0:1783074226.941272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 716 00000100:00100000:0.0:1783074226.941280:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2402:x1869685708130688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783074226.941292:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074226.941308:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e10c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4db expref: 38 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.941380:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9524d2de4200) 00010000:00010000:0.0:1783074226.941384:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074226.941423:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:2402:x1869685708130688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 143us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.941430:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 716 00000100:00100000:3.0:1783074226.942457:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.942542:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708130944 00000100:00100000:0.0:1783074226.942610:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708130944 00000100:00100000:0.0:1783074226.942655:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1443 00000100:00100000:0.0:1783074226.942666:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:73588:x1869685708130944:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.942684:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.942699:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e10ed lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4e9 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942818:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942832:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942857:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942885:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942893:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942900:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942955:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e1102 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942964:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e1102 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.942971:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e1102 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074226.942980:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783074226.943111:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943119:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943125:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943131:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943138:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.943148:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943156:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943166:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074226.943169:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.943173:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943180:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e10f4 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943194:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943201:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943206:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943212:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.943215:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943220:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943227:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff9524f4710300) 00010000:00010000:0.0:1783074226.943230:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.943238:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943244:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e10fb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943289:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e10ed lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4e9 expref: 40 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943306:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e1102 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4e9 expref: 39 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.943335:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1783074226.943337:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:0.0:1783074226.943343:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074226.943346:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868800, rc 0) 00000100:00100000:0.0:1783074226.943393:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:73588:x1869685708130944:12345-192.168.204.26@tcp:101:dd.0 Request processed in 729us (938us total) trans 124554051652 rc 0/0 00000100:00100000:0.0:1783074226.943401:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1443 00000100:00100000:0.0:1783074226.943424:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708131072 00000100:00100000:0.0:1783074226.943429:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708131072 00000100:00100000:0.0:1783074226.943461:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1444 00000100:00100000:0.0:1783074226.943470:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:73587:x1869685708131072:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.943479:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.943489:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e1110 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4f0 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943507:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869600/0x5fb609b3016e1117 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943525:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869600/0x5fb609b3016e1117 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943545:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869600/0x5fb609b3016e1117 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943635:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e1110 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4f0 expref: 41 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943651:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869600/0x5fb609b3016e1117 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4f0 expref: 40 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.943658:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:0.0:1783074226.943660:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074226.943663:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869600, rc 0) 00000100:00100000:0.0:1783074226.943699:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:73587:x1869685708131072:12345-192.168.204.26@tcp:101:dd.0 Request processed in 231us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.943707:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1444 00000100:00100000:1.0:1783074226.946522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.946554:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.946580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.946607:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708131328 00000100:00100000:2.0:1783074226.946617:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708131328 00000100:00100000:0.0:1783074226.946662:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708131456 00000100:00100000:0.0:1783074226.946668:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708131456 00000100:00100000:2.0:1783074226.946674:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708131712 00000100:00100000:2.0:1783074226.946679:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708131712 00000100:00100000:1.0:1783074226.946691:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1445 00000100:00100000:3.0:1783074226.946701:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1446 00000100:00100000:1.0:1783074226.946707:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:73587:x1869685708131328:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:0.0:1783074226.946715:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1447 00000100:00100000:3.0:1783074226.946720:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:73588:x1869685708131456:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:0.0:1783074226.946729:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:73589:x1869685708131712:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074226.946742:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.946742:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.946763:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868600/0x5fb609b3016e111e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4fe expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.946768:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074226.946792:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e10df lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4e2 expref: 43 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.946816:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:1.0:1783074226.946821:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074226.946829:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1125 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b4f7 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.946868:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc000/0x5fb609b3016e112c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946873:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.946881:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc000/0x5fb609b3016e112c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.946903:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc000/0x5fb609b3016e112c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946904:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946918:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946936:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946945:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946952:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.946998:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1141 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.947003:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947008:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1141 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.947017:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947020:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1141 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.947024:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1125 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4f7 expref: 45 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.947034:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074226.947043:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:3.0:1783074226.947055:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc000/0x5fb609b3016e112c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4f7 expref: 44 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.947065:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:3.0:1783074226.947068:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783074226.947071:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc000, rc 0) 00000001:00080000:1.0:1783074226.947094:0:66202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051653 00010000:00010000:0.0:1783074226.947101:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947113:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947120:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.947132:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+46:73588:x1869685708131456:12345-192.168.204.26@tcp:101:dd.0 Request processed in 418us (574us total) trans 0 rc 0/0 00000004:00010000:1.0:1783074226.947136:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075376f8b reply state 00000000c7c4116a transno 124554051655 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947137:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.947145:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1446 00010000:00010000:0.0:1783074226.947156:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.947161:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947163:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.947177:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:0.0:1783074226.947180:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.947182:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074226.947187:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783074226.947196:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074226.947200:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.947204:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947211:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1133 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947222:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947228:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947233:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947238:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.947241:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.947258:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+46:73587:x1869685708131328:12345-192.168.204.26@tcp:36:dd.0 Request processed in 556us (741us total) trans 124554051655 rc 0/0 00010000:00010000:0.0:1783074226.947261:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.947269:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1445 00000020:00080000:1.0:1783074226.947275:0:66202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783074226.947276:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074226.947280:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.947284:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947290:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e113a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947348:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868600/0x5fb609b3016e111e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4fe expref: 46 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947362:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1141 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4fe expref: 45 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.947370:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:0.0:1783074226.947372:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074226.947375:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869400, rc 0) 00000100:00100000:0.0:1783074226.949133:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+45:73589:x1869685708131712:12345-192.168.204.26@tcp:101:dd.0 Request processed in 2401us (2545us total) trans 124554051654 rc 0/0 00000100:00100000:0.0:1783074226.949143:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1447 00000100:00100000:2.0:1783074226.950186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.950238:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074226.950265:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708131840 00000100:00100000:0.0:1783074226.950280:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132096 00000100:00100000:3.0:1783074226.950284:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708131840 00000100:00100000:0.0:1783074226.950287:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132096 00000100:00100000:0.0:1783074226.950352:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1448 00000100:00100000:0.0:1783074226.950363:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+45:73588:x1869685708132096:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:3.0:1783074226.950371:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4969 00000100:00100000:3.0:1783074226.950384:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:73587:x1869685708131840:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074226.950395:0:26171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1783074226.950400:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783074226.950414:0:26171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016e1156 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b505 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.950423:0:66200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783074226.950440:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x782:0x0] initial LVB size: 0, mtime: 0x6a478dac, atime: 0x6a478dac, ctime: 0x6a478dac, blocks: 0x0 00010000:00010000:0.0:1783074226.950449:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e1102 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4e9 expref: 45 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.950458:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:3.0:1783074226.950463:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074226.950465:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:0.0:1783074226.950471:0:66200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074226.950472:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016e1156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b505 expref: 6 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.950489:0:26171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016e1156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b505 expref: 6 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.950500:0:26171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc400, rc 0) 00010000:00000080:3.0:1783074226.950508:0:26171:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc304700 x1869685708131840/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074226.950558:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:73587:x1869685708131840:12345-192.168.204.26@tcp:101:dd.0 Request processed in 177us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074226.950564:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4969 00010000:00010000:0.0:1783074226.950871:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.950883:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.950892:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074226.950936:0:66200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051656 00000004:00010000:0.0:1783074226.950956:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d97ae46 reply state 00000000ad3b9427 transno 124554051657 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.950966:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.950972:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:0.0:1783074226.950974:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074226.950976:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074226.951029:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:73588:x1869685708132096:12345-192.168.204.26@tcp:36:dd.0 Request processed in 669us (790us total) trans 124554051657 rc 0/0 00000100:00100000:0.0:1783074226.951271:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1448 00000020:00080000:0.0:1783074226.951276:0:66200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074226.953551:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.953590:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.953639:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132352 00000100:00100000:1.0:1783074226.953648:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132352 00000100:00100000:1.0:1783074226.953705:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1449 00000100:00100000:1.0:1783074226.953717:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:73589:x1869685708132352:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074226.953739:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074226.953757:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e1164 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b50c expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.953761:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132224 00000100:00100000:0.0:1783074226.953778:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132224 00010000:00010000:1.0:1783074226.953787:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24600/0x5fb609b3016e116b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.953798:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24600/0x5fb609b3016e116b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.953801:0:8450:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.953805:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc305f80 with x1869685708132224 ext(0->18446744073709551615) 00010000:00010000:1.0:1783074226.953808:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24600/0x5fb609b3016e116b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.953812:0:8450:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc305f80. 00010000:00010000:1.0:1783074226.953929:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e1164 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b50c expref: 49 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.953947:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24600/0x5fb609b3016e116b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b50c expref: 48 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.953955:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:1.0:1783074226.953958:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074226.953961:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24600, rc 0) 00000100:00100000:0.0:1783074226.953967:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 526 00000100:00100000:0.0:1783074226.953975:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2404:x1869685708132224:12345-192.168.204.26@tcp:10:dd.0 00000100:00100000:1.0:1783074226.954140:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+48:73589:x1869685708132352:12345-192.168.204.26@tcp:101:dd.0 Request processed in 426us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074226.954147:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1449 00002000:00010000:0.0:1783074226.954150:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074226.954153:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb mtime from disk: 1783074220 -> 1783074226 00002000:00010000:0.0:1783074226.954156:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb atime from disk: 1783074220 -> 1783074220 00002000:00010000:0.0:1783074226.954158:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb ctime from disk: 1783074220 -> 1783074226 00002000:00010000:0.0:1783074226.954160:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783074226.954168:0:8450:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc305f80 x1869685708132224/t4294968741(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074226.954206:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2404:x1869685708132224:12345-192.168.204.26@tcp:10:dd.0 Request processed in 232us (663us total) trans 4294968741 rc 0/0 00000100:00100000:0.0:1783074226.954213:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 526 00002000:00010000:0.0:1783074226.954216:0:8450:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.954219:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc305f80 with x1869685708132224 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.954223:0:8450:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc305f80. 00000100:00100000:2.0:1783074226.954360:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.954407:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132480 00000100:00100000:1.0:1783074226.954410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.954411:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132480 00000100:00100000:2.0:1783074226.954436:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4970 00000100:00100000:2.0:1783074226.954443:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:73588:x1869685708132480:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.954451:0:26178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.954463:0:26178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea10fd93/0x5fb609b3016e1172 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b513 expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074226.954480:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x783:0x0] initial LVB size: 0, mtime: 0x6a478dac, atime: 0x6a478dac, ctime: 0x6a478dac, blocks: 0x0 00010000:00010000:2.0:1783074226.954491:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:2.0:1783074226.954496:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074226.954509:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea10fd93/0x5fb609b3016e1172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b513 expref: 8 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.954523:0:26178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea10fd93/0x5fb609b3016e1172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b513 expref: 8 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.954533:0:26178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7600, rc 0) 00010000:00000080:2.0:1783074226.954538:0:26178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc305500 x1869685708132480/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074226.954573:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:73588:x1869685708132480:12345-192.168.204.26@tcp:101:dd.0 Request processed in 130us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074226.954578:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4970 00000100:00100000:0.0:1783074226.954651:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132736 00000100:00100000:0.0:1783074226.954656:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132736 00000100:00100000:0.0:1783074226.954686:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1450 00000100:00100000:0.0:1783074226.954693:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+48:73590:x1869685708132736:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.954700:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.954710:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1179 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b51a expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954808:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954817:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954824:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954856:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954863:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954868:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954920:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e118e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954928:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e118e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.954935:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e118e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074226.954944:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1783074226.954995:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955007:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955019:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955025:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955031:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.955035:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955042:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955103:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074226.955106:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.955110:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955114:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e1180 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955125:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955131:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955137:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955142:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.955151:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955158:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955165:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074226.955167:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.955170:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955176:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e1187 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955208:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1179 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b51a expref: 51 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955217:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e118e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b51a expref: 50 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.955224:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:0.0:1783074226.955227:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074226.955229:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869a00, rc 0) 00000100:00100000:0.0:1783074226.955265:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+50:73590:x1869685708132736:12345-192.168.204.26@tcp:101:dd.0 Request processed in 572us (854us total) trans 124554051658 rc 0/0 00000100:00100000:0.0:1783074226.955270:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1450 00000100:00100000:3.0:1783074226.956452:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.956566:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132864 00000100:00100000:2.0:1783074226.956572:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132864 00002000:00010000:2.0:1783074226.956598:0:8448:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:2.0:1783074226.956602:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4588700 with x1869685708132864 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074226.956610:0:8448:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4588700. 00000100:00100000:2.0:1783074226.956641:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 527 00000100:00100000:2.0:1783074226.956658:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2403:x1869685708132864:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:2.0:1783074226.956782:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783074226.956786:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb mtime from disk: 1783074220 -> 1783074226 00002000:00010000:2.0:1783074226.956788:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb atime from disk: 1783074220 -> 1783074220 00002000:00010000:2.0:1783074226.956790:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb ctime from disk: 1783074220 -> 1783074226 00002000:00010000:2.0:1783074226.956792:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783074226.956800:0:8448:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4588700 x1869685708132864/t4294968742(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074226.956877:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2403:x1869685708132864:12345-192.168.204.26@tcp:10:dd.0 Request processed in 221us (421us total) trans 4294968742 rc 0/0 00000100:00100000:2.0:1783074226.956884:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 527 00002000:00010000:2.0:1783074226.956888:0:8448:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:2.0:1783074226.956890:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4588700 with x1869685708132864 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074226.956895:0:8448:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4588700. 00000100:00100000:1.0:1783074226.959883:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.959918:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.959953:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.960011:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708133120 00000100:00100000:0.0:1783074226.960020:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708133120 00000100:00100000:0.0:1783074226.960075:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708133248 00000100:00100000:0.0:1783074226.960079:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708133248 00000100:00100000:3.0:1783074226.960090:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708133504 00000100:00100000:3.0:1783074226.960097:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708133504 00000100:00100000:2.0:1783074226.960289:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1451 00000100:00100000:2.0:1783074226.960301:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:73589:x1869685708133120:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:0.0:1783074226.960342:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1452 00000100:00100000:3.0:1783074226.960356:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1453 00000100:00100000:0.0:1783074226.960357:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:73590:x1869685708133248:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:3.0:1783074226.960374:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:73591:x1869685708133504:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.960379:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.960385:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.960400:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e11a3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b528 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.960401:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e119c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b521 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.960422:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074226.960443:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1141 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b4fe expref: 54 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.960445:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868600/0x5fb609b3016e11aa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.960465:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:0.0:1783074226.960465:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868600/0x5fb609b3016e11aa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.960474:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074226.960479:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868600/0x5fb609b3016e11aa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.960559:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e119c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b521 expref: 54 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.960573:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868600/0x5fb609b3016e11aa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b521 expref: 53 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.960581:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:0.0:1783074226.960585:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074226.960588:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868600, rc 0) 00010000:00010000:2.0:1783074226.960630:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.960642:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960646:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960657:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.960661:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+54:73590:x1869685708133248:12345-192.168.204.26@tcp:101:dd.0 Request processed in 308us (740us total) trans 0 rc 0/0 00010000:00010000:2.0:1783074226.960664:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960671:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.960680:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1452 00010000:00010000:3.0:1783074226.960697:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960705:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960712:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.960722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000001:00080000:2.0:1783074226.960723:0:67186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051659 00000004:00010000:2.0:1783074226.960745:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005244103f reply state 000000000c50144b transno 124554051660 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960761:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016e11c6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.960769:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.960771:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016e11c6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.960783:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708133760 00010000:00010000:2.0:1783074226.960789:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00000100:00100000:0.0:1783074226.960790:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708133760 00010000:00010000:3.0:1783074226.960791:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016e11c6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.960793:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074226.960798:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074226.960815:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000004:00200000:3.0:1783074226.960819:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00000100:00100000:1.0:1783074226.960853:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708134016 00000100:00100000:1.0:1783074226.960859:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708134016 00000100:00100000:2.0:1783074226.960866:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+57:73589:x1869685708133120:12345-192.168.204.26@tcp:36:dd.0 Request processed in 568us (990us total) trans 124554051660 rc 0/0 00000100:00100000:2.0:1783074226.960873:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1451 00000020:00080000:2.0:1783074226.960877:0:67186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783074226.960890:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 264 00000100:00100000:1.0:1783074226.960897:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 265 00000100:00100000:0.0:1783074226.960902:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+56:73587:x1869685708133760:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074226.960910:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+56:73588:x1869685708134016:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074226.961041:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+58:73588:x1869685708134016:12345-192.168.204.26@tcp:35:dd.0 Request processed in 133us (225us total) trans 124554051661 rc 0/0 00000100:00100000:1.0:1783074226.961049:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 265 00000100:00100000:0.0:1783074226.961099:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+58:73587:x1869685708133760:12345-192.168.204.26@tcp:35:dd.0 Request processed in 201us (380us total) trans 124554051662 rc 0/0 00000100:00100000:0.0:1783074226.961106:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 264 00010000:00010000:3.0:1783074226.961118:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961128:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961134:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961140:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961145:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074226.961149:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961156:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961166:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:3.0:1783074226.961168:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074226.961172:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961178:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e11b8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961186:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961192:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961202:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961207:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bde00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074226.961210:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961216:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961223:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff9524f44ee000) 00010000:00010000:3.0:1783074226.961226:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074226.961228:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961233:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bde00/0x5fb609b3016e11bf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961264:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e11a3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b528 expref: 58 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961276:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016e11c6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b528 expref: 57 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.961283:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:3.0:1783074226.961285:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783074226.961288:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc200, rc 0) 00000100:00100000:3.0:1783074226.961334:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+57:73591:x1869685708133504:12345-192.168.204.26@tcp:101:dd.0 Request processed in 963us (1379us total) trans 124554051663 rc 0/0 00000100:00100000:3.0:1783074226.961351:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1453 00000100:00100000:2.0:1783074226.964157:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.964187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.964213:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708134272 00000100:00100000:1.0:1783074226.964221:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708134272 00000100:00100000:2.0:1783074226.964234:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.964268:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708134528 00000100:00100000:1.0:1783074226.964272:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708134528 00000100:00100000:1.0:1783074226.964297:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1454 00000100:00100000:1.0:1783074226.964305:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+58:73590:x1869685708134272:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:2.0:1783074226.964352:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1455 00000100:00100000:2.0:1783074226.964364:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+58:73591:x1869685708134528:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074226.964372:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074226.964379:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074226.964397:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e118e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b51a expref: 58 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.964398:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e11d4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b536 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.964429:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00000100:00100000:3.0:1783074226.964433:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708134400 00010000:00010000:1.0:1783074226.964435:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074226.964440:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708134400 00010000:00010000:2.0:1783074226.964441:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016e11db lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.964455:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016e11db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.964466:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016e11db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.964483:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4971 00000100:00100000:3.0:1783074226.964496:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:73589:x1869685708134400:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074226.964506:0:26170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.964520:0:26170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016e11e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b52f expref: -99 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.964576:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e11d4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b536 expref: 60 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.964585:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.964596:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.964598:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7400/0x5fb609b3016e11db lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b536 expref: 59 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.964605:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.964622:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:2.0:1783074226.964625:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783074226.964628:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7400, rc 0) 00000001:00080000:1.0:1783074226.964663:0:68632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051664 00000100:00100000:2.0:1783074226.964685:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+60:73591:x1869685708134528:12345-192.168.204.26@tcp:101:dd.0 Request processed in 324us (450us total) trans 0 rc 0/0 00000004:00010000:1.0:1783074226.964686:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006467f494 reply state 000000004d17fbcb transno 124554051665 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.964698:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1455 00010000:00010000:1.0:1783074226.964703:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.964712:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:1.0:1783074226.964716:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074226.964724:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074226.964739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.964774:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+60:73590:x1869685708134272:12345-192.168.204.26@tcp:36:dd.0 Request processed in 469us (627us total) trans 124554051665 rc 0/0 00000100:00100000:1.0:1783074226.964784:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1454 00000020:00080000:1.0:1783074226.964790:0:68632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00010000:3.0:1783074226.964804:0:26170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x784:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00000100:00100000:1.0:1783074226.964804:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708134784 00000100:00100000:1.0:1783074226.964810:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708134784 00010000:00010000:3.0:1783074226.964822:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:3.0:1783074226.964828:0:26170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074226.964849:0:26170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016e11e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b52f expref: 10 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.964859:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1456 00010000:00010000:3.0:1783074226.964869:0:26170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016e11e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b52f expref: 10 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.964873:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+60:73592:x1869685708134784:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074226.964886:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.964888:0:26170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bcc00, rc 0) 00010000:00000080:3.0:1783074226.964897:0:26170:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc305c00 x1869685708134400/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074226.964898:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e11f0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b53d expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.964989:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:73589:x1869685708134400:12345-192.168.204.26@tcp:101:dd.0 Request processed in 495us (800us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074226.964991:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.965003:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4971 00010000:00010000:1.0:1783074226.965006:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965016:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965031:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965039:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965046:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965081:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1205 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965095:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1205 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965102:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1205 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074226.965111:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783074226.965152:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965159:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965164:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965170:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965176:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.965180:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965186:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965194:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074226.965197:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074226.965201:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965206:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e11f7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965221:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965227:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965233:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965238:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.965240:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965246:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965253:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff952502077400) 00010000:00010000:1.0:1783074226.965256:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074226.965259:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965264:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e11fe lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965291:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e11f0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b53d expref: 63 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965301:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1205 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b53d expref: 62 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.965334:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:1.0:1783074226.965336:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074226.965339:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24800, rc 0) 00000100:00100000:1.0:1783074226.965364:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+62:73592:x1869685708134784:12345-192.168.204.26@tcp:101:dd.0 Request processed in 497us (627us total) trans 124554051666 rc 0/0 00000100:00100000:1.0:1783074226.965371:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1456 00000100:00100000:3.0:1783074226.966740:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074226.966823:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074226.966866:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.966900:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708135296 00000100:00100000:1.0:1783074226.966905:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708135296 00002000:00010000:1.0:1783074226.966923:0:24838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00002000:00100000:1.0:1783074226.966927:0:24838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524f4af6d80 with x1869685708135296 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074226.966933:0:24838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524f4af6d80. 00000100:00100000:0.0:1783074226.966957:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708135168 00000100:00100000:1.0:1783074226.966958:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 528 00000100:00100000:0.0:1783074226.966965:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708135168 00000100:00100000:1.0:1783074226.966966:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2402:x1869685708135296:12345-192.168.204.26@tcp:10:dd.0 00000100:00100000:3.0:1783074226.967023:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1457 00000100:00100000:3.0:1783074226.967036:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+62:73591:x1869685708135168:12345-192.168.204.26@tcp:36:dd.0 00002000:00010000:1.0:1783074226.967065:0:24838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783074226.967069:0:24838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:1.0:1783074226.967072:0:24838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00010000:00010000:3.0:1783074226.967073:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783074226.967076:0:24838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:1.0:1783074226.967079:0:24838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783074226.967097:0:24838:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524f4af6d80 x1869685708135296/t4294968743(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783074226.967108:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc200/0x5fb609b3016e11c6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b528 expref: 62 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.967124:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:3.0:1783074226.967129:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074226.967139:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2402:x1869685708135296:12345-192.168.204.26@tcp:10:dd.0 Request processed in 172us (271us total) trans 4294968743 rc 0/0 00000100:00100000:1.0:1783074226.967147:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 528 00002000:00010000:1.0:1783074226.967151:0:24838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00000100:00100000:2.0:1783074226.967162:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708134912 00002000:00100000:1.0:1783074226.967163:0:24838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524f4af6d80 with x1869685708135296 ext(0->18446744073709551615) 00000100:00100000:2.0:1783074226.967169:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708134912 00002000:00010000:1.0:1783074226.967171:0:24838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524f4af6d80. 00000100:00100000:2.0:1783074226.967211:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4972 00000100:00100000:2.0:1783074226.967222:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c458a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:73590:x1869685708134912:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.967231:0:26169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.967240:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.967244:0:26169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004145a6db/0x5fb609b3016e121a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b544 expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.967256:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074226.967261:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x785:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:3.0:1783074226.967267:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.967274:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:2.0:1783074226.967280:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074226.967286:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004145a6db/0x5fb609b3016e121a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b544 expref: 12 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074226.967339:0:66201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051667 00010000:00010000:2.0:1783074226.967341:0:26169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004145a6db/0x5fb609b3016e121a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b544 expref: 12 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.967353:0:26169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc7800, rc 0) 00010000:00000080:2.0:1783074226.967359:0:26169:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c458a680 x1869685708134912/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000004:00010000:3.0:1783074226.967365:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e872f6d reply state 000000007c2245c2 transno 124554051668 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.967377:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.967384:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:3.0:1783074226.967386:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074226.967389:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074226.967400:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c458a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:73590:x1869685708134912:12345-192.168.204.26@tcp:101:dd.0 Request processed in 181us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074226.967409:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4972 00000100:00100000:3.0:1783074226.967450:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+64:73591:x1869685708135168:12345-192.168.204.26@tcp:36:dd.0 Request processed in 417us (625us total) trans 124554051668 rc 0/0 00000100:00100000:3.0:1783074226.967463:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1457 00000020:00080000:3.0:1783074226.967467:0:66201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783074226.968792:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.968969:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708135424 00000100:00100000:2.0:1783074226.968976:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708135424 00000100:00100000:2.0:1783074226.969106:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1458 00000100:00100000:2.0:1783074226.969117:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+64:73592:x1869685708135424:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.969132:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.969147:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1221 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b54b expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.969172:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6a00/0x5fb609b3016e1228 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.969185:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6a00/0x5fb609b3016e1228 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.969194:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6a00/0x5fb609b3016e1228 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.969290:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1221 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b54b expref: 66 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.969296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:2.0:1783074226.969340:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6a00/0x5fb609b3016e1228 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b54b expref: 65 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.969349:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708135680 00010000:00010000:2.0:1783074226.969350:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:2.0:1783074226.969356:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1783074226.969356:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708135680 00010000:00010000:2.0:1783074226.969361:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524edcc6a00, rc 0) 00000100:00100000:3.0:1783074226.969371:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.969394:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1459 00000100:00100000:0.0:1783074226.969404:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+66:73593:x1869685708135680:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.969412:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783074226.969417:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+66:73592:x1869685708135424:12345-192.168.204.26@tcp:101:dd.0 Request processed in 301us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074226.969424:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1458 00010000:00010000:0.0:1783074226.969425:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e122f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b552 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969526:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969536:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969556:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969570:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969578:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969591:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969630:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1244 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969638:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1244 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969645:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1244 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074226.969654:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:0.0:1783074226.969714:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969722:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969729:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969735:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969742:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.969758:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969765:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969785:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074226.969787:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.969790:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969807:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868a00/0x5fb609b3016e1236 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969818:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969823:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969828:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969832:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074226.969835:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969849:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969855:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff9524d0b7dd00) 00010000:00010000:0.0:1783074226.969857:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074226.969860:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969865:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e123d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969908:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e122f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b552 expref: 68 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969919:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1244 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b552 expref: 67 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.969927:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:0.0:1783074226.969930:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074226.969933:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868c00, rc 0) 00000100:00100000:1.0:1783074226.969950:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708135936 00000100:00100000:1.0:1783074226.969955:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708135936 00000100:00100000:0.0:1783074226.969965:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+68:73593:x1869685708135680:12345-192.168.204.26@tcp:101:dd.0 Request processed in 562us (672us total) trans 124554051669 rc 0/0 00000100:00100000:0.0:1783074226.969985:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1459 00000100:00100000:1.0:1783074226.969991:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 266 00000100:00100000:1.0:1783074226.970001:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4207050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+67:73589:x1869685708135936:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074226.970132:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4207050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+68:73589:x1869685708135936:12345-192.168.204.26@tcp:35:dd.0 Request processed in 133us (762us total) trans 124554051670 rc 0/0 00000100:00100000:1.0:1783074226.970138:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 266 00000100:00100000:3.0:1783074226.970218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.970255:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136192 00000100:00100000:1.0:1783074226.970260:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136192 00002000:00010000:1.0:1783074226.970277:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00002000:00100000:1.0:1783074226.970281:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fabaad80 with x1869685708136192 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074226.970288:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fabaad80. 00000100:00100000:1.0:1783074226.970333:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 529 00000100:00100000:1.0:1783074226.970341:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2403:x1869685708136192:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:1.0:1783074226.970419:0:24843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783074226.970422:0:24843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:1.0:1783074226.970425:0:24843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:1.0:1783074226.970427:0:24843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:1.0:1783074226.970429:0:24843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783074226.970435:0:24843:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fabaad80 x1869685708136192/t4294968744(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074226.970465:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:2403:x1869685708136192:12345-192.168.204.26@tcp:10:dd.0 Request processed in 125us (251us total) trans 4294968744 rc 0/0 00000100:00100000:1.0:1783074226.970481:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 529 00002000:00010000:1.0:1783074226.970484:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00002000:00100000:1.0:1783074226.970487:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fabaad80 with x1869685708136192 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074226.970491:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fabaad80. 00000100:00100000:3.0:1783074226.971580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.971706:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136064 00000100:00100000:0.0:1783074226.971712:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136064 00000100:00100000:0.0:1783074226.971758:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4973 00000100:00100000:0.0:1783074226.971767:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:73591:x1869685708136064:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.971778:0:26167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.971793:0:26167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016e1252 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b559 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.971813:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x786:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:0.0:1783074226.971848:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:0.0:1783074226.971854:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074226.971863:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016e1252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b559 expref: 14 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.971893:0:26167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016e1252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b559 expref: 14 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.971906:0:26167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869c00, rc 0) 00010000:00000080:0.0:1783074226.971912:0:26167:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524faba9880 x1869685708136064/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074226.971960:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:73591:x1869685708136064:12345-192.168.204.26@tcp:101:dd.0 Request processed in 194us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.971967:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4973 00000100:00100000:3.0:1783074226.973536:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.973583:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136448 00000100:00100000:2.0:1783074226.973590:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136448 00000100:00100000:2.0:1783074226.973641:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1460 00000100:00100000:2.0:1783074226.973651:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524faba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+68:73592:x1869685708136448:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:3.0:1783074226.973694:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:2.0:1783074226.973717:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783074226.973738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:2.0:1783074226.973744:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24800/0x5fb609b3016e1205 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b53d expref: 68 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.973763:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:2.0:1783074226.973768:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074226.973775:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136576 00000100:00100000:0.0:1783074226.973781:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136576 00000100:00100000:3.0:1783074226.973808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.973809:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136832 00000100:00100000:0.0:1783074226.973814:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136832 00000100:00100000:0.0:1783074226.973852:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1461 00000100:00100000:0.0:1783074226.973862:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+69:73593:x1869685708136576:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.973872:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.973887:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016e1259 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b560 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.973893:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1462 00000100:00100000:1.0:1783074226.973907:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+70:73594:x1869685708136832:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074226.973918:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.973919:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e1260 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.973931:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e1267 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b567 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.973933:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e1260 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.973965:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e1260 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.974028:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1783074226.974035:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974046:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974055:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.974063:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869e00/0x5fb609b3016e1259 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b560 expref: 72 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974069:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974079:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.974083:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869a00/0x5fb609b3016e1260 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b560 expref: 71 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974090:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.974097:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:0.0:1783074226.974102:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074226.974105:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869a00, rc 0) 00010000:00010000:1.0:1783074226.974141:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e127c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.974151:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fabab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+71:73593:x1869685708136576:12345-192.168.204.26@tcp:101:dd.0 Request processed in 289us (457us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074226.974161:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e127c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.974162:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1461 00010000:00010000:1.0:1783074226.974174:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e127c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.974190:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136960 00000004:00200000:1.0:1783074226.974193:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00000100:00100000:0.0:1783074226.974195:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136960 00002000:00010000:0.0:1783074226.974215:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.974220:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c6ce9880 with x1869685708136960 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.974228:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524c6ce9880. 00000100:00100000:0.0:1783074226.974250:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 530 00000100:00100000:0.0:1783074226.974260:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2402:x1869685708136960:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:1.0:1783074226.974268:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974278:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974285:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974292:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974298:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.974302:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974337:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974347:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074226.974349:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074226.974353:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974360:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e126e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974377:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974384:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974390:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974395:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.974399:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.974400:0:24855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074226.974407:0:24855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00010000:00010000:1.0:1783074226.974410:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.974412:0:24855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074226.974418:0:24855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074226.974423:0:24855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1783074226.974425:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff952502077400) 00010000:00010000:1.0:1783074226.974429:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00000080:0.0:1783074226.974431:0:24855:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c6ce9880 x1869685708136960/t4294968745(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074226.974433:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.974441:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e1275 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.974492:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2402:x1869685708136960:12345-192.168.204.26@tcp:10:dd.0 Request processed in 233us (685us total) trans 4294968745 rc 0/0 00000100:00100000:0.0:1783074226.974499:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 530 00010000:00010000:1.0:1783074226.974503:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e1267 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b567 expref: 72 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.974504:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.974511:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524c6ce9880 with x1869685708136960 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.974519:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524c6ce9880. 00010000:00010000:1.0:1783074226.974526:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e127c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b567 expref: 71 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.974541:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708137216 00000100:00100000:0.0:1783074226.974545:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708137216 00010000:00010000:1.0:1783074226.974549:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:1.0:1783074226.974552:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074226.974555:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24c00, rc 0) 00000100:00100000:0.0:1783074226.974566:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 267 00000100:00100000:0.0:1783074226.974572:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+72:73590:x1869685708137216:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074226.974584:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c2143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+72:73594:x1869685708136832:12345-192.168.204.26@tcp:101:dd.0 Request processed in 679us (845us total) trans 124554051671 rc 0/0 00000100:00100000:1.0:1783074226.974593:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1462 00000100:00100000:0.0:1783074226.974721:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+72:73590:x1869685708137216:12345-192.168.204.26@tcp:35:dd.0 Request processed in 148us (693us total) trans 124554051672 rc 0/0 00000100:00100000:0.0:1783074226.974729:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 267 00010000:00010000:2.0:1783074226.974788:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.974798:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.974810:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783074226.974860:0:66201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051673 00000004:00010000:2.0:1783074226.974881:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000058a48ff reply state 000000001ce4c39a transno 124554051674 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.974893:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.974900:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:2.0:1783074226.974902:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074226.974904:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074226.974951:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524faba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+74:73592:x1869685708136448:12345-192.168.204.26@tcp:36:dd.0 Request processed in 1302us (1420us total) trans 124554051674 rc 0/0 00000100:00100000:2.0:1783074226.974958:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1460 00000020:00080000:2.0:1783074226.974962:0:66201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783074226.976826:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074226.976883:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.976961:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708137472 00000100:00100000:1.0:1783074226.977034:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708137472 00000100:00100000:1.0:1783074226.977136:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708137600 00000100:00100000:1.0:1783074226.977141:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708137600 00000100:00100000:2.0:1783074226.977245:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1463 00000100:00100000:2.0:1783074226.977261:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+75:73593:x1869685708137472:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:2.0:1783074226.977300:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074226.977356:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1244 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b552 expref: 75 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.977375:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:2.0:1783074226.977380:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783074226.977479:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1464 00000100:00100000:0.0:1783074226.977492:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+75:73594:x1869685708137600:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.977503:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.977517:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e1291 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b56e expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.977533:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.977542:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e129f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.977554:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e129f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.977566:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e129f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.977573:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.977595:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783074226.977640:0:68632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051675 00010000:00010000:0.0:1783074226.977662:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e1291 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b56e expref: 78 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.977677:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869000/0x5fb609b3016e129f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b56e expref: 77 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783074226.977679:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057887d9b reply state 00000000589c32cc transno 124554051676 ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.977690:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:0.0:1783074226.977695:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783074226.977696:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.977699:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869000, rc 0) 00010000:00010000:2.0:1783074226.977708:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:2.0:1783074226.977711:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074226.977713:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074226.978280:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+78:73594:x1869685708137600:12345-192.168.204.26@tcp:101:dd.0 Request processed in 790us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.978288:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1464 00000100:00100000:2.0:1783074226.978394:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+77:73593:x1869685708137472:12345-192.168.204.26@tcp:36:dd.0 Request processed in 1140us (1574us total) trans 124554051676 rc 0/0 00000100:00100000:2.0:1783074226.978401:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1463 00000020:00080000:2.0:1783074226.978405:0:68632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074226.979983:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.980038:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.980068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.980157:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.980198:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708137728 00000100:00100000:0.0:1783074226.980206:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708137728 00000100:00100000:2.0:1783074226.980211:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.980235:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708137984 00000100:00100000:2.0:1783074226.980239:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708137984 00000100:00100000:0.0:1783074226.980252:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138368 00000100:00100000:0.0:1783074226.980258:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138368 00000100:00100000:2.0:1783074226.980271:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138624 00000100:00100000:2.0:1783074226.980275:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138624 00000100:00100000:0.0:1783074226.980289:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4974 00000100:00100000:0.0:1783074226.980300:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:73592:x1869685708137728:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.980339:0:26175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.980357:0:26175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016e12a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b575 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.980381:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x787:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:0.0:1783074226.980399:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:0.0:1783074226.980404:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783074226.980407:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4975 00010000:00010000:0.0:1783074226.980416:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016e12a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b575 expref: 17 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.980422:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:73593:x1869685708138368:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074226.980431:0:8487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783074226.980443:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1465 00010000:00010000:1.0:1783074226.980446:0:8487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016e12ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b583 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.980450:0:26175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016e12a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b575 expref: 17 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.980464:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+78:73602:x1869685708137984:12345-192.168.204.26@tcp:101:dd.0 00002000:00010000:1.0:1783074226.980477:0:8487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x788:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:0.0:1783074226.980480:0:26175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869e00, rc 0) 00010000:00010000:1.0:1783074226.980490:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=3066s v=(0 0) 00010000:00000080:0.0:1783074226.980491:0:26175:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc307b80 x1869685708137728/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074226.980498:0:8487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074226.980509:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016e12ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b583 expref: 18 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.980521:0:8487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016e12ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b583 expref: 18 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980543:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074226.980545:0:8487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25600, rc 0) 00010000:00000080:1.0:1783074226.980552:0:8487:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc6c6850 x1869685708138368/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1783074226.980558:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e12b4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b57c expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.980566:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:73592:x1869685708137728:12345-192.168.204.26@tcp:101:dd.0 Request processed in 265us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.980578:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4974 00000100:00100000:1.0:1783074226.980584:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:73593:x1869685708138368:12345-192.168.204.26@tcp:101:dd.0 Request processed in 164us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074226.980593:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4975 00000100:00100000:0.0:1783074226.980720:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1466 00000100:00100000:0.0:1783074226.980730:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+79:73594:x1869685708138624:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:2.0:1783074226.980731:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.980760:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074226.980779:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e127c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b567 expref: 79 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.980789:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138240 00000100:00100000:3.0:1783074226.980795:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138240 00010000:00010000:0.0:1783074226.980803:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:0.0:1783074226.980811:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074226.980832:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 268 00000100:00100000:3.0:1783074226.980852:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+79:73591:x1869685708138240:12345-192.168.204.26@tcp:35:dd.0 00010000:00010000:2.0:1783074226.980869:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980881:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980897:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980904:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980911:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980960:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e12c9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.980965:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980969:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e12c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.980982:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.980984:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e12c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074226.981011:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00000100:00100000:3.0:1783074226.981022:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+81:73591:x1869685708138240:12345-192.168.204.26@tcp:35:dd.0 Request processed in 181us (982us total) trans 124554051678 rc 0/0 00000100:00100000:3.0:1783074226.981031:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 268 00010000:00010000:2.0:1783074226.981064:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.981074:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981075:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981091:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981111:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.981116:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981124:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981133:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074226.981136:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.981140:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981146:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7c00/0x5fb609b3016e12bb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074226.981149:0:66202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051677 00010000:00010000:2.0:1783074226.981165:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981172:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074226.981174:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063f71313 reply state 00000000bc5507ea transno 124554051680 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.981189:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981192:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.981205:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:2.0:1783074226.981206:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.981213:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.981213:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074226.981218:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783074226.981223:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981235:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff9524fc299400) 00010000:00010000:2.0:1783074226.981238:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.981241:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981248:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e12c2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.981279:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+83:73594:x1869685708138624:12345-192.168.204.26@tcp:36:dd.0 Request processed in 550us (1068us total) trans 124554051680 rc 0/0 00000100:00100000:0.0:1783074226.981287:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1466 00010000:00010000:2.0:1783074226.981288:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6c00/0x5fb609b3016e12b4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b57c expref: 84 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783074226.981294:0:66202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783074226.981308:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e12c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b57c expref: 82 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.981373:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:2.0:1783074226.981375:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074226.981378:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671800, rc 0) 00000100:00100000:2.0:1783074226.981403:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+82:73602:x1869685708137984:12345-192.168.204.26@tcp:101:dd.0 Request processed in 944us (1334us total) trans 124554051679 rc 0/0 00000100:00100000:2.0:1783074226.981419:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1465 00000100:00100000:0.0:1783074226.986010:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.986057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.986064:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139008 00000100:00100000:2.0:1783074226.986087:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139008 00000100:00100000:0.0:1783074226.986088:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.986113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.986151:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.986155:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139264 00000100:00100000:2.0:1783074226.986161:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139264 00000100:00100000:0.0:1783074226.986176:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138880 00000100:00100000:0.0:1783074226.986181:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138880 00000100:00100000:2.0:1783074226.986194:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1467 00000100:00100000:2.0:1783074226.986206:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+83:73602:x1869685708139008:12345-192.168.204.26@tcp:101:dd.0 00002000:00010000:0.0:1783074226.986209:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.986215:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c2680 with x1869685708138880 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.986226:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c2680. 00000100:00100000:0.0:1783074226.986239:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138752 00010000:00010000:2.0:1783074226.986241:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783074226.986242:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138752 00002000:00010000:0.0:1783074226.986252:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.986255:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c0700 with x1869685708138752 ext(0->18446744073709551615) 00010000:00010000:2.0:1783074226.986268:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e12de lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b58a expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.986276:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c0700. 00000100:00100000:1.0:1783074226.986287:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 531 00000100:00100000:1.0:1783074226.986301:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:2403:x1869685708138880:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:2.0:1783074226.986338:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e12e5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.986346:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139392 00000100:00100000:3.0:1783074226.986352:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139392 00010000:00010000:2.0:1783074226.986354:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e12e5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986368:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e12e5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.986404:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4976 00000100:00100000:3.0:1783074226.986414:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:73594:x1869685708139392:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074226.986422:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.986467:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e12de lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b58a expref: 85 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074226.986481:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783074226.986486:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00010000:00010000:3.0:1783074226.986487:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016e12ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b598 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074226.986490:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:1.0:1783074226.986495:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00010000:00010000:2.0:1783074226.986497:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670c00/0x5fb609b3016e12e5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b58a expref: 84 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074226.986499:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783074226.986513:0:8449:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c2680 x1869685708138880/t4294968746(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:3.0:1783074226.986525:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x789:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:2.0:1783074226.986532:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:2.0:1783074226.986537:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783074226.986543:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:2.0:1783074226.986550:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb670c00, rc 0) 00010000:00010000:3.0:1783074226.986551:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074226.986562:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016e12ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b598 expref: 21 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.986576:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016e12ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b598 expref: 21 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.986585:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bc200, rc 0) 00010000:00000080:3.0:1783074226.986588:0:8443:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c0000 x1869685708139392/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074226.986648:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2403:x1869685708138880:12345-192.168.204.26@tcp:10:dd.0 Request processed in 348us (589us total) trans 4294968746 rc 0/0 00000100:00100000:0.0:1783074226.986657:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 532 00000100:00100000:1.0:1783074226.986665:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 531 00000100:00100000:0.0:1783074226.986671:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2405:x1869685708138752:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:1.0:1783074226.986674:0:8449:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:1.0:1783074226.986681:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c2680 with x1869685708138880 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074226.986686:0:8449:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c2680. 00002000:00010000:0.0:1783074226.986732:0:24837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074226.986735:0:24837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074226.986737:0:24837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074226.986739:0:24837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074226.986741:0:24837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783074226.986747:0:24837:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c0700 x1869685708138752/t4294968747(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074226.986748:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+84:73602:x1869685708139008:12345-192.168.204.26@tcp:101:dd.0 Request processed in 542us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074226.986766:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1467 00000100:00100000:0.0:1783074226.986786:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2405:x1869685708138752:12345-192.168.204.26@tcp:10:dd.0 Request processed in 119us (670us total) trans 4294968747 rc 0/0 00000100:00100000:2.0:1783074226.986790:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1468 00000100:00100000:0.0:1783074226.986799:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 532 00000100:00100000:2.0:1783074226.986803:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+83:73595:x1869685708139264:12345-192.168.204.26@tcp:101:dd.0 00002000:00010000:0.0:1783074226.986806:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.986811:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c0700 with x1869685708138752 ext(0->18446744073709551615) 00010000:00010000:2.0:1783074226.986813:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1783074226.986815:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c0700. 00010000:00010000:2.0:1783074226.986849:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e12f3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b591 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986942:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986951:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986956:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986979:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986987:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.986994:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987040:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1308 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987059:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1308 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987067:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1308 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.987079:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:73594:x1869685708139392:12345-192.168.204.26@tcp:101:dd.0 Request processed in 661us (922us total) trans 0 rc 0/0 00000004:00200000:2.0:1783074226.987081:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00000100:00100000:3.0:1783074226.987089:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4976 00010000:00010000:2.0:1783074226.987145:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987153:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987160:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987166:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987172:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151aa00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.987176:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987183:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987193:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074226.987195:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.987199:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987206:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e12fa lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987236:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987243:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987249:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987254:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.987257:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987264:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987272:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff9524fc299700) 00010000:00010000:2.0:1783074226.987274:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.987277:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987282:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1301 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987347:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e12f3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b591 expref: 86 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987366:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1308 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b591 expref: 85 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.987385:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:2.0:1783074226.987387:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074226.987389:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151b200, rc 0) 00000100:00100000:2.0:1783074226.987414:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+85:73595:x1869685708139264:12345-192.168.204.26@tcp:101:dd.0 Request processed in 616us (1326us total) trans 124554051681 rc 0/0 00000100:00100000:2.0:1783074226.987421:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1468 00000100:00100000:3.0:1783074226.988720:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.988760:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139520 00000100:00100000:2.0:1783074226.988767:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139520 00002000:00010000:2.0:1783074226.988795:0:8448:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:2.0:1783074226.988799:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4687b80 with x1869685708139520 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074226.988808:0:8448:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4687b80. 00000100:00100000:2.0:1783074226.988851:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 533 00000100:00100000:2.0:1783074226.988861:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:2402:x1869685708139520:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:2.0:1783074226.988984:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783074226.988987:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074226.988990:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:2.0:1783074226.988992:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074226.988994:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783074226.989001:0:8448:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4687b80 x1869685708139520/t4294968748(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074226.989046:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2402:x1869685708139520:12345-192.168.204.26@tcp:10:dd.0 Request processed in 187us (330us total) trans 4294968748 rc 0/0 00000100:00100000:2.0:1783074226.989053:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 533 00002000:00010000:2.0:1783074226.989056:0:8448:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:2.0:1783074226.989069:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4687b80 with x1869685708139520 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074226.989075:0:8448:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4687b80. 00000100:00100000:1.0:1783074226.989442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.989498:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.989541:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139648 00000100:00100000:0.0:1783074226.989546:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139648 00000100:00100000:0.0:1783074226.989581:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139904 00000100:00100000:1.0:1783074226.989584:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.989586:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139904 00000100:00100000:1.0:1783074226.989616:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708140160 00000100:00100000:1.0:1783074226.989621:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708140160 00000100:00100000:0.0:1783074226.989621:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1469 00000100:00100000:0.0:1783074226.989633:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+87:73595:x1869685708139648:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.989649:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783074226.989656:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 269 00010000:00010000:0.0:1783074226.989668:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1316 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b59f expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.989676:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+87:73593:x1869685708140160:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:3.0:1783074226.989695:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1470 00000100:00100000:3.0:1783074226.989706:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fab52050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+88:73602:x1869685708139904:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1783074226.989719:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e131d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.989732:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e131d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.989736:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074226.989747:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e131d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.989757:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e12c9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b57c expref: 88 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.989777:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:3.0:1783074226.989788:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074226.989827:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869400/0x5fb609b3016e1316 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b59f expref: 89 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.989859:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869200/0x5fb609b3016e131d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b59f expref: 88 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.989868:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:0.0:1783074226.989871:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074226.989874:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869200, rc 0) 00000100:00100000:1.0:1783074226.989898:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+88:73593:x1869685708140160:12345-192.168.204.26@tcp:35:dd.0 Request processed in 226us (318us total) trans 124554051682 rc 0/0 00000100:00100000:1.0:1783074226.989906:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 269 00000100:00100000:0.0:1783074226.989912:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f4699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+88:73595:x1869685708139648:12345-192.168.204.26@tcp:101:dd.0 Request processed in 279us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.989921:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1469 00000100:00100000:1.0:1783074226.989952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.989994:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708140416 00000100:00100000:0.0:1783074226.989999:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708140416 00000100:00100000:0.0:1783074226.990024:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 270 00000100:00100000:0.0:1783074226.990032:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+88:73592:x1869685708140416:12345-192.168.204.26@tcp:35:dd.0 00010000:00010000:3.0:1783074226.990057:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.990068:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.990076:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.990166:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f469a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+89:73592:x1869685708140416:12345-192.168.204.26@tcp:35:dd.0 Request processed in 134us (215us total) trans 124554051684 rc 0/0 00000100:00100000:0.0:1783074226.990188:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 270 00000001:00080000:3.0:1783074226.990780:0:66202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051683 00000004:00010000:3.0:1783074226.990810:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae0184fc reply state 00000000092eea87 transno 124554051685 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.990821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:3.0:1783074226.990828:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.990846:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:3.0:1783074226.990849:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074226.990852:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074226.990908:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fab52050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+90:73602:x1869685708139904:12345-192.168.204.26@tcp:36:dd.0 Request processed in 1203us (1408us total) trans 124554051685 rc 0/0 00000100:00100000:1.0:1783074226.990917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074226.990968:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708140928 00000100:00100000:1.0:1783074226.990972:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708140928 00000100:00100000:1.0:1783074226.990995:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 271 00000100:00100000:1.0:1783074226.991003:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+91:73594:x1869685708140928:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074226.991117:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+92:73594:x1869685708140928:12345-192.168.204.26@tcp:35:dd.0 Request processed in 114us (200us total) trans 124554051686 rc 0/0 00000100:00100000:1.0:1783074226.991125:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 271 00000100:00100000:3.0:1783074226.991199:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1470 00000020:00080000:3.0:1783074226.991204:0:66202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074226.991393:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708140672 00000100:00100000:2.0:1783074226.991398:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708140672 00000100:00100000:2.0:1783074226.991432:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1471 00000100:00100000:2.0:1783074226.991441:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+91:73596:x1869685708140672:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.991451:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.991464:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e132b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5a6 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991549:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991561:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991569:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991583:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991591:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991598:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991762:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e1340 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991782:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e1340 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991791:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e1340 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074226.991800:0:68632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00010000:00010000:2.0:1783074226.991907:0:68632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991916:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991922:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991928:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991934:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151a600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.991938:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991944:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991954:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074226.991957:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.991960:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991967:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e1332 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991987:0:68632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.991994:0:68632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992001:0:68632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992006:0:68632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151ae00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.992009:0:68632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992015:0:68632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992029:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff9524fc299400) 00010000:00010000:2.0:1783074226.992032:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.992036:0:68632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992043:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e1339 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992078:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e132b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5a6 expref: 94 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992093:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e1340 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5a6 expref: 93 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992114:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:2.0:1783074226.992116:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074226.992119:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151b400, rc 0) 00000100:00100000:2.0:1783074226.992654:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+93:73596:x1869685708140672:12345-192.168.204.26@tcp:101:dd.0 Request processed in 1214us (1836us total) trans 124554051687 rc 0/0 00000100:00100000:2.0:1783074226.992662:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1471 00000100:00100000:0.0:1783074226.992713:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.992754:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141184 00000100:00100000:2.0:1783074226.992761:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141184 00000100:00100000:0.0:1783074226.992779:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.992804:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1472 00000100:00100000:2.0:1783074226.992813:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+93:73595:x1869685708141184:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:2.0:1783074226.992910:0:66200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074226.992926:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1308 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b591 expref: 93 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.992940:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:2.0:1783074226.992944:0:66200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074226.992979:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141312 00000100:00100000:1.0:1783074226.992983:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141312 00000100:00100000:1.0:1783074226.993016:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4977 00000100:00100000:1.0:1783074226.993022:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:73602:x1869685708141312:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.993036:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.993038:0:26177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074226.993046:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.993051:0:26177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016e1355 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5ad expref: -99 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.993053:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074226.993080:0:26177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x791:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00000001:00080000:2.0:1783074226.993086:0:66200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051688 00010000:00010000:1.0:1783074226.993092:0:26177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:1.0:1783074226.993096:0:26177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=0s v=(0 0) 00000004:00010000:2.0:1783074226.993102:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048512d59 reply state 00000000e5c8f43c transno 124554051689 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.993104:0:26177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016e1355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5ad expref: 22 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.993116:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.993117:0:26177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016e1355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5ad expref: 22 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.993122:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:2.0:1783074226.993125:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074226.993127:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074226.993128:0:26177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24800, rc 0) 00010000:00000080:1.0:1783074226.993133:0:26177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c2d80 x1869685708141312/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074226.993167:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+95:73595:x1869685708141184:12345-192.168.204.26@tcp:36:dd.0 Request processed in 356us (457us total) trans 124554051689 rc 0/0 00000100:00100000:1.0:1783074226.993167:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:73602:x1869685708141312:12345-192.168.204.26@tcp:101:dd.0 Request processed in 144us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074226.993174:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4977 00000100:00100000:2.0:1783074226.993175:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1472 00000020:00080000:2.0:1783074226.993179:0:66200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783074226.994655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.994687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.994713:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.994719:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141568 00000100:00100000:2.0:1783074226.994726:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141568 00000100:00100000:2.0:1783074226.994763:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141696 00000100:00100000:2.0:1783074226.994766:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141696 00000100:00100000:2.0:1783074226.994790:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1473 00000100:00100000:0.0:1783074226.994793:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.994802:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+96:73597:x1869685708141568:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074226.994820:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783074226.994822:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141952 00000100:00100000:0.0:1783074226.994827:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141952 00002000:00010000:0.0:1783074226.994862:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00000100:00100000:1.0:1783074226.994864:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1474 00002000:00100000:0.0:1783074226.994868:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c1c00 with x1869685708141952 ext(0->18446744073709551615) 00000100:00100000:1.0:1783074226.994878:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+96:73596:x1869685708141696:12345-192.168.204.26@tcp:101:dd.0 00002000:00010000:0.0:1783074226.994879:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c1c00. 00010000:00010000:2.0:1783074226.994889:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e135c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5b4 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.994890:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074226.994899:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1363 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5bb expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.994905:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 534 00000100:00100000:0.0:1783074226.994918:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2403:x1869685708141952:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:1.0:1783074226.994924:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e136a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.994944:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e136a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.994951:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e136a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.994985:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.994997:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995005:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995030:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.995032:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1363 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5bb expref: 99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.995039:0:24841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1783074226.995042:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.995046:0:24841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074226.995054:0:24841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074226.995061:0:24841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00010000:00010000:2.0:1783074226.995062:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.995063:0:24841:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1783074226.995066:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24200/0x5fb609b3016e136a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5bb expref: 98 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1783074226.995077:0:24841:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c1c00 x1869685708141952/t4294968749(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074226.995099:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:1.0:1783074226.995103:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074226.995106:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24200, rc 0) 00010000:00010000:2.0:1783074226.995118:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a800/0x5fb609b3016e137f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995128:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a800/0x5fb609b3016e137f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995135:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a800/0x5fb609b3016e137f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.995137:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:2403:x1869685708141952:12345-192.168.204.26@tcp:10:dd.0 Request processed in 220us (347us total) trans 4294968749 rc 0/0 00000100:00100000:1.0:1783074226.995147:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+98:73596:x1869685708141696:12345-192.168.204.26@tcp:101:dd.0 Request processed in 270us (456us total) trans 0 rc 0/0 00000004:00200000:2.0:1783074226.995151:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00000100:00100000:0.0:1783074226.995157:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 534 00000100:00100000:1.0:1783074226.995158:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1474 00002000:00010000:0.0:1783074226.995163:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.995174:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c1c00 with x1869685708141952 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.995179:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c1c00. 00010000:00010000:2.0:1783074226.995206:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995225:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995232:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995239:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995245:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.995256:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995264:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995274:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074226.995277:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.995280:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995286:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b800/0x5fb609b3016e1371 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995383:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995390:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995397:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995402:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151aa00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074226.995405:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995410:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995418:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff9524fc299700) 00010000:00010000:2.0:1783074226.995421:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074226.995429:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995435:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151aa00/0x5fb609b3016e1378 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995469:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a400/0x5fb609b3016e135c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5b4 expref: 99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995482:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a800/0x5fb609b3016e137f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5b4 expref: 98 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.995500:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:2.0:1783074226.995503:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074226.995505:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151a800, rc 0) 00000100:00100000:3.0:1783074226.995518:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141824 00000100:00100000:3.0:1783074226.995524:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141824 00000100:00100000:2.0:1783074226.995554:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+98:73597:x1869685708141568:12345-192.168.204.26@tcp:101:dd.0 Request processed in 748us (900us total) trans 124554051690 rc 0/0 00000100:00100000:3.0:1783074226.995559:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4978 00000100:00100000:2.0:1783074226.995568:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1473 00000100:00100000:3.0:1783074226.995574:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:73595:x1869685708141824:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074226.995583:0:26171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074226.995596:0:26171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016e138d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5c2 expref: -99 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074226.995623:0:26171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78a:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:3.0:1783074226.995636:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:3.0:1783074226.995640:0:26171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074226.995647:0:26171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016e138d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5c2 expref: 24 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.995660:0:26171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016e138d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5c2 expref: 24 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074226.995669:0:26171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bde00, rc 0) 00010000:00000080:3.0:1783074226.995674:0:26171:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c1f80 x1869685708141824/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074226.995700:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:73595:x1869685708141824:12345-192.168.204.26@tcp:101:dd.0 Request processed in 132us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074226.995849:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4978 00000100:00100000:0.0:1783074226.997256:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.997299:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708142208 00000100:00100000:2.0:1783074226.997305:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708142208 00000100:00100000:2.0:1783074226.997445:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1475 00000100:00100000:2.0:1783074226.997454:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+98:73596:x1869685708142208:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:2.0:1783074226.997493:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074226.997511:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b400/0x5fb609b3016e1340 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5a6 expref: 98 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.997528:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:2.0:1783074226.997533:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783074226.997639:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.997648:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.997654:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783074226.997682:0:66201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051691 00000004:00010000:2.0:1783074226.997694:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa314f58 reply state 000000008e6854b2 transno 124554051692 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.997702:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.997706:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:2.0:1783074226.997707:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783074226.997709:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074226.997776:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+100:73596:x1869685708142208:12345-192.168.204.26@tcp:36:dd.0 Request processed in 323us (522us total) trans 124554051692 rc 0/0 00000100:00100000:2.0:1783074226.997783:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1475 00000020:00080000:2.0:1783074226.997787:0:66201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783074226.998048:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074226.998097:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074226.998203:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708142464 00000100:00100000:2.0:1783074226.998208:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708142464 00000100:00100000:0.0:1783074226.998229:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708142336 00000100:00100000:0.0:1783074226.998236:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708142336 00000100:00100000:2.0:1783074226.998253:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1476 00002000:00010000:0.0:1783074226.998261:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00000100:00100000:2.0:1783074226.998262:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+100:73597:x1869685708142464:12345-192.168.204.26@tcp:101:dd.0 00002000:00100000:0.0:1783074226.998268:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4684000 with x1869685708142336 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.998277:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4684000. 00000100:00100000:0.0:1783074226.998303:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 535 00000100:00100000:0.0:1783074226.998331:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:2402:x1869685708142336:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:2.0:1783074226.998353:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783074226.998359:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:2.0:1783074226.998364:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e139b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5c9 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.998411:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708142720 00010000:00010000:2.0:1783074226.998415:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e13a2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074226.998422:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708142720 00010000:00010000:2.0:1783074226.998427:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e13a2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.998434:0:24844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1783074226.998436:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e13a2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.998441:0:24844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074226.998445:0:24844:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074226.998448:0:24844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074226.998451:0:24844:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783074226.998457:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1477 00010000:00000080:0.0:1783074226.998461:0:24844:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4684000 x1869685708142336/t4294968750(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 440/432 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074226.998470:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+102:73598:x1869685708142720:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074226.998481:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074226.998493:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e13a9 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5d0 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.998517:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a200/0x5fb609b3016e139b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5c9 expref: 104 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074226.998520:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:2402:x1869685708142336:12345-192.168.204.26@tcp:10:dd.0 Request processed in 208us (473us total) trans 4294968750 rc 0/0 00000100:00100000:0.0:1783074226.998537:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 535 00002000:00010000:0.0:1783074226.998541:0:24844:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:0.0:1783074226.998545:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4684000 with x1869685708142336 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074226.998550:0:24844:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4684000. 00010000:00010000:2.0:1783074226.998552:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151ae00/0x5fb609b3016e13a2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5c9 expref: 103 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074226.998561:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:2.0:1783074226.998564:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783074226.998567:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151ae00, rc 0) 00010000:00010000:1.0:1783074226.998592:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.998604:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+103:73597:x1869685708142464:12345-192.168.204.26@tcp:101:dd.0 Request processed in 343us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074226.998618:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1476 00010000:00010000:1.0:1783074226.998621:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998631:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998645:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998652:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998663:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998701:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e13be lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074226.998706:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1783074226.998714:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e13be lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998723:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e13be lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074226.998730:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00000100:00100000:2.0:1783074226.998752:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708142976 00000100:00100000:2.0:1783074226.998757:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708142976 00010000:00010000:1.0:1783074226.998782:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.998791:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 272 00010000:00010000:1.0:1783074226.998794:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.998802:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3160850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+104:73602:x1869685708142976:12345-192.168.204.26@tcp:35:dd.0 00010000:00010000:1.0:1783074226.998804:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998818:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998824:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.998829:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998847:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998857:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074226.998860:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074226.998863:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998870:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25400/0x5fb609b3016e13b0 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998880:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998887:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998894:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998899:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074226.998903:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998918:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998927:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff9523cadc3300) 00010000:00010000:1.0:1783074226.998930:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074226.998933:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.998939:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3160850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+105:73602:x1869685708142976:12345-192.168.204.26@tcp:35:dd.0 Request processed in 138us (234us total) trans 124554051694 rc 0/0 00010000:00010000:1.0:1783074226.998941:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24400/0x5fb609b3016e13b7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074226.998959:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 272 00010000:00010000:1.0:1783074226.998978:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24c00/0x5fb609b3016e13a9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5d0 expref: 105 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.998993:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e13be lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5d0 expref: 104 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074226.999000:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:1.0:1783074226.999003:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074226.999005:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b25800, rc 0) 00000100:00100000:1.0:1783074226.999030:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+104:73598:x1869685708142720:12345-192.168.204.26@tcp:101:dd.0 Request processed in 564us (672us total) trans 124554051693 rc 0/0 00000100:00100000:1.0:1783074226.999037:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1477 00000100:00100000:2.0:1783074226.999424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074226.999497:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708143104 00000100:00100000:0.0:1783074226.999503:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708143104 00000100:00100000:0.0:1783074226.999535:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4979 00000100:00100000:0.0:1783074226.999563:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:73596:x1869685708143104:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074226.999572:0:17659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074226.999585:0:17659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b9bf66c/0x5fb609b3016e13cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5d7 expref: -99 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074226.999601:0:17659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78b:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:0.0:1783074226.999614:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:0.0:1783074226.999619:0:17659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074226.999626:0:17659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b9bf66c/0x5fb609b3016e13cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5d7 expref: 26 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.999639:0:17659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b9bf66c/0x5fb609b3016e13cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5d7 expref: 26 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074226.999650:0:17659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0869400, rc 0) 00010000:00000080:0.0:1783074226.999655:0:17659:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc304000 x1869685708143104/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:552/0 lens 328/400 e 0 to 0 dl 1783074237 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074226.999701:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:73596:x1869685708143104:12345-192.168.204.26@tcp:101:dd.0 Request processed in 143us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074226.999709:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4979 00000100:00100000:1.0:1783074227.002365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.002435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.002474:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.002481:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708143360 00000100:00100000:1.0:1783074227.002513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.002531:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708143360 00000100:00100000:0.0:1783074227.002567:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708143744 00000100:00100000:0.0:1783074227.002574:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708143744 00000100:00100000:3.0:1783074227.002577:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708143488 00000100:00100000:3.0:1783074227.002582:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708143488 00002000:00010000:0.0:1783074227.002600:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00000100:00100000:3.0:1783074227.002603:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708143872 00002000:00100000:0.0:1783074227.002606:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c3100 with x1869685708143744 ext(0->18446744073709551615) 00000100:00100000:3.0:1783074227.002608:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708143872 00002000:00010000:0.0:1783074227.002617:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c3100. 00000100:00100000:0.0:1783074227.002650:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 536 00000100:00100000:3.0:1783074227.002653:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1478 00000100:00100000:3.0:1783074227.002664:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+106:73597:x1869685708143360:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:0.0:1783074227.002670:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2404:x1869685708143744:12345-192.168.204.26@tcp:10:dd.0 00000100:00100000:1.0:1783074227.002710:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1479 00000100:00100000:1.0:1783074227.002725:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+106:73598:x1869685708143488:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074227.002738:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.002752:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e13d3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5de expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.002766:0:67186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074227.002774:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e13da lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.002784:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e13da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.002789:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a800/0x5fb609b3016e137f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5b4 expref: 107 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.002793:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e13da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.002804:0:24855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074227.002809:0:24855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.002813:0:24855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074227.002816:0:24855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.002818:0:24855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1783074227.002823:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00000080:0.0:1783074227.002828:0:24855:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c3100 x1869685708143744/t4294968751(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783074227.002830:0:67186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074227.002850:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1480 00000100:00100000:2.0:1783074227.002865:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+106:73599:x1869685708143872:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074227.002875:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074227.002885:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e13e1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5e5 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.002901:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2404:x1869685708143744:12345-192.168.204.26@tcp:10:dd.0 Request processed in 233us (431us total) trans 4294968751 rc 0/0 00010000:00010000:1.0:1783074227.002906:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3158400/0x5fb609b3016e13d3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5de expref: 108 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.002911:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 536 00002000:00010000:0.0:1783074227.002918:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00002000:00100000:0.0:1783074227.002922:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c3100 with x1869685708143744 ext(0->18446744073709551615) 00010000:00010000:1.0:1783074227.002925:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524d3159a00/0x5fb609b3016e13da lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5de expref: 108 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.002929:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c3100. 00010000:00010000:1.0:1783074227.002934:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:1.0:1783074227.002937:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074227.002939:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524d3159a00, rc 0) 00010000:00010000:2.0:1783074227.002962:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074227.002967:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+108:73598:x1869685708143488:12345-192.168.204.26@tcp:101:dd.0 Request processed in 243us (530us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074227.002976:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.002978:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074227.002984:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1479 00010000:00010000:2.0:1783074227.002998:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.003004:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:3.0:1783074227.003006:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.003018:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003019:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003037:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003042:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003081:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e13fd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783074227.003084:0:67186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051695 00010000:00010000:2.0:1783074227.003092:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e13fd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003109:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e13fd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783074227.003112:0:67186:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f280e226 reply state 000000006b7410a9 transno 124554051696 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783074227.003132:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00000100:00100000:0.0:1783074227.003165:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708144128 00000100:00100000:0.0:1783074227.003170:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708144128 00010000:00010000:2.0:1783074227.003189:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003197:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003204:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.003210:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 273 00010000:00010000:2.0:1783074227.003215:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074227.003220:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.003222:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+110:73595:x1869685708144128:12345-192.168.204.26@tcp:35:dd.0 00010000:00010000:2.0:1783074227.003235:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003246:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:2.0:1783074227.003249:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074227.003253:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003259:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb670800/0x5fb609b3016e13e8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003272:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003289:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003296:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003302:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb671800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1783074227.003306:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003333:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003342:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff9524fc299400) 00010000:00010000:2.0:1783074227.003346:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783074227.003349:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003368:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671800/0x5fb609b3016e13f6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.003372:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.003382:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:3.0:1783074227.003385:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074227.003389:0:67186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074227.003392:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+111:73595:x1869685708144128:12345-192.168.204.26@tcp:35:dd.0 Request processed in 170us (390us total) trans 124554051698 rc 0/0 00000100:00100000:0.0:1783074227.003401:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 273 00010000:00010000:2.0:1783074227.003406:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151a600/0x5fb609b3016e13e1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5e5 expref: 112 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003422:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e13fd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5e5 expref: 110 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.003430:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:2.0:1783074227.003433:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783074227.003443:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524fb671a00, rc 0) 00000100:00100000:3.0:1783074227.003455:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+111:73597:x1869685708143360:12345-192.168.204.26@tcp:36:dd.0 Request processed in 793us (1096us total) trans 124554051696 rc 0/0 00000100:00100000:3.0:1783074227.003464:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1478 00000100:00100000:2.0:1783074227.003472:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+111:73599:x1869685708143872:12345-192.168.204.26@tcp:101:dd.0 Request processed in 610us (957us total) trans 124554051697 rc 0/0 00000020:00080000:3.0:1783074227.003476:0:67186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074227.003483:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1480 00000100:00100000:2.0:1783074227.006302:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.006357:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708144384 00000100:00100000:2.0:1783074227.006364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.006364:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708144384 00000100:00100000:2.0:1783074227.006402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.006406:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708144768 00000100:00100000:1.0:1783074227.006419:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708144768 00000100:00100000:2.0:1783074227.006429:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708144640 00000100:00100000:2.0:1783074227.006436:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708144640 00000100:00100000:1.0:1783074227.006454:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1481 00000100:00100000:1.0:1783074227.006464:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+112:73598:x1869685708144384:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:2.0:1783074227.006481:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 274 00000100:00100000:0.0:1783074227.006488:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1482 00000100:00100000:2.0:1783074227.006495:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+112:73596:x1869685708144640:12345-192.168.204.26@tcp:35:dd.0 00010000:00010000:1.0:1783074227.006501:0:66202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783074227.006503:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+112:73599:x1869685708144768:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074227.006524:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.006526:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25800/0x5fb609b3016e13be lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5d0 expref: 112 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006538:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e140b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5ec expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.006543:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:1.0:1783074227.006550:0:66202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074227.006566:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e1412 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006578:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e1412 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006587:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e1412 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006661:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868000/0x5fb609b3016e140b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5ec expref: 115 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.006662:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.006682:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+115:73596:x1869685708144640:12345-192.168.204.26@tcp:35:dd.0 Request processed in 189us (279us total) trans 124554051699 rc 0/0 00010000:00010000:1.0:1783074227.006684:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006693:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868e00/0x5fb609b3016e1412 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5ec expref: 114 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.006699:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 274 00010000:00010000:1.0:1783074227.006701:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006712:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074227.006716:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074227.006720:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868e00, rc 0) 00000001:00080000:1.0:1783074227.006748:0:66202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051700 00000100:00100000:0.0:1783074227.006757:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+114:73599:x1869685708144768:12345-192.168.204.26@tcp:101:dd.0 Request processed in 259us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.006772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.006773:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1482 00000004:00010000:1.0:1783074227.006777:0:66202:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006ad7082 reply state 00000000a2f8b02e transno 124554051701 ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.006789:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.006798:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:1.0:1783074227.006801:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074227.006804:0:66202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074227.006806:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708144896 00000100:00100000:0.0:1783074227.006811:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708144896 00000100:00100000:0.0:1783074227.006861:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4980 00000100:00100000:1.0:1783074227.006868:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+114:73598:x1869685708144384:12345-192.168.204.26@tcp:36:dd.0 Request processed in 405us (570us total) trans 124554051701 rc 0/0 00000100:00100000:0.0:1783074227.006872:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:73597:x1869685708144896:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:1.0:1783074227.006879:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1481 00000020:00080000:1.0:1783074227.006891:0:66202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783074227.006896:0:26173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074227.006911:0:26173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079f1decf/0x5fb609b3016e1420 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5f3 expref: -99 pid: 26173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.006940:0:26173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78c:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:0.0:1783074227.006952:0:26173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:0.0:1783074227.006957:0:26173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074227.006964:0:26173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079f1decf/0x5fb609b3016e1420 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5f3 expref: 28 pid: 26173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006977:0:26173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079f1decf/0x5fb609b3016e1420 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5f3 expref: 28 pid: 26173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.006988:0:26173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868a00, rc 0) 00010000:00000080:0.0:1783074227.006994:0:26173:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc307800 x1869685708144896/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.007019:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:73597:x1869685708144896:12345-192.168.204.26@tcp:101:dd.0 Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.007025:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4980 00000100:00100000:2.0:1783074227.007142:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.007180:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708145152 00000100:00100000:0.0:1783074227.007185:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708145152 00000100:00100000:0.0:1783074227.007211:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1483 00000100:00100000:0.0:1783074227.007216:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+114:73600:x1869685708145152:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074227.007224:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074227.007233:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1427 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b5fa expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007331:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007341:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007348:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007361:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007368:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007375:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007410:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e143c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007418:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e143c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007426:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e143c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074227.007433:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:0.0:1783074227.007474:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007481:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007492:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007499:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007504:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074227.007508:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007515:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007524:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074227.007528:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074227.007532:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007538:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868400/0x5fb609b3016e142e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007550:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007556:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007562:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007568:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074227.007577:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007583:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007590:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff9524d1c7bf00) 00010000:00010000:0.0:1783074227.007592:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074227.007594:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007600:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e1435 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007628:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e1427 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5fa expref: 117 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007638:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e143c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5fa expref: 116 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.007644:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:0.0:1783074227.007646:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074227.007649:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9200, rc 0) 00000100:00100000:0.0:1783074227.007682:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+116:73600:x1869685708145152:12345-192.168.204.26@tcp:101:dd.0 Request processed in 465us (540us total) trans 124554051702 rc 0/0 00000100:00100000:0.0:1783074227.007688:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1483 00000100:00100000:3.0:1783074227.009378:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.009453:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708145280 00000100:00100000:1.0:1783074227.009462:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708145280 00000100:00100000:1.0:1783074227.009502:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4981 00000100:00100000:1.0:1783074227.009511:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:73598:x1869685708145280:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074227.009523:0:26176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.009540:0:26176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016e144a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b601 expref: -99 pid: 26176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074227.009560:0:26176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78d:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:1.0:1783074227.009576:0:26176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:1.0:1783074227.009580:0:26176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074227.009588:0:26176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016e144a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b601 expref: 29 pid: 26176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.009600:0:26176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016e144a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b601 expref: 29 pid: 26176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.009609:0:26176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c4b24c00, rc 0) 00010000:00000080:1.0:1783074227.009616:0:26176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4685880 x1869685708145280/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.009670:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:73598:x1869685708145280:12345-192.168.204.26@tcp:101:dd.0 Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.009680:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4981 00000100:00100000:2.0:1783074227.010663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.010692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.010714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.010732:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708145536 00000100:00100000:1.0:1783074227.010737:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708145536 00000100:00100000:2.0:1783074227.010753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00002000:00010000:1.0:1783074227.010777:0:8449:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:1.0:1783074227.010782:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc304380 with x1869685708145536 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074227.010790:0:8449:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc304380. 00000100:00100000:1.0:1783074227.010819:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 537 00000100:00100000:1.0:1783074227.010827:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2405:x1869685708145536:12345-192.168.204.26@tcp:10:dd.0 00000100:00100000:3.0:1783074227.010830:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708145408 00000100:00100000:3.0:1783074227.010849:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708145408 00000100:00100000:3.0:1783074227.010888:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708145792 00000100:00100000:3.0:1783074227.010891:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708145792 00000100:00100000:3.0:1783074227.010911:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146048 00000100:00100000:3.0:1783074227.010913:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146048 00000100:00100000:3.0:1783074227.010928:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1484 00000100:00100000:3.0:1783074227.010936:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+118:73600:x1869685708145408:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074227.010952:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074227.010965:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd600/0x5fb609b3016e1451 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b608 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074227.010971:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783074227.010975:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:1.0:1783074227.010978:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:1.0:1783074227.010980:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:1.0:1783074227.010982:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783074227.010991:0:8449:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc304380 x1869685708145536/t4294968752(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783074227.010992:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016e1458 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.011014:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016e1458 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.011026:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016e1458 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.011050:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1485 00000100:00100000:1.0:1783074227.011056:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2405:x1869685708145536:12345-192.168.204.26@tcp:10:dd.0 Request processed in 229us (363us total) trans 4294968752 rc 0/0 00000100:00100000:1.0:1783074227.011064:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 537 00000100:00100000:0.0:1783074227.011069:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+119:73601:x1869685708145792:12345-192.168.204.26@tcp:101:dd.0 00002000:00010000:1.0:1783074227.011070:0:8449:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:1.0:1783074227.011074:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc304380 with x1869685708145536 ext(0->18446744073709551615) 00002000:00010000:1.0:1783074227.011083:0:8449:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc304380. 00010000:00010000:0.0:1783074227.011094:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074227.011113:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e145f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b60f expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.011117:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd600/0x5fb609b3016e1451 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b608 expref: 120 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.011141:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd200/0x5fb609b3016e1458 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b608 expref: 120 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.011150:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:3.0:1783074227.011159:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783074227.011163:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd200, rc 0) 00010000:00010000:0.0:1783074227.011206:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011216:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011224:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011237:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011244:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011251:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011301:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e1474 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011339:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e1474 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011349:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e1474 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783074227.011359:0:66200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00000100:00100000:0.0:1783074227.011389:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1486 00000100:00100000:0.0:1783074227.011398:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+120:73599:x1869685708146048:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1783074227.011428:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074227.011443:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524fb671a00/0x5fb609b3016e13fd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5e5 expref: 120 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011458:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074227.011462:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783074227.011512:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+119:73600:x1869685708145408:12345-192.168.204.26@tcp:101:dd.0 Request processed in 577us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.011533:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1484 00010000:00010000:0.0:1783074227.011571:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011581:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011589:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074227.011625:0:66201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051703 00000004:00010000:0.0:1783074227.011644:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063f71313 reply state 000000006b3607ce transno 124554051704 ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011656:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011662:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:0.0:1783074227.011665:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074227.011667:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783074227.011681:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.011721:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+121:73599:x1869685708146048:12345-192.168.204.26@tcp:36:dd.0 Request processed in 323us (967us total) trans 124554051704 rc 0/0 00000100:00100000:0.0:1783074227.011728:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1486 00000020:00080000:0.0:1783074227.011732:0:66201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783074227.011814:0:66200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011827:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011833:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011852:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011858:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1783074227.011866:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011874:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011886:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:0.0:1783074227.011889:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074227.011892:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011898:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9a00/0x5fb609b3016e1466 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.011907:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146176 00010000:00010000:0.0:1783074227.011909:0:66200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.011913:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146176 00010000:00010000:0.0:1783074227.011919:0:66200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011925:0:66200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074227.011933:0:8450:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00010000:00010000:0.0:1783074227.011937:0:66200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8800 already unused, calling callback (ffffffffc186d4f0) 00002000:00100000:3.0:1783074227.011939:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc305880 with x1869685708146176 ext(0->18446744073709551615) 00010000:00010000:0.0:1783074227.011943:0:66200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074227.011948:0:8450:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc305880. 00010000:00010000:0.0:1783074227.011951:0:66200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011961:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff9524d30b3000) 00010000:00010000:0.0:1783074227.011964:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783074227.011967:0:66200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.011972:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c8800/0x5fb609b3016e146d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.012005:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9e00/0x5fb609b3016e145f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b60f expref: 122 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.012011:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 538 00010000:00010000:0.0:1783074227.012022:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e1474 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b60f expref: 121 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.012024:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2404:x1869685708146176:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:0.0:1783074227.012037:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:0.0:1783074227.012039:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783074227.012041:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524df2c9800, rc 0) 00000100:00100000:0.0:1783074227.012075:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+121:73601:x1869685708145792:12345-192.168.204.26@tcp:101:dd.0 Request processed in 1015us (1359us total) trans 124554051705 rc 0/0 00000100:00100000:0.0:1783074227.012082:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1485 00002000:00010000:3.0:1783074227.012117:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783074227.012121:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:3.0:1783074227.012124:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:3.0:1783074227.012126:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:3.0:1783074227.012129:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783074227.012136:0:8450:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc305880 x1869685708146176/t4294968753(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.012174:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2404:x1869685708146176:12345-192.168.204.26@tcp:10:dd.0 Request processed in 153us (494us total) trans 4294968753 rc 0/0 00000100:00100000:3.0:1783074227.012181:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 538 00002000:00010000:3.0:1783074227.012185:0:8450:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:3.0:1783074227.012188:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc305880 with x1869685708146176 ext(0->18446744073709551615) 00002000:00010000:3.0:1783074227.012193:0:8450:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc305880. 00000100:00100000:2.0:1783074227.012887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.012924:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146432 00000100:00100000:1.0:1783074227.012930:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146432 00000100:00100000:1.0:1783074227.012978:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 275 00000100:00100000:1.0:1783074227.012987:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+121:73597:x1869685708146432:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:3.0:1783074227.013165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.013175:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+122:73597:x1869685708146432:12345-192.168.204.26@tcp:35:dd.0 Request processed in 188us (286us total) trans 124554051706 rc 0/0 00000100:00100000:1.0:1783074227.013185:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 275 00000100:00100000:2.0:1783074227.013203:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146560 00000100:00100000:2.0:1783074227.013206:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146560 00000100:00100000:2.0:1783074227.013252:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4982 00000100:00100000:2.0:1783074227.013261:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:73599:x1869685708146560:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074227.013270:0:26166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074227.013303:0:26166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e1489 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b616 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074227.013341:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78e:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:2.0:1783074227.013354:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:2.0:1783074227.013359:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074227.013367:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e1489 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b616 expref: 32 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.013379:0:26166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e1489 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b616 expref: 32 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.013390:0:26166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151b400, rc 0) 00010000:00000080:2.0:1783074227.013400:0:26166:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4685500 x1869685708146560/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.013434:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:73599:x1869685708146560:12345-192.168.204.26@tcp:101:dd.0 Request processed in 173us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.013440:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4982 00000100:00100000:0.0:1783074227.015790:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.015825:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.015869:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.015876:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146688 00000100:00100000:3.0:1783074227.015883:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146688 00000100:00100000:3.0:1783074227.015919:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146944 00000100:00100000:3.0:1783074227.015922:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146944 00000100:00100000:1.0:1783074227.015931:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1487 00000100:00100000:1.0:1783074227.015947:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+123:73601:x1869685708146688:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:0.0:1783074227.015949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.015955:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1488 00000100:00100000:3.0:1783074227.015966:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+123:73603:x1869685708146944:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074227.015970:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074227.015976:0:67186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783074227.015986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1783074227.015989:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85c00/0x5fb609b3016e1490 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b61d expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.015990:0:67186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e1497 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b624 expref: -99 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.016004:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708147584 00000100:00100000:0.0:1783074227.016009:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708147584 00002000:00010000:0.0:1783074227.016029:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00010000:00010000:1.0:1783074227.016034:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85400/0x5fb609b3016e149e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1783074227.016034:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c3480 with x1869685708147584 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074227.016044:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c3480. 00010000:00010000:1.0:1783074227.016051:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85400/0x5fb609b3016e149e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.016062:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85400/0x5fb609b3016e149e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.016064:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 539 00000100:00100000:0.0:1783074227.016075:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:2403:x1869685708147584:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:3.0:1783074227.016114:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016125:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016133:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016148:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.016154:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85c00/0x5fb609b3016e1490 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b61d expref: 126 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016158:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016173:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.016180:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85400/0x5fb609b3016e149e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b61d expref: 125 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.016180:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074227.016187:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.016193:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00010000:00010000:1.0:1783074227.016196:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00002000:00010000:0.0:1783074227.016197:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.016203:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1783074227.016204:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074227.016210:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0d85400, rc 0) 00010000:00000080:0.0:1783074227.016212:0:24842:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c3480 x1869685708147584/t4294968754(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783074227.016217:0:67186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e14b3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016233:0:67186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e14b3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016248:0:67186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e14b3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783074227.016259:0:67186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00000100:00100000:0.0:1783074227.016261:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2403:x1869685708147584:12345-192.168.204.26@tcp:10:dd.0 Request processed in 187us (275us total) trans 4294968754 rc 0/0 00000100:00100000:0.0:1783074227.016270:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 539 00002000:00010000:0.0:1783074227.016273:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00002000:00100000:0.0:1783074227.016276:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c3480 with x1869685708147584 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074227.016280:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c3480. 00010000:00010000:3.0:1783074227.016349:0:67186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016358:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016365:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016371:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016377:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bdc00 already unused, calling callback (ffffffffc186d4f0) 00000100:00100000:1.0:1783074227.016382:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+126:73601:x1869685708146688:12345-192.168.204.26@tcp:101:dd.0 Request processed in 439us (593us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074227.016384:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074227.016398:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1487 00010000:00010000:3.0:1783074227.016399:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016414:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00000100:00100000:0.0:1783074227.016415:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708147456 00010000:00010000:3.0:1783074227.016419:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074227.016421:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708147456 00000100:00100000:0.0:1783074227.016454:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1489 00000100:00100000:0.0:1783074227.016462:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+126:73600:x1869685708147456:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1783074227.016483:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783074227.016487:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016495:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bdc00/0x5fb609b3016e14a5 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016499:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9200/0x5fb609b3016e143c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5fa expref: 126 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016505:0:67186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016514:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:3.0:1783074227.016517:0:67186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016519:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783074227.016524:0:67186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016528:0:67186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1783074227.016530:0:67186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016534:0:67186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016541:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff9524f44eec00) 00010000:00010000:3.0:1783074227.016542:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783074227.016544:0:67186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016548:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd000/0x5fb609b3016e14ac lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016573:0:67186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e1497 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b624 expref: 126 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016582:0:67186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e14b3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b624 expref: 125 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.016586:0:67186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:3.0:1783074227.016588:0:67186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1783074227.016593:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708147328 00010000:00010000:3.0:1783074227.016595:0:67186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd800, rc 0) 00000100:00100000:2.0:1783074227.016598:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708147328 00000100:00100000:3.0:1783074227.016626:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+126:73603:x1869685708146944:12345-192.168.204.26@tcp:101:dd.0 Request processed in 663us (800us total) trans 124554051707 rc 0/0 00000100:00100000:2.0:1783074227.016632:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 276 00000100:00100000:3.0:1783074227.016634:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1488 00000100:00100000:2.0:1783074227.016643:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+126:73598:x1869685708147328:12345-192.168.204.26@tcp:35:dd.0 00010000:00010000:0.0:1783074227.016809:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016819:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016827:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074227.016873:0:66201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051708 00000004:00010000:0.0:1783074227.016892:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb8bf7c5 reply state 000000007b83b0a6 transno 124554051709 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016904:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.016911:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:0.0:1783074227.016913:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074227.016915:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074227.016961:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+128:73600:x1869685708147456:12345-192.168.204.26@tcp:36:dd.0 Request processed in 500us (1017us total) trans 124554051709 rc 0/0 00000100:00100000:0.0:1783074227.016968:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1489 00000020:00080000:0.0:1783074227.016977:0:66201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074227.017113:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+128:73598:x1869685708147328:12345-192.168.204.26@tcp:35:dd.0 Request processed in 472us (1243us total) trans 124554051710 rc 0/0 00000100:00100000:2.0:1783074227.017119:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 276 00000100:00100000:0.0:1783074227.018294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.018347:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.018382:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708147840 00000100:00100000:0.0:1783074227.018387:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.018396:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708147840 00000100:00100000:1.0:1783074227.018405:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708147712 00000100:00100000:1.0:1783074227.018411:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708147712 00000100:00100000:2.0:1783074227.018439:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4983 00000100:00100000:1.0:1783074227.018450:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1490 00000100:00100000:2.0:1783074227.018452:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:73600:x1869685708147840:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:1.0:1783074227.018463:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+128:73603:x1869685708147712:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074227.018465:0:26175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.018478:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074227.018483:0:26175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e14c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b632 expref: -99 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.018490:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84a00/0x5fb609b3016e14cf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b62b expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074227.018507:0:26175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78f:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:1.0:1783074227.018519:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84600/0x5fb609b3016e14d6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.018524:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:2.0:1783074227.018532:0:26175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783074227.018534:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84600/0x5fb609b3016e14d6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.018540:0:26175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e14c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b632 expref: 34 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.018547:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84600/0x5fb609b3016e14d6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.018573:0:26175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e14c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b632 expref: 34 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.018585:0:26175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151aa00, rc 0) 00010000:00000080:2.0:1783074227.018591:0:26175:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c2d80 x1869685708147840/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074227.018629:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84a00/0x5fb609b3016e14cf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b62b expref: 130 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.018639:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:73600:x1869685708147840:12345-192.168.204.26@tcp:101:dd.0 Request processed in 191us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.018645:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4983 00010000:00010000:1.0:1783074227.018646:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84600/0x5fb609b3016e14d6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b62b expref: 129 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.018654:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:1.0:1783074227.018657:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074227.018660:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0d84600, rc 0) 00000100:00100000:1.0:1783074227.019567:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+129:73603:x1869685708147712:12345-192.168.204.26@tcp:101:dd.0 Request processed in 1106us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.019575:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1490 00000100:00100000:0.0:1783074227.019698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.019708:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708148096 00000100:00100000:3.0:1783074227.019714:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708148096 00000100:00100000:0.0:1783074227.019729:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708148352 00000100:00100000:0.0:1783074227.019735:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708148352 00000100:00100000:3.0:1783074227.019754:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 277 00000100:00100000:3.0:1783074227.019765:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+130:73599:x1869685708148096:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:0.0:1783074227.019775:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1491 00000100:00100000:0.0:1783074227.019786:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+130:73601:x1869685708148352:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:2.0:1783074227.019797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1783074227.019814:0:66201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074227.019833:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9800/0x5fb609b3016e1474 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b60f expref: 130 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.019862:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00000100:00100000:1.0:1783074227.019864:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708148608 00010000:00010000:0.0:1783074227.019866:0:66201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074227.019871:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708148608 00000100:00100000:1.0:1783074227.019908:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1492 00000100:00100000:1.0:1783074227.019917:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+130:73604:x1869685708148608:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074227.019929:0:66202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.019940:0:66202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84000/0x5fb609b3016e14dd lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b639 expref: -99 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.019992:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.020004:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.020013:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020036:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.020043:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+133:73599:x1869685708148096:12345-192.168.204.26@tcp:35:dd.0 Request processed in 278us (1653us total) trans 124554051712 rc 0/0 00010000:00010000:1.0:1783074227.020049:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.020054:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 277 00010000:00010000:1.0:1783074227.020064:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020080:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020087:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020095:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020136:0:66202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85200/0x5fb609b3016e14f9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074227.020141:0:66201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051711 00010000:00010000:1.0:1783074227.020145:0:66202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85200/0x5fb609b3016e14f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020153:0:66202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85200/0x5fb609b3016e14f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783074227.020167:0:66201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080458da9 reply state 00000000fda008f7 transno 124554051713 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074227.020174:0:66202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:0.0:1783074227.020181:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.020200:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:0.0:1783074227.020203:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783074227.020207:0:66201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074227.020237:0:66202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020243:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020247:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020251:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020254:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0d84400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074227.020257:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020261:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020267:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074227.020269:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074227.020271:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020274:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84400/0x5fb609b3016e14eb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020280:0:66202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020300:0:66202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020304:0:66202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020307:0:66202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0d85a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074227.020333:0:66202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020338:0:66202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020344:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff9523cadc3d00) 00010000:00010000:1.0:1783074227.020347:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074227.020349:0:66202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020353:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85a00/0x5fb609b3016e14f2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020387:0:66202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84000/0x5fb609b3016e14dd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b639 expref: 136 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020395:0:66202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85200/0x5fb609b3016e14f9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b639 expref: 135 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.020400:0:66202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:1.0:1783074227.020403:0:66202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1783074227.020406:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+135:73601:x1869685708148352:12345-192.168.204.26@tcp:36:dd.0 Request processed in 620us (707us total) trans 124554051713 rc 0/0 00010000:00010000:1.0:1783074227.020411:0:66202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0d85200, rc 0) 00000100:00100000:0.0:1783074227.020418:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1491 00000020:00080000:0.0:1783074227.020423:0:66201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783074227.020435:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+134:73604:x1869685708148608:12345-192.168.204.26@tcp:101:dd.0 Request processed in 519us (640us total) trans 124554051714 rc 0/0 00000100:00100000:1.0:1783074227.020441:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1492 00000100:00100000:2.0:1783074227.021183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.021235:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708148736 00000100:00100000:0.0:1783074227.021240:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708148736 00002000:00010000:0.0:1783074227.021262:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00100000:0.0:1783074227.021266:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc304700 with x1869685708148736 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074227.021366:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc304700. 00000100:00100000:0.0:1783074227.021387:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 540 00000100:00100000:0.0:1783074227.021396:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:2404:x1869685708148736:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:0.0:1783074227.021478:0:24841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074227.021481:0:24841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.021482:0:24841:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074227.021484:0:24841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.021485:0:24841:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783074227.021490:0:24841:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc304700 x1869685708148736/t4294968755(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.021519:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2404:x1869685708148736:12345-192.168.204.26@tcp:10:dd.0 Request processed in 125us (337us total) trans 4294968755 rc 0/0 00000100:00100000:0.0:1783074227.021527:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 540 00002000:00010000:0.0:1783074227.021530:0:24841:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00100000:0.0:1783074227.021539:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc304700 with x1869685708148736 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074227.021611:0:24841:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc304700. 00000100:00100000:2.0:1783074227.022213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.022596:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708148864 00000100:00100000:1.0:1783074227.022601:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708148864 00000100:00100000:1.0:1783074227.022637:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1493 00000100:00100000:1.0:1783074227.022645:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+134:73604:x1869685708148864:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074227.022657:0:68632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.022670:0:68632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85c00/0x5fb609b3016e1507 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b640 expref: -99 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.022694:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85800/0x5fb609b3016e150e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.022705:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85800/0x5fb609b3016e150e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.022713:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85800/0x5fb609b3016e150e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.022787:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85c00/0x5fb609b3016e1507 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b640 expref: 136 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.022802:0:68632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85800/0x5fb609b3016e150e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b640 expref: 135 pid: 68632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.022810:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:1.0:1783074227.022813:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783074227.022823:0:68632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0d85800, rc 0) 00000100:00100000:2.0:1783074227.022896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.022915:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+135:73604:x1869685708148864:12345-192.168.204.26@tcp:101:dd.0 Request processed in 270us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.022924:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1493 00000100:00100000:3.0:1783074227.022940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.022944:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708149248 00000100:00100000:0.0:1783074227.022949:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708149248 00000100:00100000:1.0:1783074227.022966:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708149120 00000100:00100000:1.0:1783074227.022972:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708149120 00000100:00100000:0.0:1783074227.022991:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4984 00000100:00100000:0.0:1783074227.023001:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:73601:x1869685708149248:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074227.023010:0:26168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783074227.023017:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.023017:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1494 00010000:00010000:0.0:1783074227.023025:0:26168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000815c28fc/0x5fb609b3016e1515 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b64e expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074227.023032:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+135:73605:x1869685708149120:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1783074227.023046:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1783074227.023051:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x790:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:1.0:1783074227.023056:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84800/0x5fb609b3016e151c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b647 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.023066:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:0.0:1783074227.023071:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074227.023079:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000815c28fc/0x5fb609b3016e1515 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b64e expref: 36 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.023092:0:26168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000815c28fc/0x5fb609b3016e1515 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b64e expref: 36 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.023098:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708149504 00000100:00100000:2.0:1783074227.023104:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708149504 00010000:00010000:0.0:1783074227.023104:0:26168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0868400, rc 0) 00010000:00000080:0.0:1783074227.023112:0:26168:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc305c00 x1869685708149248/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074227.023138:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.023143:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1495 00000100:00100000:0.0:1783074227.023152:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:73601:x1869685708149248:12345-192.168.204.26@tcp:101:dd.0 Request processed in 149us (252us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074227.023155:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.023160:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+137:73603:x1869685708149504:12345-192.168.204.26@tcp:36:dd.0 00000100:00100000:0.0:1783074227.023170:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4984 00010000:00010000:1.0:1783074227.023175:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023190:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.023194:0:66200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074227.023202:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023209:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.023214:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd800/0x5fb609b3016e14b3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b624 expref: 137 pid: 67186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.023229:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:2.0:1783074227.023233:0:66200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074227.023248:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85600/0x5fb609b3016e1531 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023264:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85600/0x5fb609b3016e1531 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023272:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85600/0x5fb609b3016e1531 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074227.023281:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:1.0:1783074227.023360:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023368:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023376:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023383:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0d84e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074227.023388:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023396:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023406:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074227.023409:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074227.023412:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023418:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84e00/0x5fb609b3016e1523 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023430:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023443:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023450:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023455:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0d85000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074227.023458:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023465:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023474:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff9523cadc3100) 00000100:00100000:2.0:1783074227.023478:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1783074227.023479:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074227.023484:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023491:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85000/0x5fb609b3016e152a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023525:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84800/0x5fb609b3016e151c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b647 expref: 139 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.023527:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708149760 00010000:00010000:3.0:1783074227.023535:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.023539:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708149760 00010000:00010000:1.0:1783074227.023540:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85600/0x5fb609b3016e1531 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b647 expref: 138 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.023554:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023555:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:1.0:1783074227.023561:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783074227.023568:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.023572:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524f0d85600, rc 0) 00000100:00100000:0.0:1783074227.023578:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 278 00000100:00100000:0.0:1783074227.023588:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3161050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+139:73600:x1869685708149760:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074227.023608:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+139:73605:x1869685708149120:12345-192.168.204.26@tcp:101:dd.0 Request processed in 579us (667us total) trans 124554051715 rc 0/0 00000001:00080000:3.0:1783074227.023611:0:66200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051716 00000100:00100000:1.0:1783074227.023618:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1494 00000004:00010000:3.0:1783074227.023638:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023e83041 reply state 00000000f59a82a4 transno 124554051717 ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.023650:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.023656:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:3.0:1783074227.023666:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783074227.023669:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783074227.023754:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3161050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+141:73600:x1869685708149760:12345-192.168.204.26@tcp:35:dd.0 Request processed in 167us (278us total) trans 124554051718 rc 0/0 00000100:00100000:3.0:1783074227.023760:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+141:73603:x1869685708149504:12345-192.168.204.26@tcp:36:dd.0 Request processed in 604us (747us total) trans 124554051717 rc 0/0 00000100:00100000:0.0:1783074227.023768:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 278 00000100:00100000:3.0:1783074227.023773:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1495 00000020:00080000:3.0:1783074227.023779:0:66200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074227.023996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.024033:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150016 00000100:00100000:1.0:1783074227.024038:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150016 00000100:00100000:1.0:1783074227.024136:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1496 00000100:00100000:1.0:1783074227.024145:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+140:73604:x1869685708150016:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:1.0:1783074227.024167:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074227.024179:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85200/0x5fb609b3016e14f9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b639 expref: 140 pid: 66202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.024191:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:1.0:1783074227.024194:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074227.024257:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.024266:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.024273:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783074227.024298:0:68632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051719 00000004:00010000:1.0:1783074227.024412:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034103052 reply state 000000009484488a transno 124554051720 ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.024425:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.024443:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:1.0:1783074227.024445:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074227.024448:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783074227.024478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.024514:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150144 00000100:00100000:2.0:1783074227.024518:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150144 00002000:00010000:2.0:1783074227.024534:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:2.0:1783074227.024538:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4686300 with x1869685708150144 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074227.024544:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4686300. 00000100:00100000:2.0:1783074227.024562:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 541 00000100:00100000:2.0:1783074227.024569:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2404:x1869685708150144:12345-192.168.204.26@tcp:10:dd.0 00000100:00100000:1.0:1783074227.024708:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+142:73604:x1869685708150016:12345-192.168.204.26@tcp:36:dd.0 Request processed in 562us (710us total) trans 124554051720 rc 0/0 00000100:00100000:1.0:1783074227.024717:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1496 00000020:00080000:1.0:1783074227.024721:0:68632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00010000:2.0:1783074227.024767:0:24843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783074227.024772:0:24843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074227.024774:0:24843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:2.0:1783074227.024777:0:24843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074227.024778:0:24843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783074227.024786:0:24843:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4686300 x1869685708150144/t4294968756(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.025261:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:2404:x1869685708150144:12345-192.168.204.26@tcp:10:dd.0 Request processed in 691us (783us total) trans 4294968756 rc 0/0 00000100:00100000:2.0:1783074227.025270:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 541 00002000:00010000:2.0:1783074227.025274:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:2.0:1783074227.025278:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4686300 with x1869685708150144 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074227.025282:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4686300. 00000100:00100000:0.0:1783074227.025373:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.025400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.025439:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150400 00000100:00100000:3.0:1783074227.025445:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150400 00000100:00100000:1.0:1783074227.025448:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150528 00000100:00100000:1.0:1783074227.025455:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150528 00000100:00100000:3.0:1783074227.025484:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4985 00000100:00100000:1.0:1783074227.025490:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1497 00000100:00100000:3.0:1783074227.025496:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:73603:x1869685708150400:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:1.0:1783074227.025504:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+142:73606:x1869685708150528:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074227.025508:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.025517:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783074227.025523:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016e154d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b65c expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025538:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85e00/0x5fb609b3016e1554 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b655 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783074227.025540:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x792:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:3.0:1783074227.025556:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:3.0:1783074227.025561:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783074227.025569:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016e154d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b65c expref: 38 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.025582:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016e154d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b65c expref: 38 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.025592:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bdc00, rc 0) 00010000:00000080:3.0:1783074227.025597:0:8443:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c0700 x1869685708150400/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783074227.025629:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025640:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025650:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025662:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025668:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025686:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.025696:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:73603:x1869685708150400:12345-192.168.204.26@tcp:101:dd.0 Request processed in 202us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.025703:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4985 00010000:00010000:1.0:1783074227.025730:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebc00/0x5fb609b3016e1569 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025739:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebc00/0x5fb609b3016e1569 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025746:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebc00/0x5fb609b3016e1569 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783074227.025753:0:66201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:1.0:1783074227.025797:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025805:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025811:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025816:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523cb0eb400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074227.025820:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025826:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025834:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9524f4575000) 00010000:00010000:1.0:1783074227.025848:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074227.025859:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025865:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0eb400/0x5fb609b3016e155b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025875:0:66201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025881:0:66201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025887:0:66201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025892:0:66201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523cb0ebe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074227.025895:0:66201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025899:0:66201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025907:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff9523cadc3000) 00010000:00010000:1.0:1783074227.025909:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074227.025911:0:66201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025916:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebe00/0x5fb609b3016e1562 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025945:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85e00/0x5fb609b3016e1554 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b655 expref: 145 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025977:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebc00/0x5fb609b3016e1569 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b655 expref: 144 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.025983:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:1.0:1783074227.025985:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783074227.025987:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523cb0ebc00, rc 0) 00000100:00100000:1.0:1783074227.026015:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+144:73606:x1869685708150528:12345-192.168.204.26@tcp:101:dd.0 Request processed in 517us (614us total) trans 124554051721 rc 0/0 00000100:00100000:1.0:1783074227.026022:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1497 00000100:00100000:2.0:1783074227.026531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.026577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.026612:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150784 00000100:00100000:0.0:1783074227.026616:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150784 00000100:00100000:0.0:1783074227.026643:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4986 00000100:00100000:0.0:1783074227.026648:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:73604:x1869685708150784:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074227.026655:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074227.026666:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e1577 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b66a expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.026682:0:8444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x793:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00000100:00100000:3.0:1783074227.026686:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150656 00000100:00100000:3.0:1783074227.026693:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150656 00010000:00010000:0.0:1783074227.026694:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:0.0:1783074227.026699:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783074227.026706:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e1577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b66a expref: 39 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.026717:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e1577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b66a expref: 39 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.026724:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da400, rc 0) 00010000:00000080:0.0:1783074227.026735:0:8444:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc304e00 x1869685708150784/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.026736:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1498 00000100:00100000:3.0:1783074227.026750:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+144:73605:x1869685708150656:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1783074227.026762:0:66200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783074227.026770:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:73604:x1869685708150784:12345-192.168.204.26@tcp:101:dd.0 Request processed in 120us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1783074227.026774:0:66200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e157e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b663 expref: -99 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.026777:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4986 00010000:00010000:3.0:1783074227.026802:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd600/0x5fb609b3016e1585 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.026812:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd600/0x5fb609b3016e1585 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.026895:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd600/0x5fb609b3016e1585 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.027149:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bda00/0x5fb609b3016e157e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b663 expref: 146 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.027165:0:66200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd600/0x5fb609b3016e1585 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b663 expref: 145 pid: 66200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074227.027173:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00000100:00100000:0.0:1783074227.027179:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:3.0:1783074227.027185:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783074227.027188:0:66200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bd600, rc 0) 00000100:00100000:1.0:1783074227.027237:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151040 00000100:00100000:1.0:1783074227.027242:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151040 00000100:00100000:1.0:1783074227.027278:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 279 00000100:00100000:1.0:1783074227.027286:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+146:73601:x1869685708151040:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:3.0:1783074227.027303:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+146:73605:x1869685708150656:12345-192.168.204.26@tcp:101:dd.0 Request processed in 555us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.027338:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1498 00000100:00100000:1.0:1783074227.027462:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+146:73601:x1869685708151040:12345-192.168.204.26@tcp:35:dd.0 Request processed in 176us (283us total) trans 124554051722 rc 0/0 00000100:00100000:1.0:1783074227.027469:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 279 00000100:00100000:0.0:1783074227.027753:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.027849:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151168 00000100:00100000:2.0:1783074227.027853:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151168 00002000:00010000:2.0:1783074227.027871:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:2.0:1783074227.027875:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c3800 with x1869685708151168 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074227.027880:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c3800. 00000100:00100000:2.0:1783074227.027926:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 542 00000100:00100000:2.0:1783074227.027931:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2405:x1869685708151168:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:2.0:1783074227.028005:0:24855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783074227.028009:0:24855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074227.028011:0:24855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:2.0:1783074227.028013:0:24855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074227.028016:0:24855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783074227.028028:0:24855:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c3800 x1869685708151168/t4294968757(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.028069:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:2405:x1869685708151168:12345-192.168.204.26@tcp:10:dd.0 Request processed in 138us (316us total) trans 4294968757 rc 0/0 00000100:00100000:2.0:1783074227.028098:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 542 00002000:00010000:2.0:1783074227.028102:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:2.0:1783074227.028104:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c3800 with x1869685708151168 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074227.028109:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c3800. 00000100:00100000:2.0:1783074227.029132:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.029154:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.029175:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.029213:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151296 00000100:00100000:3.0:1783074227.029219:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151296 00000100:00100000:0.0:1783074227.029228:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151424 00000100:00100000:0.0:1783074227.029234:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151424 00002000:00010000:3.0:1783074227.029242:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:3.0:1783074227.029246:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c53fa680 with x1869685708151296 ext(0->18446744073709551615) 00002000:00010000:3.0:1783074227.029254:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c53fa680. 00000100:00100000:0.0:1783074227.029270:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151680 00000100:00100000:0.0:1783074227.029274:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151680 00000100:00100000:0.0:1783074227.029299:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1499 00000100:00100000:0.0:1783074227.029307:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+147:73606:x1869685708151424:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1783074227.029340:0:66201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783074227.029356:0:66201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e158c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b671 expref: -99 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783074227.029360:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 543 00000100:00100000:1.0:1783074227.029375:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1500 00000100:00100000:3.0:1783074227.029376:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:2404:x1869685708151296:12345-192.168.204.26@tcp:10:dd.0 00010000:00010000:0.0:1783074227.029388:0:66201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e1593 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074227.029391:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+148:73605:x1869685708151680:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1783074227.029408:0:66201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e1593 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.029418:0:66201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e1593 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.029429:0:68632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074227.029449:0:68632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d85600/0x5fb609b3016e1531 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b647 expref: 148 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.029464:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:1.0:1783074227.029468:0:68632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1783074227.029469:0:24837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783074227.029474:0:24837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:3.0:1783074227.029479:0:24837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:3.0:1783074227.029481:0:24837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:3.0:1783074227.029484:0:24837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783074227.029493:0:24837:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c53fa680 x1869685708151296/t4294968758(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1783074227.029494:0:66201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dba00/0x5fb609b3016e158c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b671 expref: 148 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.029535:0:66201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021db600/0x5fb609b3016e1593 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b671 expref: 147 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.029543:0:66201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00000100:00100000:3.0:1783074227.029548:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:2404:x1869685708151296:12345-192.168.204.26@tcp:10:dd.0 Request processed in 176us (369us total) trans 4294968758 rc 0/0 00010000:00010000:0.0:1783074227.029549:0:66201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783074227.029554:0:66201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021db600, rc 0) 00000100:00100000:3.0:1783074227.029560:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 543 00002000:00010000:3.0:1783074227.029564:0:24837:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:3.0:1783074227.029567:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c53fa680 with x1869685708151296 ext(0->18446744073709551615) 00002000:00010000:3.0:1783074227.029572:0:24837:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c53fa680. 00010000:00010000:1.0:1783074227.029576:0:68632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.029595:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+148:73606:x1869685708151424:12345-192.168.204.26@tcp:101:dd.0 Request processed in 287us (462us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074227.029596:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.029609:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1499 00010000:00010000:1.0:1783074227.029614:0:68632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783074227.029711:0:68632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051723 00000004:00010000:1.0:1783074227.029734:0:68632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091e9f267 reply state 000000006d98b6ff transno 124554051724 ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.029746:0:68632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.029752:0:68632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:1.0:1783074227.029754:0:68632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074227.029756:0:68632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783074227.029946:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+149:73605:x1869685708151680:12345-192.168.204.26@tcp:36:dd.0 Request processed in 559us (788us total) trans 124554051724 rc 0/0 00000100:00100000:1.0:1783074227.029955:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1500 00000020:00080000:1.0:1783074227.029959:0:68632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783074227.030173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.030248:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151936 00000100:00100000:0.0:1783074227.030253:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151936 00000100:00100000:0.0:1783074227.030283:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 280 00000100:00100000:0.0:1783074227.030291:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+149:73603:x1869685708151936:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:0.0:1783074227.030444:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+150:73603:x1869685708151936:12345-192.168.204.26@tcp:35:dd.0 Request processed in 153us (269us total) trans 124554051725 rc 0/0 00000100:00100000:0.0:1783074227.030452:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 280 00000100:00100000:3.0:1783074227.031557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.031590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.031599:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152192 00000100:00100000:0.0:1783074227.031605:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152192 00000100:00100000:0.0:1783074227.031639:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1501 00000100:00100000:0.0:1783074227.031645:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+150:73606:x1869685708152192:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1783074227.031679:0:66200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783074227.031696:0:66200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ebc00/0x5fb609b3016e1569 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b655 expref: 150 pid: 66201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.031709:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:0.0:1783074227.031717:0:66200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783074227.031802:0:66200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.031813:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.031821:0:66200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783074227.031868:0:66200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051726 00000100:00100000:1.0:1783074227.031870:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152320 00000100:00100000:1.0:1783074227.031875:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152320 00000004:00010000:0.0:1783074227.031892:0:66200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d53a8ea reply state 000000001fc86701 transno 124554051727 ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.031905:0:66200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074227.031911:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4987 00010000:00010000:0.0:1783074227.031917:0:66200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:0.0:1783074227.031922:0:66200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783074227.031923:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:73605:x1869685708152320:12345-192.168.204.26@tcp:101:dd.0 00000100:00100000:0.0:1783074227.031925:0:66200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783074227.031936:0:26174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783074227.031950:0:26174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037696079/0x5fb609b3016e15a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b678 expref: -99 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783074227.031978:0:26174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x794:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:1.0:1783074227.031992:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=3066s v=(0 0) 00000100:00100000:0.0:1783074227.031996:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+152:73606:x1869685708152192:12345-192.168.204.26@tcp:36:dd.0 Request processed in 348us (437us total) trans 124554051727 rc 0/0 00010000:00010000:1.0:1783074227.031999:0:26174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783074227.032011:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1501 00010000:00010000:1.0:1783074227.032015:0:26174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037696079/0x5fb609b3016e15a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b678 expref: 42 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783074227.032017:0:66200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783074227.032033:0:26174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037696079/0x5fb609b3016e15a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b678 expref: 42 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.032044:0:26174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523cb0ea200, rc 0) 00010000:00000080:1.0:1783074227.032050:0:26174:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4686a00 x1869685708152320/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.032076:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:73605:x1869685708152320:12345-192.168.204.26@tcp:101:dd.0 Request processed in 156us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.032082:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4987 00000100:00100000:2.0:1783074227.032262:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.032429:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152576 00000100:00100000:1.0:1783074227.032434:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152576 00000100:00100000:1.0:1783074227.032510:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 281 00000100:00100000:1.0:1783074227.032518:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+152:73604:x1869685708152576:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074227.032650:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+153:73604:x1869685708152576:12345-192.168.204.26@tcp:35:dd.0 Request processed in 132us (388us total) trans 124554051728 rc 0/0 00000100:00100000:1.0:1783074227.032657:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 281 00000100:00100000:3.0:1783074227.033499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.033631:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152704 00000100:00100000:2.0:1783074227.033636:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152704 00002000:00010000:2.0:1783074227.033658:0:24856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:2.0:1783074227.033663:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4687800 with x1869685708152704 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074227.033670:0:24856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4687800. 00000100:00100000:2.0:1783074227.033691:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 544 00000100:00100000:2.0:1783074227.033700:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:2405:x1869685708152704:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:2.0:1783074227.033787:0:24856:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783074227.033791:0:24856:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074227.033794:0:24856:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:2.0:1783074227.033797:0:24856:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:2.0:1783074227.033799:0:24856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783074227.033807:0:24856:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4687800 x1869685708152704/t4294968759(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.033923:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:2405:x1869685708152704:12345-192.168.204.26@tcp:10:dd.0 Request processed in 224us (424us total) trans 4294968759 rc 0/0 00000100:00100000:2.0:1783074227.033944:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 544 00002000:00010000:2.0:1783074227.033947:0:24856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:2.0:1783074227.033951:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4687800 with x1869685708152704 ext(0->18446744073709551615) 00002000:00010000:2.0:1783074227.033956:0:24856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4687800. 00000100:00100000:3.0:1783074227.034197:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.034259:0:26178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152832 00000100:00100000:2.0:1783074227.034263:0:26178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152832 00000100:00100000:2.0:1783074227.034295:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4988 00000100:00100000:2.0:1783074227.034303:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:73606:x1869685708152832:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1783074227.034346:0:26178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783074227.034361:0:26178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e15af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b67f expref: -99 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783074227.034377:0:26178:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x795:0x0] initial LVB size: 0, mtime: 0x6a478dad, atime: 0x6a478dad, ctime: 0x6a478dad, blocks: 0x0 00010000:00010000:2.0:1783074227.034389:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=3066s v=(0 0) 00010000:00010000:2.0:1783074227.034394:0:26178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783074227.034400:0:26178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e15af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b67f expref: 44 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.034414:0:26178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e15af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b67f expref: 44 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.034424:0:26178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151a200, rc 0) 00010000:00000080:2.0:1783074227.034429:0:26178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4687100 x1869685708152832/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 328/400 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.034459:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+44:73606:x1869685708152832:12345-192.168.204.26@tcp:101:dd.0 Request processed in 157us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.034471:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4988 00000100:00100000:3.0:1783074227.035801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.035854:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152960 00000100:00100000:0.0:1783074227.035861:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152960 00002000:00010000:0.0:1783074227.035887:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:0.0:1783074227.035892:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4684380 with x1869685708152960 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074227.035900:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4684380. 00000100:00100000:0.0:1783074227.035926:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 545 00000100:00100000:0.0:1783074227.035936:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+44:2404:x1869685708152960:12345-192.168.204.26@tcp:10:dd.0 00002000:00010000:0.0:1783074227.036058:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783074227.036062:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb mtime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.036066:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb atime from disk: 1783074221 -> 1783074221 00002000:00010000:0.0:1783074227.036069:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb ctime from disk: 1783074221 -> 1783074226 00002000:00010000:0.0:1783074227.036071:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783074227.036080:0:24842:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4684380 x1869685708152960/t4294968760(0) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.036126:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+45:2404:x1869685708152960:12345-192.168.204.26@tcp:10:dd.0 Request processed in 193us (329us total) trans 4294968760 rc 0/0 00000100:00100000:0.0:1783074227.036137:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 545 00000100:00100000:2.0:1783074227.036142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00002000:00010000:0.0:1783074227.036143:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:0.0:1783074227.036148:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4684380 with x1869685708152960 ext(0->18446744073709551615) 00002000:00010000:0.0:1783074227.036154:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4684380. 00000100:00100000:1.0:1783074227.036208:0:80537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153216 00000100:00100000:1.0:1783074227.036220:0:80537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153216 00000100:00100000:1.0:1783074227.036254:0:80537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 282 00000100:00100000:1.0:1783074227.036263:0:80537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+153:73605:x1869685708153216:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074227.036493:0:80537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+154:73605:x1869685708153216:12345-192.168.204.26@tcp:35:dd.0 Request processed in 231us (357us total) trans 124554051729 rc 0/0 00000100:00100000:1.0:1783074227.036500:0:80537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 282 00000100:00100000:2.0:1783074227.037899:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.037945:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153472 00000100:00100000:1.0:1783074227.037950:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153472 00000100:00100000:1.0:1783074227.037994:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 283 00000100:00100000:1.0:1783074227.038004:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+154:73606:x1869685708153472:12345-192.168.204.26@tcp:35:dd.0 00000100:00100000:1.0:1783074227.038170:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+155:73606:x1869685708153472:12345-192.168.204.26@tcp:35:dd.0 Request processed in 167us (273us total) trans 124554051730 rc 0/0 00000100:00100000:1.0:1783074227.038178:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 283 00000100:00100000:3.0:1783074227.183761:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.183900:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153600 00000100:00100000:1.0:1783074227.183910:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153600 00002000:00100000:1.0:1783074227.183960:0:24838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff9524df3b9180 x1869685708153600/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.183972:0:24838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b9180 with x1869685708153600 ext(0->1023) 00002000:00010000:1.0:1783074227.183978:0:24838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b9180 00000100:00100000:1.0:1783074227.184016:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 546 00000100:00100000:1.0:1783074227.184026:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+45:2404:x1869685708153600:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:1.0:1783074227.184441:0:24838:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b9180 x1869685708153600/t4294968761(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.184499:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:2404:x1869685708153600:12345-192.168.204.26@tcp:4:dd.0 Request processed in 474us (751us total) trans 4294968761 rc 0/0 00000100:00100000:1.0:1783074227.184517:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 546 00002000:00100000:1.0:1783074227.184524:0:24838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff9524df3b9180 x1869685708153600/t4294968761(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.184530:0:24838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b9180 with x1869685708153600 ext(0->1023) 00002000:00010000:1.0:1783074227.184533:0:24838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b9180 00000100:00100000:2.0:1783074227.185523:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.186048:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.186082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.186126:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153856 00000100:00100000:1.0:1783074227.186135:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153856 00000100:00100000:1.0:1783074227.186182:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:2.0:1783074227.186194:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.186194:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2402:x1869685708153856:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074227.186237:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153984 00000100:00100000:2.0:1783074227.186242:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153984 00000100:00100000:1.0:1783074227.186248:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c6e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2402:x1869685708153856:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 57us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.186256:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00080000:1.0:1783074227.186294:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783074227.186420:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 907 00000100:00100000:2.0:1783074227.186432:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2402:x1869685708153984:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074227.186467:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2402:x1869685708153984:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.186473:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 907 00000100:00100000:0.0:1783074227.186630:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153728 00000100:00100000:0.0:1783074227.186638:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153728 00000100:00100000:3.0:1783074227.186641:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154112 00000100:00100000:3.0:1783074227.186646:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154112 00000100:00100000:0.0:1783074227.186675:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4989 00000100:00100000:0.0:1783074227.186683:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:2404:x1869685708153728:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:3.0:1783074227.186773:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2212 00000100:00100000:3.0:1783074227.186780:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708154112:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074227.186814:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708154112:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 35us (732us total) trans 0 rc 0/0 00000100:00080000:1.0:1783074227.186848:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783074227.187035:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968761 is committed 00010000:00000080:1.0:1783074227.187171:0:26173:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c53fbb80 x1869685708153728/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.187211:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:2404:x1869685708153728:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 529us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.188019:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2212 00000100:00100000:1.0:1783074227.188060:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4989 00000100:00100000:1.0:1783074227.190823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.190871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.190947:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154368 00000100:00100000:3.0:1783074227.190957:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154368 00000100:00100000:0.0:1783074227.190959:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154240 00000100:00100000:0.0:1783074227.190962:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154240 00002000:00100000:0.0:1783074227.191002:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff9523c53f8e00 x1869685708154240/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.191072:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c53f8e00 with x1869685708154240 ext(0->1023) 00002000:00010000:0.0:1783074227.191080:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c53f8e00 00000100:00100000:0.0:1783074227.191140:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 547 00000100:00100000:0.0:1783074227.191163:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2405:x1869685708154240:12345-192.168.204.26@tcp:4:dd.0 00000100:00100000:3.0:1783074227.191227:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4990 00000100:00100000:3.0:1783074227.191236:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2405:x1869685708154368:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:3.0:1783074227.191268:0:26166:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c1500 x1869685708154368/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.191346:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2405:x1869685708154368:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 111us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.191353:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4990 00010000:00000080:0.0:1783074227.191585:0:24844:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c53f8e00 x1869685708154240/t4294968762(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.191636:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2405:x1869685708154240:12345-192.168.204.26@tcp:4:dd.0 Request processed in 474us (765us total) trans 4294968762 rc 0/0 00000100:00100000:0.0:1783074227.191643:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 547 00002000:00100000:0.0:1783074227.191649:0:24844:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff9523c53f8e00 x1869685708154240/t4294968762(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.191657:0:24844:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c53f8e00 with x1869685708154240 ext(0->1023) 00002000:00010000:0.0:1783074227.191660:0:24844:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c53f8e00 00000100:00100000:2.0:1783074227.194110:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.194198:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154624 00000100:00100000:0.0:1783074227.194206:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154624 00000100:00100000:1.0:1783074227.194277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.194284:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4991 00000100:00100000:0.0:1783074227.194302:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2404:x1869685708154624:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.194370:0:26172:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c53f9c00 x1869685708154624/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.194398:0:24854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154496 00000100:00100000:3.0:1783074227.194402:0:24854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154496 00002000:00100000:3.0:1783074227.194425:0:24854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff9523c49c3480 x1869685708154496/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.194425:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:2404:x1869685708154624:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 133us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.194432:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4991 00002000:00100000:3.0:1783074227.194434:0:24854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c3480 with x1869685708154496 ext(0->1023) 00002000:00010000:3.0:1783074227.194449:0:24854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c3480 00000100:00100000:3.0:1783074227.194674:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 548 00000100:00100000:3.0:1783074227.194684:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2405:x1869685708154496:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:3.0:1783074227.195002:0:24854:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c3480 x1869685708154496/t4294968763(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.195044:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2405:x1869685708154496:12345-192.168.204.26@tcp:4:dd.0 Request processed in 362us (767us total) trans 4294968763 rc 0/0 00000100:00100000:3.0:1783074227.195051:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 548 00002000:00100000:3.0:1783074227.195058:0:24854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff9523c49c3480 x1869685708154496/t4294968763(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.195066:0:24854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c3480 with x1869685708154496 ext(0->1023) 00002000:00010000:3.0:1783074227.195069:0:24854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c3480 00000100:00100000:3.0:1783074227.196909:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.196909:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.196971:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154880 00000100:00100000:0.0:1783074227.196978:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154880 00000100:00100000:2.0:1783074227.197020:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154752 00000100:00100000:2.0:1783074227.197026:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154752 00002000:00100000:2.0:1783074227.197063:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff9523c49c0a80 x1869685708154752/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.197071:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c0a80 with x1869685708154752 ext(0->1023) 00002000:00010000:2.0:1783074227.197075:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c0a80 00000100:00100000:2.0:1783074227.197096:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 549 00000100:00100000:2.0:1783074227.197103:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2405:x1869685708154752:12345-192.168.204.26@tcp:4:dd.0 00000100:00100000:0.0:1783074227.197130:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4992 00000100:00100000:0.0:1783074227.197140:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2405:x1869685708154880:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.197167:0:26168:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3ba300 x1869685708154880/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.197214:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2405:x1869685708154880:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 76us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.197222:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4992 00010000:00000080:2.0:1783074227.197394:0:24837:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c0a80 x1869685708154752/t4294968764(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.197451:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2405:x1869685708154752:12345-192.168.204.26@tcp:4:dd.0 Request processed in 348us (548us total) trans 4294968764 rc 0/0 00000100:00100000:2.0:1783074227.197459:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 549 00002000:00100000:2.0:1783074227.197466:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff9523c49c0a80 x1869685708154752/t4294968764(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.197475:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c0a80 with x1869685708154752 ext(0->1023) 00002000:00010000:2.0:1783074227.197479:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c0a80 00000100:00100000:1.0:1783074227.202293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.202337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.202394:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155008 00000100:00100000:2.0:1783074227.202404:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155008 00002000:00100000:2.0:1783074227.202450:0:8450:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff9524df3b8700 x1869685708155008/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.202462:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b8700 with x1869685708155008 ext(0->1023) 00002000:00010000:2.0:1783074227.202467:0:8450:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b8700 00000100:00100000:2.0:1783074227.202497:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 550 00000100:00100000:2.0:1783074227.202508:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2403:x1869685708155008:12345-192.168.204.26@tcp:4:dd.0 00000100:00100000:0.0:1783074227.202619:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155136 00000100:00100000:0.0:1783074227.202623:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155136 00000100:00100000:0.0:1783074227.202651:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4993 00000100:00100000:0.0:1783074227.202658:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:2402:x1869685708155136:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.202684:0:8445:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c0e00 x1869685708155136/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.202728:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:2402:x1869685708155136:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 72us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.202734:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4993 00010000:00000080:2.0:1783074227.202898:0:8450:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b8700 x1869685708155008/t4294968765(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.202931:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2403:x1869685708155008:12345-192.168.204.26@tcp:4:dd.0 Request processed in 426us (664us total) trans 4294968765 rc 0/0 00000100:00100000:2.0:1783074227.202937:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 550 00002000:00100000:2.0:1783074227.202945:0:8450:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff9524df3b8700 x1869685708155008/t4294968765(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.202953:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b8700 with x1869685708155008 ext(0->1023) 00002000:00010000:2.0:1783074227.202975:0:8450:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b8700 00000100:00100000:1.0:1783074227.207346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.207402:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155392 00000100:00100000:2.0:1783074227.207409:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155392 00000100:00100000:2.0:1783074227.207445:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4994 00000100:00100000:2.0:1783074227.207452:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2404:x1869685708155392:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:2.0:1783074227.207494:0:26177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c0000 x1869685708155392/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.207542:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2404:x1869685708155392:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.207550:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4994 00000100:00100000:2.0:1783074227.208184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.208331:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155264 00000100:00100000:1.0:1783074227.208348:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155264 00002000:00100000:1.0:1783074227.208375:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff9523c53f9f80 x1869685708155264/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.208385:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c53f9f80 with x1869685708155264 ext(0->1023) 00002000:00010000:1.0:1783074227.208391:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c53f9f80 00000100:00100000:1.0:1783074227.208560:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 551 00000100:00100000:1.0:1783074227.208572:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2405:x1869685708155264:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:1.0:1783074227.209219:0:8448:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c53f9f80 x1869685708155264/t4294968766(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.209257:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2405:x1869685708155264:12345-192.168.204.26@tcp:4:dd.0 Request processed in 688us (1075us total) trans 4294968766 rc 0/0 00000100:00100000:1.0:1783074227.209262:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 551 00002000:00100000:1.0:1783074227.209266:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff9523c53f9f80 x1869685708155264/t4294968766(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.209272:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c53f9f80 with x1869685708155264 ext(0->1023) 00002000:00010000:1.0:1783074227.209276:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c53f9f80 00000100:00100000:3.0:1783074227.209937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.209988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.210010:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155648 00000100:00100000:3.0:1783074227.210016:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155648 00000100:00100000:1.0:1783074227.210041:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155520 00000100:00100000:1.0:1783074227.210047:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155520 00000100:00100000:3.0:1783074227.210053:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4995 00000100:00100000:3.0:1783074227.210064:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2403:x1869685708155648:12345-192.168.204.26@tcp:16:kworker.0 00002000:00100000:1.0:1783074227.210074:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff9524df3b9880 x1869685708155520/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.210084:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b9880 with x1869685708155520 ext(0->1023) 00002000:00010000:1.0:1783074227.210089:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b9880 00010000:00000080:3.0:1783074227.210096:0:26171:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3bb100 x1869685708155648/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.210110:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 552 00000100:00100000:1.0:1783074227.210120:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2403:x1869685708155520:12345-192.168.204.26@tcp:4:dd.0 00000100:00100000:3.0:1783074227.210143:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2403:x1869685708155648:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.210161:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4995 00010000:00000080:1.0:1783074227.210683:0:24841:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b9880 x1869685708155520/t4294968767(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.210725:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:2403:x1869685708155520:12345-192.168.204.26@tcp:4:dd.0 Request processed in 606us (789us total) trans 4294968767 rc 0/0 00000100:00100000:1.0:1783074227.210732:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 552 00002000:00100000:1.0:1783074227.210739:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff9524df3b9880 x1869685708155520/t4294968767(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.210747:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b9880 with x1869685708155520 ext(0->1023) 00002000:00010000:1.0:1783074227.210750:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b9880 00000100:00100000:0.0:1783074227.214481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.214503:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.214535:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155904 00000100:00100000:0.0:1783074227.214544:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155904 00000100:00100000:3.0:1783074227.214599:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155776 00000100:00100000:3.0:1783074227.214604:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155776 00000100:00100000:0.0:1783074227.214607:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4996 00000100:00100000:0.0:1783074227.214620:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2405:x1869685708155904:12345-192.168.204.26@tcp:16:kworker.0 00002000:00100000:3.0:1783074227.214633:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff9523c20c2680 x1869685708155776/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.214642:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c2680 with x1869685708155776 ext(0->1023) 00002000:00010000:3.0:1783074227.214646:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c2680 00000100:00100000:3.0:1783074227.214662:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 553 00000100:00100000:3.0:1783074227.214668:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2405:x1869685708155776:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.214676:0:17659:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c1c00 x1869685708155904/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.214728:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2405:x1869685708155904:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.214736:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4996 00010000:00000080:3.0:1783074227.215027:0:24843:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c2680 x1869685708155776/t4294968768(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.215053:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2405:x1869685708155776:12345-192.168.204.26@tcp:4:dd.0 Request processed in 386us (583us total) trans 4294968768 rc 0/0 00000100:00100000:3.0:1783074227.215059:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 553 00002000:00100000:3.0:1783074227.215064:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff9523c20c2680 x1869685708155776/t4294968768(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.215070:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c2680 with x1869685708155776 ext(0->1023) 00002000:00010000:3.0:1783074227.215073:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c2680 00000100:00100000:0.0:1783074227.219241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.219283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.219341:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156160 00000100:00100000:0.0:1783074227.219349:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156160 00000100:00100000:0.0:1783074227.219393:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4997 00000100:00100000:0.0:1783074227.219402:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2403:x1869685708156160:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.219449:0:26176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c1180 x1869685708156160/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.219509:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2403:x1869685708156160:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.219518:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4997 00000100:00100000:3.0:1783074227.219668:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156032 00000100:00100000:3.0:1783074227.219674:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156032 00002000:00100000:3.0:1783074227.219705:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff9523c20c0a80 x1869685708156032/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.219715:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c0a80 with x1869685708156032 ext(0->1023) 00002000:00010000:3.0:1783074227.219721:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c0a80 00000100:00100000:0.0:1783074227.219879:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 554 00000100:00100000:0.0:1783074227.219888:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2402:x1869685708156032:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.220189:0:24854:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c0a80 x1869685708156032/t4294968769(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.220351:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:2402:x1869685708156032:12345-192.168.204.26@tcp:4:dd.0 Request processed in 464us (1118us total) trans 4294968769 rc 0/0 00000100:00100000:0.0:1783074227.220359:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 554 00002000:00100000:0.0:1783074227.220366:0:24854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff9523c20c0a80 x1869685708156032/t4294968769(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.220375:0:24854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c0a80 with x1869685708156032 ext(0->1023) 00002000:00010000:0.0:1783074227.220379:0:24854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c0a80 00000100:00100000:3.0:1783074227.223278:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.223365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.223390:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156416 00000100:00100000:0.0:1783074227.223401:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156416 00000100:00100000:0.0:1783074227.223451:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4998 00000100:00100000:1.0:1783074227.223453:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156288 00000100:00100000:0.0:1783074227.223462:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:2404:x1869685708156416:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:1.0:1783074227.223470:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156288 00002000:00100000:1.0:1783074227.223504:0:8449:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff9524df3bb800 x1869685708156288/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00000080:0.0:1783074227.223514:0:26170:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3bbb80 x1869685708156416/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.223520:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3bb800 with x1869685708156288 ext(0->1023) 00002000:00010000:1.0:1783074227.223527:0:8449:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3bb800 00000100:00100000:0.0:1783074227.223557:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:2404:x1869685708156416:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.223561:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 555 00000100:00100000:0.0:1783074227.223565:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4998 00000100:00100000:1.0:1783074227.223576:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:2404:x1869685708156288:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:1.0:1783074227.223897:0:8449:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3bb800 x1869685708156288/t4294968770(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.223940:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:2404:x1869685708156288:12345-192.168.204.26@tcp:4:dd.0 Request processed in 368us (575us total) trans 4294968770 rc 0/0 00000100:00100000:1.0:1783074227.223947:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 555 00002000:00100000:1.0:1783074227.223954:0:8449:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff9524df3bb800 x1869685708156288/t4294968770(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.223969:0:8449:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3bb800 with x1869685708156288 ext(0->1023) 00002000:00010000:1.0:1783074227.223973:0:8449:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3bb800 00000100:00100000:3.0:1783074227.227653:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.227654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.227733:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156672 00000100:00100000:2.0:1783074227.227768:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156544 00000100:00100000:1.0:1783074227.227828:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156672 00000100:00100000:2.0:1783074227.227841:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156544 00002000:00100000:2.0:1783074227.227885:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff9523c20c0000 x1869685708156544/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.227896:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c0000 with x1869685708156544 ext(0->1023) 00002000:00010000:2.0:1783074227.227901:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c0000 00000100:00100000:2.0:1783074227.227927:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 556 00000100:00100000:2.0:1783074227.227935:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:2402:x1869685708156544:12345-192.168.204.26@tcp:4:dd.0 00000100:00100000:1.0:1783074227.228012:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4999 00000100:00100000:1.0:1783074227.228033:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+44:2403:x1869685708156672:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:1.0:1783074227.228138:0:26167:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3bb480 x1869685708156672/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.228190:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+44:2403:x1869685708156672:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 158us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.228198:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4999 00010000:00000080:2.0:1783074227.228665:0:24856:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c20c0000 x1869685708156544/t4294968771(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.228700:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+45:2402:x1869685708156544:12345-192.168.204.26@tcp:4:dd.0 Request processed in 765us (1053us total) trans 4294968771 rc 0/0 00000100:00100000:2.0:1783074227.228706:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 556 00002000:00100000:2.0:1783074227.228712:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff9523c20c0000 x1869685708156544/t4294968771(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.228725:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c20c0000 with x1869685708156544 ext(0->1023) 00002000:00010000:2.0:1783074227.228729:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c20c0000 00000100:00100000:3.0:1783074227.232186:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.232269:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.232344:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156928 00000100:00100000:2.0:1783074227.232352:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156928 00000100:00100000:2.0:1783074227.232397:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5000 00000100:00100000:2.0:1783074227.232406:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+45:2405:x1869685708156928:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:2.0:1783074227.232451:0:26175:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b8a80 x1869685708156928/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.232629:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156800 00000100:00100000:0.0:1783074227.232633:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156800 00002000:00100000:0.0:1783074227.232656:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff9524df3b8000 x1869685708156800/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.232665:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b8000 with x1869685708156800 ext(0->1023) 00002000:00010000:0.0:1783074227.232670:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b8000 00000100:00100000:0.0:1783074227.232685:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 557 00000100:00100000:0.0:1783074227.232691:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+46:2405:x1869685708156800:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.233013:0:24842:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b8000 x1869685708156800/t4294968772(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.233188:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+48:2405:x1869685708156928:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 783us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.233200:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5000 00000100:00100000:0.0:1783074227.235864:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:2405:x1869685708156800:12345-192.168.204.26@tcp:4:dd.0 Request processed in 3165us (3680us total) trans 4294968772 rc 0/0 00000100:00100000:0.0:1783074227.235877:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 557 00002000:00100000:0.0:1783074227.235887:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff9524df3b8000 x1869685708156800/t4294968772(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.235898:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b8000 with x1869685708156800 ext(0->1023) 00002000:00010000:0.0:1783074227.235904:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b8000 00000100:00100000:1.0:1783074227.238919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.238958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.238965:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157056 00000100:00100000:3.0:1783074227.238976:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157056 00002000:00100000:3.0:1783074227.239030:0:24838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff9523c49c2300 x1869685708157056/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.239040:0:24838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c2300 with x1869685708157056 ext(0->1023) 00002000:00010000:3.0:1783074227.239046:0:24838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c2300 00000100:00100000:3.0:1783074227.239078:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 558 00000100:00100000:3.0:1783074227.239088:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+47:2403:x1869685708157056:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:3.0:1783074227.239541:0:24838:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c2300 x1869685708157056/t4294968773(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.239606:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2403:x1869685708157056:12345-192.168.204.26@tcp:4:dd.0 Request processed in 519us (692us total) trans 4294968773 rc 0/0 00000100:00100000:3.0:1783074227.239614:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 558 00002000:00100000:3.0:1783074227.239621:0:24838:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff9523c49c2300 x1869685708157056/t4294968773(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.239630:0:24838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c2300 with x1869685708157056 ext(0->1023) 00002000:00010000:3.0:1783074227.239633:0:24838:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c2300 00000100:00100000:3.0:1783074227.239657:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157184 00000100:00100000:3.0:1783074227.239662:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157184 00000100:00100000:3.0:1783074227.239696:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5001 00000100:00100000:3.0:1783074227.239704:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2402:x1869685708157184:12345-192.168.204.26@tcp:16:kworker.0 00000001:00080000:3.0:1783074227.240093:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968773 is committed 00010000:00000080:0.0:1783074227.243252:0:8487:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c3800 x1869685708157184/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.243470:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:2402:x1869685708157184:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 3766us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.243480:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5001 00000100:00100000:0.0:1783074227.245438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.245484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.245488:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157312 00000100:00100000:3.0:1783074227.245498:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157312 00000100:00100000:0.0:1783074227.245528:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157440 00000100:00100000:0.0:1783074227.245534:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157440 00002000:00100000:3.0:1783074227.245540:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff9523c76c3100 x1869685708157312/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.245552:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c3100 with x1869685708157312 ext(0->1023) 00002000:00010000:3.0:1783074227.245558:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c3100 00000100:00100000:0.0:1783074227.245586:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5002 00000100:00100000:3.0:1783074227.245593:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 559 00000100:00100000:0.0:1783074227.245598:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2405:x1869685708157440:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:3.0:1783074227.245608:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2404:x1869685708157312:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.245648:0:8443:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c2a00 x1869685708157440/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.245694:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2405:x1869685708157440:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 100us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.245701:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5002 00010000:00000080:3.0:1783074227.245950:0:24843:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c76c3100 x1869685708157312/t4294968774(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.245987:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2404:x1869685708157312:12345-192.168.204.26@tcp:4:dd.0 Request processed in 384us (554us total) trans 4294968774 rc 0/0 00000100:00100000:3.0:1783074227.246005:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 559 00002000:00100000:3.0:1783074227.246011:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff9523c76c3100 x1869685708157312/t4294968774(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.246020:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c76c3100 with x1869685708157312 ext(0->1023) 00002000:00010000:3.0:1783074227.246024:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c76c3100 00000100:00100000:1.0:1783074227.248198:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.248240:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157568 00000100:00100000:2.0:1783074227.248248:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157568 00002000:00100000:2.0:1783074227.248285:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff9523c49c0700 x1869685708157568/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783074227.248294:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c0700 with x1869685708157568 ext(0->1023) 00002000:00010000:2.0:1783074227.248299:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c0700 00000100:00100000:1.0:1783074227.248424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.248497:0:26177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157696 00000100:00100000:3.0:1783074227.248501:0:26177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157696 00000100:00100000:3.0:1783074227.248533:0:26177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5003 00000100:00100000:3.0:1783074227.248541:0:26177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:2403:x1869685708157696:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:3.0:1783074227.248578:0:26177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c0380 x1869685708157696/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.248655:0:26177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:2403:x1869685708157696:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 114us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074227.248662:0:26177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5003 00000100:00100000:0.0:1783074227.248866:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 560 00000100:00100000:0.0:1783074227.248876:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2402:x1869685708157568:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.249259:0:24854:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c0700 x1869685708157568/t4294968775(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.249392:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2402:x1869685708157568:12345-192.168.204.26@tcp:4:dd.0 Request processed in 518us (1201us total) trans 4294968775 rc 0/0 00000100:00100000:0.0:1783074227.249400:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 560 00002000:00100000:0.0:1783074227.249406:0:24854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff9523c49c0700 x1869685708157568/t4294968775(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.249415:0:24854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c49c0700 with x1869685708157568 ext(0->1023) 00002000:00010000:0.0:1783074227.249424:0:24854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c49c0700 00000100:00100000:3.0:1783074227.250271:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074227.250363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074227.251181:0:26171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157952 00000100:00100000:2.0:1783074227.251186:0:26171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157952 00000100:00100000:2.0:1783074227.251217:0:26171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5004 00000100:00100000:2.0:1783074227.251224:0:26171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2402:x1869685708157952:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:2.0:1783074227.251251:0:26171:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c49c1f80 x1869685708157952/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.251272:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157824 00000100:00100000:0.0:1783074227.251277:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157824 00000100:00100000:2.0:1783074227.251292:0:26171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2402:x1869685708157952:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 69us (929us total) trans 0 rc 0/0 00002000:00100000:0.0:1783074227.251301:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff9524df3b9500 x1869685708157824/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074227.251330:0:26171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5004 00002000:00100000:0.0:1783074227.251446:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b9500 with x1869685708157824 ext(0->1023) 00002000:00010000:0.0:1783074227.251451:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b9500 00000100:00100000:0.0:1783074227.251532:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 561 00000100:00100000:0.0:1783074227.252467:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2402:x1869685708157824:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.252866:0:24837:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b9500 x1869685708157824/t4294968776(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.253051:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2402:x1869685708157824:12345-192.168.204.26@tcp:4:dd.0 Request processed in 1510us (2779us total) trans 4294968776 rc 0/0 00000100:00100000:0.0:1783074227.253059:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 561 00002000:00100000:0.0:1783074227.253066:0:24837:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff9524df3b9500 x1869685708157824/t4294968776(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783074227.253075:0:24837:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b9500 with x1869685708157824 ext(0->1023) 00002000:00010000:0.0:1783074227.253079:0:24837:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b9500 00000100:00100000:1.0:1783074227.254222:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.254229:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.254260:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158208 00000100:00100000:0.0:1783074227.254268:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158208 00000100:00100000:0.0:1783074227.254306:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5005 00000100:00100000:0.0:1783074227.254335:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2402:x1869685708158208:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.254371:0:17659:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524c6ce8a80 x1869685708158208/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.254418:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2402:x1869685708158208:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.254425:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5005 00000100:00100000:3.0:1783074227.254557:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158080 00000100:00100000:3.0:1783074227.254562:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158080 00002000:00100000:3.0:1783074227.254585:0:8450:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff9523c4aeb800 x1869685708158080/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.254594:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4aeb800 with x1869685708158080 ext(0->1023) 00002000:00010000:3.0:1783074227.254599:0:8450:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4aeb800 00000100:00100000:3.0:1783074227.254652:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 562 00000100:00100000:3.0:1783074227.254661:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2402:x1869685708158080:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:3.0:1783074227.255250:0:8450:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4aeb800 x1869685708158080/t4294968777(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.255289:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2402:x1869685708158080:12345-192.168.204.26@tcp:4:dd.0 Request processed in 630us (1062us total) trans 4294968777 rc 0/0 00000100:00100000:3.0:1783074227.255297:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 562 00002000:00100000:3.0:1783074227.255303:0:8450:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff9523c4aeb800 x1869685708158080/t4294968777(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.255338:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4aeb800 with x1869685708158080 ext(0->1023) 00002000:00010000:3.0:1783074227.255343:0:8450:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4aeb800 00000100:00100000:0.0:1783074227.257864:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.257901:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.257932:0:26176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158464 00000100:00100000:0.0:1783074227.257939:0:26176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158464 00000100:00100000:0.0:1783074227.257990:0:26176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5006 00000100:00100000:0.0:1783074227.258000:0:26176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2403:x1869685708158464:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.258041:0:26176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4ae8a80 x1869685708158464/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.258085:0:26176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2403:x1869685708158464:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 87us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.258103:0:26176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5006 00000100:00100000:3.0:1783074227.258258:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158336 00000100:00100000:3.0:1783074227.258263:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158336 00002000:00100000:3.0:1783074227.258287:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff9523c4ae8000 x1869685708158336/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.258302:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4ae8000 with x1869685708158336 ext(0->1023) 00002000:00010000:3.0:1783074227.258308:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4ae8000 00000100:00100000:3.0:1783074227.258353:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 563 00000100:00100000:3.0:1783074227.258362:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2403:x1869685708158336:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:3.0:1783074227.258658:0:8448:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4ae8000 x1869685708158336/t4294968778(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.258690:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2403:x1869685708158336:12345-192.168.204.26@tcp:4:dd.0 Request processed in 329us (829us total) trans 4294968778 rc 0/0 00000100:00100000:3.0:1783074227.258697:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 563 00002000:00100000:3.0:1783074227.258704:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff9523c4ae8000 x1869685708158336/t4294968778(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.258712:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9523c4ae8000 with x1869685708158336 ext(0->1023) 00002000:00010000:3.0:1783074227.258716:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9523c4ae8000 00000100:00100000:3.0:1783074227.262933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.262934:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.262986:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158720 00000100:00100000:0.0:1783074227.262995:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158720 00000100:00100000:0.0:1783074227.263052:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5007 00000100:00100000:0.0:1783074227.263067:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2403:x1869685708158720:12345-192.168.204.26@tcp:16:kworker.0 00010000:00000080:0.0:1783074227.263121:0:26170:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9523c4ae9500 x1869685708158720/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.263129:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158592 00000100:00100000:1.0:1783074227.263135:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158592 00002000:00100000:1.0:1783074227.263165:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff9524df3b8e00 x1869685708158592/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.263175:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b8e00 with x1869685708158592 ext(0->1023) 00000100:00100000:0.0:1783074227.263182:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2403:x1869685708158720:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 117us (258us total) trans 0 rc 0/0 00002000:00010000:1.0:1783074227.263184:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b8e00 00000100:00100000:0.0:1783074227.263195:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5007 00000100:00100000:1.0:1783074227.263208:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 564 00000100:00100000:1.0:1783074227.263224:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2403:x1869685708158592:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:1.0:1783074227.263618:0:24841:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524df3b8e00 x1869685708158592/t4294968779(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074227.263671:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:2403:x1869685708158592:12345-192.168.204.26@tcp:4:dd.0 Request processed in 448us (745us total) trans 4294968779 rc 0/0 00000100:00100000:1.0:1783074227.263679:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 564 00002000:00100000:1.0:1783074227.263685:0:24841:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff9524df3b8e00 x1869685708158592/t4294968779(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783074227.263694:0:24841:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524df3b8e00 with x1869685708158592 ext(0->1023) 00002000:00010000:1.0:1783074227.263698:0:24841:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524df3b8e00 00000100:00100000:3.0:1783074227.265277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074227.265341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074227.265369:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158976 00000100:00100000:3.0:1783074227.265375:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158848 00000100:00100000:0.0:1783074227.265377:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158976 00000100:00100000:3.0:1783074227.265381:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158848 00002000:00100000:3.0:1783074227.265413:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff9524fc494700 x1869685708158848/t0(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/0 e 0 to 0 dl 1783074238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.265423:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc494700 with x1869685708158848 ext(0->1023) 00000100:00100000:0.0:1783074227.265427:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5008 00002000:00010000:3.0:1783074227.265430:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc494700 00000100:00100000:0.0:1783074227.265441:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2404:x1869685708158976:12345-192.168.204.26@tcp:16:kworker.0 00000100:00100000:3.0:1783074227.265454:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 565 00000100:00100000:3.0:1783074227.265471:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2405:x1869685708158848:12345-192.168.204.26@tcp:4:dd.0 00010000:00000080:0.0:1783074227.265476:0:26166:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc495180 x1869685708158976/t0(0) o16->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 440/432 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074227.265530:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2404:x1869685708158976:12345-192.168.204.26@tcp:16:kworker.0 Request processed in 94us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.265536:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5008 00010000:00000080:3.0:1783074227.265845:0:24843:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9524fc494700 x1869685708158848/t4294968780(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074227.265885:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2405:x1869685708158848:12345-192.168.204.26@tcp:4:dd.0 Request processed in 416us (611us total) trans 4294968780 rc 0/0 00000100:00100000:3.0:1783074227.265893:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 565 00002000:00100000:3.0:1783074227.265900:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff9524fc494700 x1869685708158848/t4294968780(0) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:553/0 lens 1512/448 e 0 to 0 dl 1783074238 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783074227.265908:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9524fc494700 with x1869685708158848 ext(0->1023) 00002000:00010000:3.0:1783074227.265912:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9524fc494700 00010000:00010000:3.0:1783074227.823441:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783074227.848433:0:95900:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783074227.848495:0:95900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.848509:0:95900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.848517:0:95900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.848524:0:95900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.848553:0:95900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783074227.848559:0:95900:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783074227.848598:0:95900:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074227.848603:0:95900:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783074227.848609:0:95900:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783074227.848632:0:95900:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783074227.848700:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074227.848708:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.848718:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c3299400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074227.848723:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.848733:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074227.848741:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074227.848747:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783074227.848750:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783074227.848753:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1783074227.848764:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723652992:0@lo:39:umount.0 00010000:00010000:1.0:1783074227.848787:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.848796:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783074227.848840:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.848849:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9523c3299400/0x5fb609b3016e0bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0bd7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074227.848858:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723653120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074227.848862:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074227.848865:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074227.848867:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074227.848918:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074227.848958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653120 00000100:00100000:1.0:1783074227.848965:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653120 00000100:00100000:1.0:1783074227.849013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783074227.849022:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723653120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783074227.849035:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074227.849050:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524fb671600/0x5fb609b3016e0bd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0bd0 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.849063:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074227.849105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3661:x1869685723653120:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.849113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783074227.849159:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723653120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783074227.849296:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074227.849360:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723652992 00000100:00100000:1.0:1783074227.849365:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723652992 00000100:00100000:1.0:1783074227.849492:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1783074227.849502:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723652992:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783074227.849531:0:68632:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016e07fc 00000100:00080000:1.0:1783074227.849545:0:68632:0:(import.c:65:import_set_state_nolock()) ffff9524c2b7b000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783074227.849578:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074227.849607:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+1:3657:x1869685723652992:12345-0@lo:39:umount.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074227.849615:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000020:00000080:1.0:1783074227.849625:0:68632:0:(genops.c:906:class_export_put()) final put ffff9524c2b79000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:1.0:1783074227.849708:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1704000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783074227.849718:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723652992:0@lo:39:umount.0 00000020:00000080:1.0:1783074227.849739:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c2b79000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783074227.849781:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c2b7b000 for lustre-MDT0000 00000100:00080000:1.0:1783074227.849808:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783074227.849818:0:95900:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783074227.849835:0:95900:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074227.849839:0:95900:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783074227.851230:0:95900:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783074227.851236:0:95900:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783074227.851241:0:95900:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783074227.851258:0:95900:0:(import.c:65:import_set_state_nolock()) ffff9523c1eff000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783074227.851584:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869685723653248:0@lo:39:umount.0 00000100:00100000:1.0:1783074227.851638:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074227.852240:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653248 00000100:00100000:0.0:1783074227.852248:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653248 00000100:00100000:0.0:1783074227.852392:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1783074227.852403:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1869685723653248:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783074227.852429:0:66201:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016da07d 00000100:00080000:0.0:1783074227.852437:0:66201:0:(import.c:65:import_set_state_nolock()) ffff9524f41ac000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783074227.852503:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3657:x1869685723653248:12345-0@lo:39:umount.0 Request processed in 101us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074227.852511:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000020:00000080:0.0:1783074227.852522:0:66201:0:(genops.c:906:class_export_put()) final put ffff9524c6ca8800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:0.0:1783074227.852543:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783074227.852669:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1783074227.852686:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9524c6ca8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:0.0:1783074227.852706:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1eff000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783074227.852720:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869685723653248:0@lo:39:umount.0 00000100:00080000:0.0:1783074227.852746:0:95900:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000020:00000080:1.0:1783074227.852750:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524f41ac000 for lustre-MDT0001 00000100:00100000:0.0:1783074227.852750:0:95900:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783074227.852757:0:95900:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783074227.854662:0:95900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.854692:0:95900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.854700:0:95900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.854933:0:95900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.854956:0:95900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783074227.854964:0:95900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.854982:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783074227.854982:0:95900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.854993:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855003:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524fb670400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1783074227.855007:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855017:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783074227.855024:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074227.855030:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783074227.855033:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1783074227.855060:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855067:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074227.855089:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855097:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524fb670400/0x5fb609b3016e0bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e0be5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855109:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074227.855111:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783074227.855119:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074227.855134:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723653376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074227.855188:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783074227.855242:0:95900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.855244:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653376 00000100:00100000:2.0:1783074227.855252:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653376 00010000:00010000:0.0:1783074227.855254:0:95900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.855270:0:95900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783074227.855274:0:95900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1783074227.855280:0:95900:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1783074227.855337:0:46245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074227.855345:0:46245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.855354:0:46245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074227.855358:0:46245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783074227.855360:0:95900:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783074227.855366:0:95900:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:1.0:1783074227.855369:0:46245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783074227.855372:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:1.0:1783074227.855380:0:46245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:0.0:1783074227.855381:0:95900:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00000100:00100000:2.0:1783074227.855383:0:19658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1783074227.855394:0:19658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+23:3658:x1869685723653376:12345-0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1783074227.855400:0:46245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783074227.855404:0:46245:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783074227.855407:0:46245:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783074227.855412:0:19658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783074227.855425:0:46245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855427:0:19658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524e4144600/0x5fb609b3016e0be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e0bde expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.855441:0:46245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783074227.855449:0:19658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783074227.855461:0:46245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074227.855469:0:46245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524edcc6800/0x5fb609b3016e07af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb609b3016e07b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074227.855481:0:19658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c53f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3658:x1869685723653376:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (291us total) trans 0 rc 0/0 00010000:00010000:1.0:1783074227.855481:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074227.855485:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074227.855488:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074227.855492:0:19658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783074227.855500:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723653504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074227.855531:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074227.855567:0:7930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653504 00000100:00100000:2.0:1783074227.855572:0:7930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653504 00000100:00100000:1.0:1783074227.855583:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723653376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783074227.855603:0:7930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1783074227.855611:0:7930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3659:x1869685723653504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074227.855618:0:7930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783074227.855627:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524df28e200/0x5fb609b3016e07b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb609b3016e07af expref: 22 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074227.855635:0:7930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783074227.855672:0:7930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3659:x1869685723653504:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074227.855678:0:7930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783074227.855710:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:522b6a34-04f4-4017-ab45-61a21d19bfef:3659:1869685723653504:0@lo:103:ldlm_bl.0 00002000:00000080:0.0:1783074227.857942:0:95900:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1783074227.857985:0:95900:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:1.0:1783074227.858586:0:8438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968780 is committed 00000020:00000080:0.0:1783074227.858672:0:95900:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1783074227.858682:0:95900:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9523c316d000 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 192.168.204.26@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294968780 stale:0 00000020:00080000:0.0:1783074227.858689:0:95900:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9524ee2c7800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968736 stale:0 00000020:00080000:0.0:1783074227.858693:0:95900:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9523c4e7f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968718 stale:0 00000020:00080000:0.0:1783074227.858698:0:95900:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff9524c4413380) has exports, disconnecting them 00000020:00080000:0.0:1783074227.858703:0:95900:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.26@tcp (ffff9523c316d000), last request at 1783074227 00000020:00000080:0.0:1783074227.858710:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016e0842 00000020:00010000:0.0:1783074227.858719:0:95900:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9523c316d000: total 0 00000100:00080000:0.0:1783074227.858724:0:95900:0:(import.c:65:import_set_state_nolock()) ffff9524c4404800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783074227.858752:0:95900:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.26@tcp (ffff9523c316d000): rc 0 00000020:00080000:0.0:1783074227.858756:0:95900:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9524ee2c7800), last request at 1783074224 00000020:00000080:0.0:1783074227.858759:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016e06ba 00000100:00080000:0.0:1783074227.858763:0:95900:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1783074227.858780:0:6517:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9523c316d000: total 0 00010000:00010000:2.0:1783074227.858885:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074227.858949:0:6517:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9523c316d000, canceled 0 locks, left on hash table 20. 00002000:00010000:0.0:1783074227.859179:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859184:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859206:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a1aa18e/0x5fb609b3016e12a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b575 expref: 21 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859231:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859233:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859241:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079f1decf/0x5fb609b3016e1420 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5f3 expref: 20 pid: 26173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859272:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859274:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859282:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b7a80be/0x5fb609b3016e14c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b632 expref: 19 pid: 26175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859297:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859299:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859306:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000175e3593/0x5fb609b3016e1156 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b505 expref: 18 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859440:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859442:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859451:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004145a6db/0x5fb609b3016e121a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b544 expref: 17 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859465:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859467:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859472:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c5adb1/0x5fb609b3016e12ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b583 expref: 16 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859486:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859488:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859494:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027c044f8/0x5fb609b3016e138d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5c2 expref: 15 pid: 26171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859592:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859596:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859606:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003692f3b1/0x5fb609b3016e144a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b601 expref: 14 pid: 26176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859622:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859624:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859631:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea10fd93/0x5fb609b3016e1172 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b513 expref: 13 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859645:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859648:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859654:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000815c28fc/0x5fb609b3016e1515 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b64e expref: 12 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859671:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859673:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859683:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf73f23/0x5fb609b3016e11e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b52f expref: 11 pid: 26170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859699:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859702:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859712:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87b7577/0x5fb609b3016e15af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b67f expref: 10 pid: 26178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859744:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859747:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859758:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b86bf32b/0x5fb609b3016e154d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b65c expref: 9 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859777:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859780:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859787:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1f2779/0x5fb609b3016e1355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5ad expref: 8 pid: 26177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.859904:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.859907:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.859916:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f15081/0x5fb609b3016e1577 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b66a expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.860000:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.860003:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.860013:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037696079/0x5fb609b3016e15a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b678 expref: 6 pid: 26174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.860029:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.860031:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.860038:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d1d991/0x5fb609b3016e1252 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b559 expref: 5 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.860064:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.860067:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.860074:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4c8955/0x5fb609b3016e12ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b598 expref: 4 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.860087:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.860089:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.860095:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b9bf66c/0x5fb609b3016e13cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b5d7 expref: 3 pid: 17659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783074227.860108:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1783074227.860110:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783074227.860116:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc885ca3/0x5fb609b3016e1489 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b616 expref: 2 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074227.860130:0:6517:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9523c316d000, canceled 20 locks, left on hash table 0. 00000020:00080000:2.0:1783074227.860775:0:95900:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524ee2c7800): rc 0 00000020:00000080:2.0:1783074227.860779:0:95900:0:(genops.c:906:class_export_put()) final put ffff9524ee2c7800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1783074227.860786:0:95900:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9523c4e7f000), last request at 1783074224 00000020:00000080:2.0:1783074227.860792:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b3016d9ff1 00000100:00080000:2.0:1783074227.860805:0:95900:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783074227.860830:0:95900:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c4e7f000): rc 0 00000020:00000080:2.0:1783074227.860832:0:95900:0:(genops.c:906:class_export_put()) final put ffff9523c4e7f000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1783074227.860851:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783074227.860858:0:95900:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9524c4413380) has no exports 00000020:00000080:1.0:1783074227.861298:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524ee2c7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783074227.861350:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c4e7f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783074227.861370:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524ee2c5800 for lustre-OST0000 00000020:00000080:1.0:1783074227.861374:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c4e7d800 for lustre-OST0000 00000020:00000080:0.0:1783074227.862353:0:6517:0:(genops.c:906:class_export_put()) final put ffff9523c316d000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b 00010000:00010000:0.0:1783074227.862368:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074227.862370:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074227.862372:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783074227.862463:0:44310:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c316d000/0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b for lustre-OST0000 00000020:00000080:3.0:1783074227.862514:0:44310:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9524c4404800 for lustre-OST0000 00000020:01000000:2.0:1783074227.863041:0:95900:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c169ac00 - data ffff9524dfb23360/ffff9523c20c6800 00000020:01000000:2.0:1783074227.863135:0:95900:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9523c1e16de0 - data ffff9524df9ab948/ffff9523c1d6ac00 00100000:10000000:0.0:1783074227.883080:0:95900:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783074227.889792:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b301699e71 00000020:00000080:3.0:1783074227.889803:0:95900:0:(genops.c:906:class_export_put()) final put ffff9523c1706800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783074227.889831:0:95900:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9524f4a91000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783074227.889834:0:95900:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f4a91000 2 00000020:01000004:3.0:1783074227.889837:0:95900:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9524f4a91000 from lustre-OST0000 00000020:00000080:3.0:1783074227.889859:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074227.889871:0:95900:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783074227.889874:0:95900:0:(genops.c:906:class_export_put()) final put ffff9524fda9b800/lustre-OST0000_UUID 00000020:00000080:3.0:1783074227.889876:0:95900:0:(genops.c:865:class_export_destroy()) destroying export ffff9524fda9b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783074227.889883:0:95900:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783074227.889928:0:95900:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1783074227.889940:0:95900:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783074227.889943:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783074227.889949:0:95900:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783074227.889956:0:95900:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9524d2ca6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783074227.889961:0:95900:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9524c4414d40) has exports, disconnecting them 00000020:00080000:3.0:1783074227.889965:0:95900:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9524d2ca6800), last request at 1783071341 00000020:00000080:3.0:1783074227.889969:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b301699e9b 00000020:00080000:3.0:1783074227.889978:0:95900:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9524d2ca6800): rc 0 00000020:00000080:3.0:1783074227.889982:0:95900:0:(genops.c:906:class_export_put()) final put ffff9524d2ca6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783074227.890132:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c1706800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783074227.890140:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783074227.891002:0:95900:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783074227.891008:0:95900:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783074227.891013:0:95900:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783074227.891018:0:95900:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783074227.891147:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783074227.891154:0:95900:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783074227.891158:0:95900:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783074227.891161:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783074227.891165:0:95900:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783074227.891170:0:95900:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9523c1efa800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783074227.891175:0:95900:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9524f3da19c0) has exports, disconnecting them 00000020:00080000:2.0:1783074227.891178:0:95900:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9523c1efa800), last request at 1783071341 00000020:00000080:2.0:1783074227.891181:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b301699ea9 00000020:00080000:2.0:1783074227.891192:0:95900:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9523c1efa800): rc 0 00000020:00000080:2.0:1783074227.891196:0:95900:0:(genops.c:906:class_export_put()) final put ffff9523c1efa800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783074227.891214:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c1704000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783074227.891219:0:53092:0:(genops.c:906:class_export_put()) final put ffff9523c1704800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783074227.891222:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c1704800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783074227.891226:0:53092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783074227.894385:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9523c1efa800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783074227.895380:0:95900:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783074227.895386:0:95900:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783074227.895391:0:95900:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783074227.895397:0:95900:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783074227.895425:0:53092:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9523c1eff000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783074227.895550:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783074227.895560:0:95900:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783074227.895569:0:95900:0:(genops.c:906:class_export_put()) final put ffff9524d2ca1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783074227.895571:0:95900:0:(genops.c:865:class_export_destroy()) destroying export ffff9524d2ca1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783074227.895576:0:95900:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783074227.895654:0:95900:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9524f4a91000 1 00000020:00000080:1.0:1783074227.895658:0:95900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5fb609b301699e39 00000020:00000080:1.0:1783074227.895663:0:95900:0:(genops.c:906:class_export_put()) final put ffff9524f4942800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783074227.895670:0:95900:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783074227.895676:0:53092:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f4942800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783074227.895682:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783074227.895687:0:95900:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783074227.895690:0:95900:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9524c4410000) has no exports 00000020:00000080:3.0:1783074227.918207:0:95900:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783074227.918225:0:95900:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783074227.918230:0:95900:0:(genops.c:906:class_export_put()) final put ffff9524f4a93000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783074227.918235:0:95900:0:(genops.c:865:class_export_destroy()) destroying export ffff9524f4a93000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783074227.918244:0:95900:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783074227.918411:0:95900:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9524f4a90000 00000020:02000400:3.0:1783074227.918466:0:95900:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783074228.846904:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074229.166486:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723653632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074229.166574:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.166583:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723653888:0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.166642:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723654144:0@lo:400:kworker.0 00000100:00100000:1.0:1783074229.166784:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723654016:0@lo:400:kworker.0 00000100:00100000:0.0:1783074229.166832:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723653760:0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.167041:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074229.167069:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723654656:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167074:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.167102:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723654400:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167138:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.167158:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723654912:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167179:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.167210:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653632 00000100:00100000:2.0:1783074229.167216:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653632 00000100:00100000:3.0:1783074229.167239:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.167262:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654144 00000100:00100000:3.0:1783074229.167267:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524c6cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723655168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074229.167267:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654144 00000100:00100000:2.0:1783074229.167288:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654656 00000100:00100000:2.0:1783074229.167292:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654656 00000100:00100000:3.0:1783074229.167306:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.167333:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1783074229.167343:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723653632:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074229.167366:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655168 00000100:00100000:3.0:1783074229.167369:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655168 00000004:00000024:2.0:1783074229.167371:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444683776 avail 1298444288 00000100:00100000:3.0:1783074229.167387:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1783074229.167393:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723654144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167413:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1869685723653632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074229.167418:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1783074229.167435:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:3.0:1783074229.167440:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723654144:12345-0@lo:400:kworker.0 Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074229.167443:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723654656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.167451:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1783074229.167467:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1783074229.167474:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723655168:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074229.167481:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1869685723654656:12345-0@lo:400:kworker.0 Request processed in 39us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074229.167489:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000004:00000024:3.0:1783074229.167490:0:8453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:2.0:1783074229.167514:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653888 00000100:00100000:3.0:1783074229.167519:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723655168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074229.167520:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653888 00000100:00100000:3.0:1783074229.167526:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1783074229.167573:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1783074229.167580:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723653888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167602:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723653888:12345-0@lo:400:kworker.0 Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074229.167606:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1783074229.167626:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654400 00000100:00100000:2.0:1783074229.167628:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654400 00000100:00100000:2.0:1783074229.167652:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654912 00000100:00100000:2.0:1783074229.167655:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654912 00000100:00100000:2.0:1783074229.167677:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:2.0:1783074229.167683:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723654400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167716:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723654400:12345-0@lo:400:kworker.0 Request processed in 33us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074229.167719:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:2.0:1783074229.167728:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1783074229.167731:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723654912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074229.167763:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783074229.167768:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783074229.167778:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723654912:12345-0@lo:400:kworker.0 Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074229.167787:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:2.0:1783074229.167787:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723655424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783074229.167832:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.167869:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723653888:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167884:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723654400:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167893:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723654912:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.167920:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655424 00000100:00100000:2.0:1783074229.167923:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655424 00000100:00100000:2.0:1783074229.167963:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1783074229.167968:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3658:x1869685723655424:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1783074229.167974:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783074229.168015:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3658:x1869685723655424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (181us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783074229.168024:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.168028:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:02020000:3.0:1783074229.168029:0:3658:0:(client.c:1491:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1783074229.168034:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783074229.168039:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783074229.168042:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1783074229.168051:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1783074229.168054:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074229.168057:0:3658:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3042 00000100:00080000:3.0:1783074229.168063:0:3658:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9523c6a63800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1783074229.168063:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723653760 00000100:00100000:2.0:1783074229.168069:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723653760 00000100:00100000:0.0:1783074229.168069:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723654272:0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.168082:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc496d80 x1869685723655552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074229.168101:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783074229.168118:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723653760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074229.168128:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074229.168134:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074229.168148:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723655552:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1783074229.168154:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723654528:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.168161:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3661:x1869685723653760:12345-0@lo:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074229.168164:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1869685723654784:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.168172:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783074229.168182:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723655296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074229.168194:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074229.168197:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074229.168210:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.168223:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524c6cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723655168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783074229.168241:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723654144:0@lo:400:kworker.0 00000100:00100000:1.0:1783074229.168247:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723655040:0@lo:400:kworker.0 00000100:00100000:0.0:1783074229.168254:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723653760:0@lo:400:kworker.0 00000100:00100000:2.0:1783074229.168259:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723654656:0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.168261:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654272 00000100:00100000:3.0:1783074229.168267:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654272 00000100:00100000:1.0:1783074229.168275:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.168278:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c53f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723653632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783074229.168367:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655552 00000100:00100000:3.0:1783074229.168370:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655552 00000100:00100000:0.0:1783074229.168427:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654016 00000100:00100000:0.0:1783074229.168431:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654016 00000100:00100000:0.0:1783074229.168455:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723654528 00000100:00100000:0.0:1783074229.168457:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723654528 00000100:00100000:0.0:1783074229.168468:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655040 00000100:00100000:0.0:1783074229.168471:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655040 00000100:00100000:0.0:1783074229.168483:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1783074229.168490:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723654016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074229.168566:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723654016:12345-0@lo:400:kworker.0 Request processed in 77us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074229.168571:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1783074229.168581:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1783074229.168585:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723654528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074229.168603:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869685723654528:12345-0@lo:400:kworker.0 Request processed in 18us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074229.168608:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1783074229.168612:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009 00000100:00100000:0.0:1783074229.168622:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1783074229.168629:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.168634:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3661:x1869685723654272:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783074229.168634:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783074229.168641:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010 00000020:00080000:3.0:1783074229.168646:0:8443:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783074229.168653:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3657:x1869685723655552:12345-0@lo:8:ptlrpcd_00_00.0 00000100:00100000:0.0:1783074229.168653:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869685723655040:12345-0@lo:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074229.168669:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00010000:00020000:1.0:1783074229.168677:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783074229.168691:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655296 00000100:00100000:0.0:1783074229.168695:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655296 00000100:00100000:3.0:1783074229.168699:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3661:x1869685723654272:12345-0@lo:400:kworker.0 Request processed in 67us (565us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783074229.168707:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009 00000100:00100000:0.0:1783074229.168714:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:0.0:1783074229.168719:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723655296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074229.168735:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074229.168738:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3657:x1869685723655552:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 86us (544us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783074229.168747:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010 00000100:00080000:3.0:1783074229.168764:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783074229.168765:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723655296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (555us total) trans 0 rc 0/0 00000100:00080000:3.0:1783074229.168770:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1783074229.168775:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:02000400:3.0:1783074229.168778:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783074229.168786:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000004:00080000:3.0:1783074229.168791:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1783074229.168793:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00080000:3.0:1783074229.168807:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783074229.168814:0:3661:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2443 00000100:00100000:1.0:1783074229.168816:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723655552:0@lo:8:ptlrpcd_00_00.0 00000100:00080000:3.0:1783074229.168823:0:3661:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9523c1efd800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1783074229.168825:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723654016:0@lo:400:kworker.0 00000100:00100000:0.0:1783074229.168839:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869685723654528:0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.168850:0:3661:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc496a00 x1869685723655680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074229.168872:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723654272:0@lo:400:kworker.0 00000100:00100000:3.0:1783074229.168896:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723655296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783074229.168903:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df76bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869685723655040:0@lo:400:kworker.0 00000100:00100000:1.0:1783074229.168957:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723655680:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1783074229.168983:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074229.169110:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655680 00000100:00100000:3.0:1783074229.169120:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655680 00000100:00100000:3.0:1783074229.169145:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5011 00000100:00100000:3.0:1783074229.169150:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3657:x1869685723655680:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:3.0:1783074229.169161:0:26174:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783074229.169559:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783074229.169564:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783074229.169567:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723655680:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:3.0:1783074229.169582:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3657:x1869685723655680:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 429us (596us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783074229.169590:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5011 00000100:00100000:0.0:1783074229.680278:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723655808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783074229.680364:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074229.680680:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655808 00000100:00100000:2.0:1783074229.680687:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655808 00000100:00100000:2.0:1783074229.680735:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:2.0:1783074229.680746:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723655808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783074229.680770:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783074229.680829:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869685723655808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074229.680836:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:2.0:1783074229.680890:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723655808:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1783074229.688688:0:94271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051730 is committed 00010000:00010000:1.0:1783074229.688866:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688884:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688892:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688897:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.688909:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688918:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688934:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff952502077300) 00010000:00010000:1.0:1783074229.688938:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.688942:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688948:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24e00/0x5fb609b3016e1061 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688980:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688987:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688992:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.688998:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689000:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689007:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689156:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4bbd12da (ffff952502077300) 00010000:00010000:1.0:1783074229.689160:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689170:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689176:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24a00/0x5fb609b3016e1099 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4bbd12da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689198:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689206:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689212:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689217:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689220:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689226:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689233:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9524e0374e00) 00010000:00010000:1.0:1783074229.689234:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689236:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689241:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25c00/0x5fb609b3016e1148 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689429:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689445:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689451:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689456:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0869800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689459:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689465:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689473:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9524e3aa5800) 00010000:00010000:1.0:1783074229.689475:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689479:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689484:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0869800/0x5fb609b3016e115d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689500:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689507:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689512:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689517:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689527:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689533:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689542:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9524f44ee200) 00010000:00010000:1.0:1783074229.689544:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689547:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689552:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7a00/0x5fb609b3016e11b1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689570:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689577:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689583:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689588:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b25a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689591:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689597:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689604:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9524f44ee700) 00010000:00010000:1.0:1783074229.689607:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689616:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689622:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b25a00/0x5fb609b3016e11e9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689637:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689643:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689649:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689654:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689657:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689663:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689672:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9524f44ee500) 00010000:00010000:1.0:1783074229.689674:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689676:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689682:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc600/0x5fb609b3016e1213 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689693:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689699:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689710:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689780:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc6400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689784:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689801:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689809:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9524f44ee900) 00010000:00010000:1.0:1783074229.689811:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689813:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689819:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc6400/0x5fb609b3016e128a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689833:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689839:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689844:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689849:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524edcc7000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689852:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689867:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689875:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9524f44ee600) 00010000:00010000:1.0:1783074229.689877:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689880:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689886:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524edcc7000/0x5fb609b3016e1298 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689898:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689904:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689909:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689914:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689916:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689922:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689928:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9524d30b3500) 00010000:00010000:1.0:1783074229.689931:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.689933:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689947:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868800/0x5fb609b3016e12d0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689961:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689967:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689973:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689978:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bce00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.689981:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689987:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.689995:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9524d0b7de00) 00010000:00010000:1.0:1783074229.689998:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690001:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690006:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bce00/0x5fb609b3016e1324 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690022:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690028:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690040:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690045:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151bc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690048:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690053:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690061:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9524d30b3c00) 00010000:00010000:1.0:1783074229.690063:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690066:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690072:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151bc00/0x5fb609b3016e134e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690087:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690092:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690097:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690102:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c151b200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690105:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690121:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690131:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9524d0b7d300) 00010000:00010000:1.0:1783074229.690134:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690137:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690141:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c151b200/0x5fb609b3016e1394 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690193:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690200:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690206:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690211:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bd400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690215:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690222:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690231:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9524d0b7d000) 00010000:00010000:1.0:1783074229.690234:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690236:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690515:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bd400/0x5fb609b3016e13ef lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690528:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690534:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690541:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690546:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524c4b24000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690549:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690556:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690566:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9524d0b7d200) 00010000:00010000:1.0:1783074229.690569:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690572:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690577:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524c4b24000/0x5fb609b3016e1419 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690588:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690595:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690607:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690612:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690615:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690621:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690634:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9524d0b7d800) 00010000:00010000:1.0:1783074229.690636:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690639:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690646:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524df2c9c00/0x5fb609b3016e147b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690659:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690666:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690673:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690678:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690682:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690697:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690707:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9524d0b7da00) 00010000:00010000:1.0:1783074229.690709:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690712:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690718:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868c00/0x5fb609b3016e14c1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690731:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690738:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690743:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690748:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0868200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690750:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690756:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690763:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9524d0b7d500) 00010000:00010000:1.0:1783074229.690765:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690768:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690784:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0868200/0x5fb609b3016e14e4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690810:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690815:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690820:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690824:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523c69bc800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690827:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690831:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690838:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9524d2de4b00) 00010000:00010000:1.0:1783074229.690840:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690843:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690847:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523c69bc800/0x5fb609b3016e153f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690855:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690861:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690871:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690875:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524f0d84c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690877:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690882:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690889:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9524d2de4300) 00010000:00010000:1.0:1783074229.690890:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690893:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690898:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9524f0d84c00/0x5fb609b3016e1546 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690908:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690914:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690920:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690924:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523cb0ea800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690927:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690942:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690951:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9524d2de4e00) 00010000:00010000:1.0:1783074229.690954:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.690957:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690964:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9523cb0ea800/0x5fb609b3016e159a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690977:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690981:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690987:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.690993:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9525021dbe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1783074229.690995:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.691002:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.691009:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9524d2de4a00) 00010000:00010000:1.0:1783074229.691011:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783074229.691014:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074229.691031:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9525021dbe00/0x5fb609b3016e15a1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074229.870443:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783074230.825221:0:96245:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:3.0:1783074230.894463:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783074231.918509:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1783074232.303264:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0236c50 x1869685708159104 msgsize 224 00000100:00100000:1.0:1783074232.303280:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074232.303282:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783074232.303358:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf6680 x1869685708159360 msgsize 224 00000100:00100000:3.0:1783074232.303364:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159104 00000100:00100000:1.0:1783074232.303366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074232.303383:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159104 00000020:00000040:3.0:1783074232.303388:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e07d9 00000020:00000040:3.0:1783074232.303394:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524df202800 refcount=10 00000100:00000040:1.0:1783074232.303396:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf7480 x1869685708159232 msgsize 224 00000100:00100000:1.0:1783074232.303404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074232.303406:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159360 00000100:00100000:0.0:1783074232.303413:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159360 00000020:00000040:0.0:1783074232.303416:0:66200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016dfc80 00000100:00000040:3.0:1783074232.303419:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000040:0.0:1783074232.303420:0:66200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7816800 refcount=11 00000100:00000040:1.0:1783074232.303433:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf4700 x1869685708159616 msgsize 224 00000100:00100000:1.0:1783074232.303441:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000020:00000040:0.0:1783074232.303443:0:66200:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 10 - evictor 00000100:00000040:0.0:1783074232.303467:0:66200:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1783074232.303473:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc6c4850 x1869685708159488 msgsize 224 00000100:00100000:1.0:1783074232.303480:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074232.303482:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1783074232.303499:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159232 00000100:00100000:0.0:1783074232.303503:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159232 00000020:00000040:0.0:1783074232.303505:0:66200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0666 00000020:00000040:0.0:1783074232.303508:0:66200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc200000 refcount=51 00000020:00000040:0.0:1783074232.303515:0:66200:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 14 - evictor 00000100:00100000:3.0:1783074232.303526:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00000040:3.0:1783074232.303533:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524df202800 : new rpc_count 1 00000100:00000040:3.0:1783074232.303543:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0236c50 x1869685708159104/t0(0) o400->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:558/0 lens 224/0 e 0 to 0 dl 1783074243 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.303552:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 912 00000100:00000040:0.0:1783074232.303556:0:66200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7816800 : new rpc_count 1 00000100:00000040:0.0:1783074232.303565:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf6680 x1869685708159360/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:558/0 lens 224/0 e 0 to 0 dl 1783074243 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074232.303577:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2403:x1869685708159104:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074232.303584:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2403:x1869685708159360:12345-192.168.204.26@tcp:400:kworker.0 00010000:00000040:3.0:1783074232.303600:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685708159104 00010000:00000040:0.0:1783074232.303601:0:66200:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 77309411475, transno 0, xid 1869685708159360 00000100:00000040:0.0:1783074232.303610:0:66200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074232.303612:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.303617:0:66200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074232.303622:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074232.303658:0:66200:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074232.303660:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.303668:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf6680 x1869685708159360/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:558/0 lens 224/224 e 0 to 0 dl 1783074243 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074232.303670:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0236c50 x1869685708159104/t0(0) o400->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:558/0 lens 224/224 e 0 to 0 dl 1783074243 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.303697:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2403:x1869685708159360:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 117us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074232.303713:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 912 00000100:00000040:0.0:1783074232.303718:0:66200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7816800 : new rpc_count 0 00000100:00100000:3.0:1783074232.303719:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2403:x1869685708159104:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 144us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074232.303730:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 171 00000020:00000040:0.0:1783074232.303731:0:66200:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7816800 : new refcount 10 00000100:00000040:3.0:1783074232.303733:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524df202800 : new rpc_count 0 00000020:00000040:3.0:1783074232.303757:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524df202800 : new refcount 9 00000100:00100000:0.0:1783074232.303758:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 913 00000100:00000040:0.0:1783074232.303763:0:66200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc200000 : new rpc_count 1 00000100:00000040:0.0:1783074232.303767:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf7480 x1869685708159232/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:558/0 lens 224/0 e 0 to 0 dl 1783074243 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.303780:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+51:2402:x1869685708159232:12345-192.168.204.26@tcp:400:kworker.0 00010000:00000040:0.0:1783074232.303795:0:66200:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1869685708159232 00000100:00000040:0.0:1783074232.303800:0:66200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.303804:0:66200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074232.303820:0:66200:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.303831:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf7480 x1869685708159232/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:558/0 lens 224/224 e 0 to 0 dl 1783074243 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.303840:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+51:2402:x1869685708159232:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 64us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074232.303847:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 913 00000100:00000040:0.0:1783074232.303850:0:66200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc200000 : new rpc_count 0 00000020:00000040:0.0:1783074232.303856:0:66200:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc200000 : new refcount 50 00000100:00080000:0.0:1783074232.303882:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783074232.303886:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9524fb4d8000) now 14 - evictor 00000100:00080000:0.0:1783074232.303890:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783074232.303891:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9524fab73380) now 10 - evictor 00000100:00100000:0.0:1783074232.303907:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159616 00000100:00100000:0.0:1783074232.303910:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159616 00000020:00000040:0.0:1783074232.303912:0:17659:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0849 00000020:00000040:0.0:1783074232.303915:0:17659:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fb6b3800 refcount=7 00000020:00000040:0.0:1783074232.303924:0:17659:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9523c2c30000) now 10 - evictor 00000100:00000040:0.0:1783074232.303940:0:17659:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1783074232.303955:0:17659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159488 00000100:00100000:0.0:1783074232.303958:0:17659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159488 00000020:00000040:0.0:1783074232.303960:0:17659:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0842 00000100:00100000:0.0:1783074232.303984:0:17659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2215 00000100:00000040:0.0:1783074232.303988:0:17659:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fb6b3800 : new rpc_count 1 00000100:00000040:0.0:1783074232.303992:0:17659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf4700 x1869685708159616/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:558/0 lens 224/0 e 0 to 0 dl 1783074243 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.304004:0:17659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2403:x1869685708159616:12345-192.168.204.26@tcp:400:kworker.0 00010000:00000040:0.0:1783074232.304014:0:17659:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685708159616 00000100:00000040:0.0:1783074232.304020:0:17659:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.304024:0:17659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074232.304052:0:17659:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.304059:0:17659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4700 x1869685708159616/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:558/0 lens 224/224 e 0 to 0 dl 1783074243 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.304068:0:17659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2403:x1869685708159616:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 67us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074232.304104:0:26178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5012 00000100:00000040:1.0:1783074232.304111:0:26178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc6c4850 x1869685708159488/t0(0) o400->@:558/0 lens 224/0 e 0 to 0 dl 1783074243 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.304111:0:17659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2215 00000100:00000040:0.0:1783074232.304116:0:17659:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fb6b3800 : new rpc_count 0 00000020:00000040:0.0:1783074232.304124:0:17659:0:(genops.c:900:class_export_put()) PUTting export ffff9524fb6b3800 : new refcount 6 00000100:00100000:1.0:1783074232.304130:0:26178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2402:x1869685708159488:12345-192.168.204.26@tcp:400:kworker.0 00000020:00080000:1.0:1783074232.304138:0:26178:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074232.304150:0:26178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074232.304153:0:26178:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074232.304157:0:26178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074232.304171:0:26178:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074232.304175:0:26178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc6c4850 x1869685708159488/t0(0) o400->@:558/0 lens 224/224 e 0 to 0 dl 1783074243 ref 1 fl Interpret:/200/0 rc -107/-107 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783074232.304212:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1783074232.304216:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9523c2c30000) now 10 - evictor 00000100:00100000:1.0:1783074232.304361:0:26178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2402:x1869685708159488:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 58us (710us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783074232.304376:0:26178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5012 00000100:00000040:3.0:1783074232.307478:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc497b80 x1869685708159744 msgsize 520 00000100:00100000:3.0:1783074232.307492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074232.307702:0:26173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159744 00000100:00100000:0.0:1783074232.307711:0:26173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159744 00000020:00000040:0.0:1783074232.307713:0:26173:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0842 00000100:00100000:0.0:1783074232.307767:0:26173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5013 00000100:00000040:0.0:1783074232.307775:0:26173:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc497b80 x1869685708159744/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074252 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.307784:0:26173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2401:x1869685708159744:12345-192.168.204.26@tcp:8:ptlrpcd_00_00.0 00010000:00020000:0.0:1783074232.307803:0:26173:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.26@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1783074232.307819:0:26173:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.307821:0:26173:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.307825:0:26173:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074232.307882:0:26173:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074232.307888:0:26173:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc497b80 x1869685708159744/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783074252 ref 1 fl Interpret:/200/0 rc -19/-19 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074232.307898:0:26173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2401:x1869685708159744:12345-192.168.204.26@tcp:8:ptlrpcd_00_00.0 Request processed in 113us (420us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783074232.307906:0:26173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5013 00010000:00010000:1.0:1783074232.942522:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783074233.968798:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1783074234.287395:0:94290:0:(genops.c:1231:class_import_get()) import ffff9524c7838000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1783074234.287435:0:94290:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e629cfd9] to pc [ptlrpcd_00_02+2] req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.287625:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1783074234.287639:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.287679:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723655936:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783074234.287716:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.287724:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.287762:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4ae9f80 x1869685723655936 msgsize 224 00000100:00100000:0.0:1783074234.287767:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074234.287792:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.287797:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723655936 00000100:00100000:1.0:1783074234.287807:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723655936 00000100:00000040:0.0:1783074234.287807:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 4031 usecs (5 jiffies) 00000020:00000040:1.0:1783074234.287811:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06cf 00000020:00000040:1.0:1783074234.287816:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c6e2d800 refcount=5 00000020:00000040:1.0:1783074234.287829:0:8446:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9523c2c30000) now 10 - evictor 00000100:00000040:1.0:1783074234.287856:0:8446:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1783074234.287880:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00000040:1.0:1783074234.287884:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524c6e2d800 : new rpc_count 1 00000100:00000040:1.0:1783074234.287889:0:8446:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4ae9f80 x1869685723655936/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.287903:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723655936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783074234.287930:0:8446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:1.0:1783074234.287939:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968716, transno 0, xid 1869685723655936 00000100:00000040:1.0:1783074234.287947:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:1.0:1783074234.287951:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074234.287968:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074234.287992:0:8446:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074234.287997:0:8446:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae9f80 x1869685723655936/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.288006:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723655936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074234.288012:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00000040:1.0:1783074234.288015:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524c6e2d800 : new rpc_count 0 00000020:00000040:1.0:1783074234.288025:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff9524c6e2d800 : new refcount 4 00000100:00000040:0.0:1783074234.288028:0:3661:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968716 00000100:00000040:0.0:1783074234.288037:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783074234.288047:0:3661:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1783074234.288051:0:3661:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1783074234.288059:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.288066:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723655936:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783074234.288072:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc494e00 x1869685723655936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.288083:0:3661:0:(genops.c:1244:class_import_put()) import ffff9524c7838000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783074234.288122:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783074234.288130:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:0.0:1783074234.288140:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 522b6a34-04f4-4017-ab45-61a21d19bfef->MGS req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074234.288164:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f02f8880] to pc [ptlrpcd_00_03+3] req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288179:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783074234.288185:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c2e07000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783074234.288194:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074234.288203:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005bf272d1] to pc [ptlrpcd_00_00+0] req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.288208:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1783074234.288220:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783074234.288222:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.288229:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524f778d800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:2.0:1783074234.288239:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723656064:0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.288243:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074234.288252:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006507ce43] to pc [ptlrpcd_00_01+1] req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288261:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288261:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783074234.288271:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524f0d24800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783074234.288281:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074234.288293:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.288298:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ec5e7de2] to pc [ptlrpcd_00_02+2] req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074234.288307:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074234.288334:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783074234.288337:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074234.288349:0:53092:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3068 00000100:00080000:0.0:1783074234.288353:0:53092:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00000040:0.0:1783074234.288357:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 50 to 0@lo 00000100:00000040:0.0:1783074234.288360:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 51 to 0@lo 00000020:00000040:0.0:1783074234.288363:0:53092:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fdc 00000020:00000040:0.0:1783074234.288367:0:53092:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c32cf000 refcount=4 00000100:00000040:2.0:1783074234.288368:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0235050 x1869685723656064 msgsize 224 00000100:00000040:0.0:1783074234.288372:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 50 to 0@lo 00000100:00100000:2.0:1783074234.288379:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074234.288380:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:2.0:1783074234.288385:0:3660:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000020:00000040:0.0:1783074234.288385:0:53092:0:(genops.c:900:class_export_put()) PUTting export ffff9523c32cf000 : new refcount 3 00000100:00080000:0.0:1783074234.288391:0:53092:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9523c1efd800 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:0.0:1783074234.288402:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c1efd800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783074234.288403:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.288416:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074234.288427:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b785d941] to pc [ptlrpcd_rcv+-1] req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288434:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.288446:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723656448:0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.288447:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783074234.288454:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524f0d27800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783074234.288461:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288464:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074234.288483:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.288489:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007abed132] to pc [ptlrpcd_00_03+3] req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288499:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783074234.288501:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524f091b800 x1869685723656448 msgsize 224 00000020:00000040:0.0:1783074234.288505:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c4d13000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00100000:2.0:1783074234.288508:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074234.288516:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074234.288525:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288529:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002e31826e] to pc [ptlrpcd_00_00+0] req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288537:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2665695 usecs (2666 jiffies) 00000100:00000040:0.0:1783074234.288548:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783074234.288549:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000040:0.0:1783074234.288558:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524c6211000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783074234.288559:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288571:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074234.288572:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723656704:0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.288588:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009c824e8a] to pc [ptlrpcd_00_01+1] req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288592:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074234.288607:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783074234.288611:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:0.0:1783074234.288613:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783074234.288617:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783074234.288621:0:53092:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3068 00000100:00080000:0.0:1783074234.288624:0:53092:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:0.0:1783074234.288627:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 50 to 0@lo 00000100:00000040:2.0:1783074234.288630:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0919880 x1869685723656704 msgsize 224 00000100:00000040:0.0:1783074234.288631:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 51 to 0@lo 00000020:00000040:0.0:1783074234.288636:0:53092:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ac 00000100:00100000:2.0:1783074234.288640:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:0.0:1783074234.288641:0:53092:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c4400000 refcount=4 00000100:00000040:0.0:1783074234.288645:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 50 to 0@lo 00000100:00000040:0.0:1783074234.288648:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 51 to 0@lo 00000020:00000040:0.0:1783074234.288652:0:53092:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4400000 : new refcount 3 00000100:00000040:2.0:1783074234.288656:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074234.288669:0:53092:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9523c6a63800 using connection 192.168.204.126@tcp/0@lo 00000100:00000040:2.0:1783074234.288673:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 3078 usecs (4 jiffies) 00000020:00000040:0.0:1783074234.288678:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c6a63800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783074234.288689:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074234.288709:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ba1b479a] to pc [ptlrpcd_rcv+-1] req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.288710:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656448 00000100:00100000:2.0:1783074234.288717:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656448 00000020:00000040:2.0:1783074234.288721:0:8454:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e065f 00000100:00000040:0.0:1783074234.288721:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783074234.288724:0:8454:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc207800 refcount=7 00000020:00000040:0.0:1783074234.288734:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524de7c4800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1783074234.288742:0:8454:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:0.0:1783074234.288745:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074234.288756:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cf8f9b4e] to pc [ptlrpcd_00_02+2] req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.288763:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00000040:2.0:1783074234.288770:0:8454:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc207800 : new rpc_count 1 00000100:00000040:2.0:1783074234.288777:0:8454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f091b800 x1869685723656448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288779:0:53092:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3078) 00000100:00100000:2.0:1783074234.288793:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723656448:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.288802:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783074234.288808:0:8454:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1869685723656448 00000100:00100000:0.0:1783074234.288814:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723656320:0@lo:400:kworker.0 00000100:00000040:2.0:1783074234.288817:0:8454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.288822:0:8454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.288835:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288844:0:8454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288845:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.288862:0:8454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:2.0:1783074234.288867:0:8454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091b800 x1869685723656448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.288868:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4aeaa00 x1869685723656320 msgsize 224 00000100:00100000:0.0:1783074234.288880:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074234.288887:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723656448:12345-0@lo:400:kworker.0 Request processed in 96us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074234.288895:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00000040:0.0:1783074234.288899:0:3659:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288900:0:8454:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc207800 : new rpc_count 0 00000020:00000040:2.0:1783074234.288909:0:8454:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc207800 : new refcount 6 00000100:00000040:2.0:1783074234.288946:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.288955:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723656576:0@lo:8:kworker.0 00000100:00000040:2.0:1783074234.288975:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074249 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.288982:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.288996:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0918700 x1869685723656576 msgsize 520 00000100:00100000:2.0:1783074234.289000:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074234.289014:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074249 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289023:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2971 usecs (3 jiffies) 00000100:00000040:2.0:1783074234.289029:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289037:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723657088:0@lo:8:kworker.0 00000100:00000040:2.0:1783074234.289049:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074249 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289055:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.289064:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f091aa00 x1869685723657088 msgsize 520 00000100:00100000:2.0:1783074234.289067:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074234.289077:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074249 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289085:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 2330 usecs (3 jiffies) 00000100:00100000:2.0:1783074234.289103:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656704 00000100:00100000:2.0:1783074234.289107:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656704 00000020:00000040:2.0:1783074234.289109:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fff 00000020:00000040:2.0:1783074234.289111:0:26172:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524e010a000 refcount=5 00000100:00000040:2.0:1783074234.289124:0:26172:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783074234.289138:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656576 00000100:00100000:2.0:1783074234.289141:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656576 00000020:00000040:2.0:1783074234.289142:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9ff1 00000100:00100000:2.0:1783074234.289155:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657088 00000100:00100000:2.0:1783074234.289157:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657088 00000020:00000040:2.0:1783074234.289164:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ba 00000100:00100000:2.0:1783074234.289179:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00000040:2.0:1783074234.289181:0:26172:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524e010a000 : new rpc_count 1 00000100:00000040:2.0:1783074234.289185:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0919880 x1869685723656704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289196:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723656704:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783074234.289206:0:26172:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968702, transno 0, xid 1869685723656704 00000100:00000040:2.0:1783074234.289210:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.289213:0:26172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.289229:0:26172:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289241:0:26172:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:2.0:1783074234.289245:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0919880 x1869685723656704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289253:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723656704:12345-0@lo:400:kworker.0 Request processed in 59us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074234.289259:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00000040:2.0:1783074234.289261:0:26172:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524e010a000 : new rpc_count 0 00000020:00000040:2.0:1783074234.289267:0:26172:0:(genops.c:900:class_export_put()) PUTting export ffff9524e010a000 : new refcount 4 00000100:00100000:2.0:1783074234.289277:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5014 00000100:00000040:2.0:1783074234.289280:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0918700 x1869685723656576/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074254 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289287:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3657:x1869685723656576:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783074234.289303:0:26172:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783074234.289338:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.289342:0:26172:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.289351:0:26172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.289365:0:26172:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074249 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289380:0:26172:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:2.0:1783074234.289385:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0918700 x1869685723656576/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783074254 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289393:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3657:x1869685723656576:12345-0@lo:8:kworker.0 Request processed in 105us (396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074234.289400:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5014 00000100:00100000:2.0:1783074234.289412:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5015 00000100:00000040:2.0:1783074234.289415:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f091aa00 x1869685723657088/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074254 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289423:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3657:x1869685723657088:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783074234.289433:0:26172:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783074234.289442:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.289444:0:26172:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.289448:0:26172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.289462:0:26172:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074249 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289488:0:26172:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074234.289492:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 5735 usecs (6 jiffies) 00000100:00000040:2.0:1783074234.289493:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091aa00 x1869685723657088/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783074254 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.289504:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.289505:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3657:x1869685723657088:12345-0@lo:8:kworker.0 Request processed in 80us (438us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783074234.289520:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5015 00000100:00100000:0.0:1783074234.289524:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723656960:0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.289540:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289550:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.289550:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.289567:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092ea00 x1869685723656960 msgsize 224 00000100:00100000:0.0:1783074234.289573:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074234.289576:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723656192:0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.289592:0:3659:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289594:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.289611:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.289623:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1983 usecs (2 jiffies) 00000100:00000040:2.0:1783074234.289628:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0919500 x1869685723656192 msgsize 224 00000100:00100000:2.0:1783074234.289635:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783074234.289720:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1783074234.289726:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9523c2c30000) now 10 - evictor 00000100:00100000:3.0:1783074234.289741:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656960 00000100:00100000:3.0:1783074234.289744:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656960 00000020:00000040:3.0:1783074234.289746:0:8453:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06a5 00000020:00000040:3.0:1783074234.289750:0:8453:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7805000 refcount=5 00000020:00000040:1.0:1783074234.289759:0:75601:0:(genops.c:1231:class_import_get()) import ffff9524f0d24800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1783074234.289763:0:8453:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:1.0:1783074234.289781:0:75601:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004d2d650f] to pc [ptlrpcd_00_03+3] req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.289786:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00000040:3.0:1783074234.289792:0:8453:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7805000 : new rpc_count 1 00000100:00000040:3.0:1783074234.289800:0:8453:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092ea00 x1869685723656960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074234.289810:0:94286:0:(genops.c:1231:class_import_get()) import ffff9524c6211000 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00100000:3.0:1783074234.289814:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723656960:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1783074234.289826:0:94286:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008c06a5df] to pc [ptlrpcd_00_00+0] req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783074234.289828:0:8453:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723656960 00000100:00000040:3.0:1783074234.289834:0:8453:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00100000:0.0:1783074234.289845:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656320 00000100:00000040:3.0:1783074234.289846:0:8453:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783074234.289851:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656320 00000020:00000040:0.0:1783074234.289854:0:66201:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016da084 00000020:00000040:0.0:1783074234.289857:0:66201:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f41aa800 refcount=5 00000100:00000040:3.0:1783074234.289867:0:8453:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.289867:0:66201:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 10 - evictor 00000100:00000040:0.0:1783074234.289887:0:66201:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:3.0:1783074234.289906:0:8453:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00100000:0.0:1783074234.289907:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656192 00000100:00100000:0.0:1783074234.289912:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656192 00000100:00000040:3.0:1783074234.289913:0:8453:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092ea00 x1869685723656960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.289916:0:66201:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0803 00000020:00000040:0.0:1783074234.289920:0:66201:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fb6b7000 refcount=5 00000100:00100000:3.0:1783074234.289928:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723656960:12345-0@lo:400:kworker.0 Request processed in 118us (359us total) trans 0 rc 0/0 00000020:00000040:0.0:1783074234.289930:0:66201:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 14 - evictor 00000100:00100000:3.0:1783074234.289940:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00000040:3.0:1783074234.289943:0:8453:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7805000 : new rpc_count 0 00000020:00000040:3.0:1783074234.289952:0:8453:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7805000 : new refcount 4 00000100:00100000:0.0:1783074234.289957:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00000040:0.0:1783074234.289961:0:66201:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f41aa800 : new rpc_count 1 00000100:00000040:0.0:1783074234.289967:0:66201:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4aeaa00 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.289979:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723656320:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783074234.289990:0:66201:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723656320 00000100:00000040:0.0:1783074234.289996:0:66201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074234.290001:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290001:0:66201:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1783074234.290015:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723657344:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1783074234.290024:0:66201:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290032:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290041:0:66201:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074234.290042:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.290050:0:66201:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aeaa00 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.290059:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723656320:12345-0@lo:400:kworker.0 Request processed in 83us (1189us total) trans 0 rc 0/0 00000100:00000040:3.0:1783074234.290061:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc494380 x1869685723657344 msgsize 224 00000100:00100000:3.0:1783074234.290069:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074234.290072:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00000040:0.0:1783074234.290082:0:66201:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f41aa800 : new rpc_count 0 00000020:00000040:0.0:1783074234.290093:0:66201:0:(genops.c:900:class_export_put()) PUTting export ffff9524f41aa800 : new refcount 4 00000100:00000040:3.0:1783074234.290095:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290095:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.290106:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00000040:2.0:1783074234.290110:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 6026 usecs (7 jiffies) 00000100:00000040:0.0:1783074234.290110:0:66201:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fb6b7000 : new rpc_count 1 00000100:00000040:0.0:1783074234.290115:0:66201:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0919500 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290118:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2665695 usecs (2666 jiffies) 00000100:00000040:2.0:1783074234.290120:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.290127:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1783074234.290135:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.290153:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723656192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074234.290154:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723656832:0@lo:400:kworker.0 00000100:00100000:3.0:1783074234.290160:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723657216:0@lo:400:kworker.0 00010000:00000040:0.0:1783074234.290171:0:66201:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723656192 00000100:00100000:1.0:1783074234.290172:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656064 00000100:00000040:3.0:1783074234.290174:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290174:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.290179:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656064 00000100:00000040:0.0:1783074234.290181:0:66201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000020:00000040:1.0:1783074234.290185:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000100:00000040:0.0:1783074234.290191:0:66201:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.290193:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074234.290196:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1783074234.290196:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=21 00000100:00000040:1.0:1783074234.290217:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:2.0:1783074234.290219:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9524f091a300 x1869685723656832 msgsize 224 00000100:00000040:0.0:1783074234.290219:0:66201:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.290226:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657344 00000100:00100000:3.0:1783074234.290231:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657344 00000100:00100000:2.0:1783074234.290231:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:3.0:1783074234.290235:0:8454:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e065f 00000020:00000040:3.0:1783074234.290239:0:8454:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc207800 refcount=7 00000100:00100000:1.0:1783074234.290245:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00000040:0.0:1783074234.290249:0:66201:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074234.290250:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074234.290251:0:8454:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1783074234.290256:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290257:0:66201:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0919500 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074234.290260:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0235050 x1869685723656064/t0(0) o400->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.290272:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00000040:3.0:1783074234.290279:0:8454:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc207800 : new rpc_count 1 00000100:00000040:3.0:1783074234.290286:0:8454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc494380 x1869685723657344/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.290291:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723656192:12345-0@lo:400:kworker.0 Request processed in 142us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074234.290308:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1783074234.290332:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3660:x1869685723656064:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783074234.290334:0:66201:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fb6b7000 : new rpc_count 0 00000100:00100000:3.0:1783074234.290339:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723657344:12345-0@lo:41:osp-pre-0-1.0 00000020:00000040:0.0:1783074234.290345:0:66201:0:(genops.c:900:class_export_put()) PUTting export ffff9524fb6b7000 : new refcount 4 00010000:00000040:1.0:1783074234.290349:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723656064 00000100:00100000:0.0:1783074234.290356:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723656832 00000100:00000040:1.0:1783074234.290357:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074234.290362:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 56642 usecs (57 jiffies) 00000100:00100000:0.0:1783074234.290362:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723656832 00000004:00000024:3.0:1783074234.290366:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444683776 avail 1298444288 00000100:00000040:1.0:1783074234.290367:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1783074234.290367:0:66201:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e080a 00000020:00000040:0.0:1783074234.290373:0:66201:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316d800 refcount=5 00010000:00000040:3.0:1783074234.290378:0:8454:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1869685723657344 00000100:00000040:2.0:1783074234.290379:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290384:0:66201:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:3.0:1783074234.290385:0:8454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 53 to 0@lo 00000100:00100000:2.0:1783074234.290390:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723657472:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1783074234.290393:0:8454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783074234.290403:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00000040:2.0:1783074234.290408:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290408:0:66201:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316d800 : new rpc_count 1 00000100:00000040:1.0:1783074234.290409:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290414:0:8454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290418:0:66201:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f091a300 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290456:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783074234.290463:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723656832:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1783074234.290472:0:8454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:1.0:1783074234.290477:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00010000:00000040:0.0:1783074234.290477:0:66201:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723656832 00000100:00000040:3.0:1783074234.290481:0:8454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc494380 x1869685723657344/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290482:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0919c00 x1869685723657472 msgsize 224 00000100:00000040:1.0:1783074234.290489:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0235050 x1869685723656064/t0(0) o400->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290490:0:66201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00100000:2.0:1783074234.290491:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074234.290495:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723657344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (430us total) trans 0 rc 0/0 00000100:00000040:0.0:1783074234.290501:0:66201:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.290509:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.290511:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00000040:3.0:1783074234.290516:0:8454:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc207800 : new rpc_count 0 00000100:00100000:1.0:1783074234.290517:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+21:3660:x1869685723656064:12345-0@lo:400:kworker.0 Request processed in 206us (2143us total) trans 0 rc 0/0 00000100:00000040:2.0:1783074234.290522:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1983 usecs (2 jiffies) 00000020:00000040:3.0:1783074234.290524:0:8454:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc207800 : new refcount 6 00000100:00000040:0.0:1783074234.290527:0:66201:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.290528:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783074234.290533:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657472 00000100:00100000:3.0:1783074234.290538:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657472 00000100:00000040:2.0:1783074234.290539:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783074234.290542:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:3.0:1783074234.290547:0:8454:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06a5 00000100:00000040:2.0:1783074234.290547:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074234.290551:0:8454:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7805000 refcount=5 00000100:00000040:0.0:1783074234.290551:0:66201:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000020:00000040:1.0:1783074234.290553:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 20 00000100:00000040:0.0:1783074234.290562:0:66201:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091a300 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290563:0:8454:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1783074234.290564:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.290578:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:0.0:1783074234.290579:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723656832:12345-0@lo:400:kworker.0 Request processed in 118us (356us total) trans 0 rc 0/0 00000100:00000040:3.0:1783074234.290582:0:8454:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7805000 : new rpc_count 1 00000100:00100000:2.0:1783074234.290583:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723656192:0@lo:400:kworker.0 00000100:00000040:3.0:1783074234.290588:0:8454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0919c00 x1869685723657472/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.290595:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00000040:2.0:1783074234.290601:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783074234.290602:0:66201:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316d800 : new rpc_count 0 00000100:00100000:3.0:1783074234.290605:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723657472:12345-0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783074234.290607:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.290613:0:66201:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316d800 : new refcount 4 00000100:00000040:2.0:1783074234.290615:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000024:3.0:1783074234.290622:0:8454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:2.0:1783074234.290624:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723656832:0@lo:400:kworker.0 00010000:00000040:3.0:1783074234.290629:0:8454:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723657472 00000100:00000040:2.0:1783074234.290630:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4aebb80 x1869685723656192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290634:0:8454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074234.290638:0:8454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1783074234.290639:0:3658:0:(genops.c:1244:class_import_put()) import ffff9523c2e07000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1783074234.290648:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4ae8a80 x1869685723656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074234.290649:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:3.0:1783074234.290654:0:8454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.290656:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9524fb4d8000) now 14 - evictor 00000020:00000040:2.0:1783074234.290659:0:3658:0:(genops.c:1244:class_import_put()) import ffff9523c4d13000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00080000:0.0:1783074234.290663:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000040:1.0:1783074234.290667:0:3660:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968702 00000020:00000040:0.0:1783074234.290668:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9524fab73380) now 10 - evictor 00000100:00000040:2.0:1783074234.290677:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1783074234.290678:0:8454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074234.290678:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290686:0:8454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0919c00 x1869685723657472/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290690:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290696:0:3659:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783074234.290712:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290715:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783074234.290725:0:3658:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352878 avail=317175 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023685 state=0: rc = 0 00000100:00100000:3.0:1783074234.290726:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723657472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (239us total) trans 0 rc 0/0 00000100:00000040:2.0:1783074234.290740:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.290744:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1783074234.290747:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723656704:0@lo:400:kworker.0 00000100:00000040:3.0:1783074234.290750:0:8454:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7805000 : new rpc_count 0 00000100:00000040:0.0:1783074234.290754:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074234.290760:0:8454:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7805000 : new refcount 4 00000100:00100000:2.0:1783074234.290766:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723657472:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1783074234.290769:0:3660:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00100000:0.0:1783074234.290774:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723656320:0@lo:400:kworker.0 00000100:00000040:1.0:1783074234.290778:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290780:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc494e00 x1869685723657216 msgsize 224 00000100:00000040:2.0:1783074234.290781:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf5880 x1869685723657472/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290792:0:3659:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00100000:3.0:1783074234.290793:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074234.290808:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074234.290810:0:3658:0:(genops.c:1244:class_import_put()) import ffff9524c6211000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783074234.290811:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290813:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.290840:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290842:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 2638 usecs (3 jiffies) 00000100:00000040:2.0:1783074234.290847:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074249 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.290849:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723656448:0@lo:400:kworker.0 00000100:00000040:3.0:1783074234.290855:0:3661:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:3.0:1783074234.290868:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.290868:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723656960:0@lo:400:kworker.0 00000100:00080000:2.0:1783074234.290871:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783074234.290878:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1783074234.290879:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1783074234.290882:0:3661:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352706 avail=317003 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023565 state=0: rc = 0 00000100:00000040:0.0:1783074234.290883:0:3659:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4ae8700 x1869685723656320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290886:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074249 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290895:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074234.290913:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.290918:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723656576:0@lo:8:kworker.0 00000020:00000040:0.0:1783074234.290919:0:3659:0:(genops.c:1244:class_import_put()) import ffff9524f778d800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:3.0:1783074234.290920:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723657344:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1783074234.290934:0:3659:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4ae9500 x1869685723656960/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074234.290935:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf4700 x1869685723657344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074234.290936:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723656064:0@lo:400:kworker.0 00000100:00000040:2.0:1783074234.290940:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074249 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074234.290950:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4aead80 x1869685723656704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.290967:0:3659:0:(genops.c:1244:class_import_put()) import ffff9524c6211000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:3.0:1783074234.290968:0:3661:0:(genops.c:1244:class_import_put()) import ffff9524f0d24800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1783074234.290968:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000020:00000040:1.0:1783074234.290973:0:3660:0:(genops.c:1244:class_import_put()) import ffff9524f0d27800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:2.0:1783074234.290977:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1783074234.290986:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4ae9180 x1869685723656448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.290997:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074249 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.291005:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657216 00000100:00100000:0.0:1783074234.291011:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657216 00000020:00000040:0.0:1783074234.291015:0:68632:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0811 00000020:00000040:0.0:1783074234.291020:0:68632:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc3c4800 refcount=5 00000020:00000040:1.0:1783074234.291024:0:3660:0:(genops.c:1244:class_import_put()) import ffff9524f0d24800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:2.0:1783074234.291029:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723657088:0@lo:8:kworker.0 00000100:00000040:0.0:1783074234.291034:0:68632:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1783074234.291036:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4aeb480 x1869685723656064/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.291046:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4ae9880 x1869685723656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074249 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074234.291048:0:3660:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074234.291063:0:3657:0:(genops.c:1244:class_import_put()) import ffff9523c1efd800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783074234.291069:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00000040:2.0:1783074234.291073:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4ae8e00 x1869685723657088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074249 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.291074:0:68632:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc3c4800 : new rpc_count 1 00000100:00000040:0.0:1783074234.291082:0:68632:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc494e00 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074234.291086:0:3657:0:(genops.c:1244:class_import_put()) import ffff9523c6a63800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783074234.291100:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723657216:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783074234.291111:0:68632:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723657216 00000100:00000040:0.0:1783074234.291116:0:68632:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074234.291120:0:68632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.291137:0:68632:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.291157:0:68632:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074234.291171:0:68632:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc494e00 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1783074245 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.291180:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869685723657216:12345-0@lo:400:kworker.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074234.291187:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00000040:3.0:1783074234.291189:0:3661:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783074234.291191:0:68632:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc3c4800 : new rpc_count 0 00000100:00000040:3.0:1783074234.291195:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.291199:0:68632:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc3c4800 : new refcount 4 00000100:00000040:3.0:1783074234.291205:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074234.291210:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869685723657216:0@lo:400:kworker.0 00000100:00000040:3.0:1783074234.291214:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4aea680 x1869685723657216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074250 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074234.291219:0:3661:0:(genops.c:1244:class_import_put()) import ffff9524de7c4800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:0.0:1783074234.799157:0:75605:0:(genops.c:1231:class_import_get()) import ffff9524f0d27800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783074234.799195:0:75605:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006656653d] to pc [ptlrpcd_00_01+1] req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.799261:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1783074234.799433:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.799447:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723657600:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783074234.799477:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.799486:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074234.799520:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9524f091bb80 x1869685723657600 msgsize 224 00000100:00100000:2.0:1783074234.799525:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074234.799583:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074234.799596:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 3076 usecs (4 jiffies) 00000100:00100000:0.0:1783074234.799630:0:83645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657600 00000100:00100000:0.0:1783074234.799636:0:83645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657600 00000020:00000040:0.0:1783074234.799638:0:83645:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fff 00000020:00000040:0.0:1783074234.799642:0:83645:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524e010a000 refcount=5 00000100:00000040:0.0:1783074234.799657:0:83645:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1783074234.799685:0:83645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00000040:0.0:1783074234.799699:0:83645:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524e010a000 : new rpc_count 1 00000100:00000040:0.0:1783074234.799704:0:83645:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f091bb80 x1869685723657600/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1783074245 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.799717:0:83645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723657600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074234.799739:0:83645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1783074234.799749:0:83645:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968702, transno 0, xid 1869685723657600 00000100:00000040:0.0:1783074234.799757:0:83645:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074234.799762:0:83645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074234.799784:0:83645:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074234.799806:0:83645:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074234.799812:0:83645:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091bb80 x1869685723657600/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1783074245 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074234.799826:0:83645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723657600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074234.799832:0:83645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00000040:2.0:1783074234.799835:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968702 00000100:00000040:0.0:1783074234.799835:0:83645:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524e010a000 : new rpc_count 0 00000100:00000040:2.0:1783074234.799841:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074234.799845:0:83645:0:(genops.c:900:class_export_put()) PUTting export ffff9524e010a000 : new refcount 4 00000004:00000040:2.0:1783074234.799851:0:3658:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1783074234.799854:0:3658:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1783074234.799862:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074234.799871:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723657600:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783074234.799877:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f092dc00 x1869685723657600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783074250 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074234.799893:0:3658:0:(genops.c:1244:class_import_put()) import ffff9524f0d27800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1783074234.990623:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783074235.553131:0:96839:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783074235.553136:0:96839:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783074235.553137:0:96839:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1783074235.553210:0:96839:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9523c4c49000 00000020:01000004:0.0:1783074235.553224:0:96839:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783074235.553238:0:96839:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783074235.553251:0:96839:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9524c4410000) 00000020:00000040:0.0:1783074235.553258:0:96839:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c4c4c800 with handle 0x5fb609b3016e15b6 to hash 00000020:00000040:0.0:1783074235.553263:0:96839:0:(genops.c:900:class_export_put()) PUTting export ffff9523c4c4c800 : new refcount 1 00000020:00000040:0.0:1783074235.553271:0:96839:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9524c4410000) now 2 - obd_device_list 00000020:00000080:0.0:1783074235.553274:0:96839:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:2.0:1783074235.740267:0:96839:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:2.0:1783074235.745414:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783074235.745492:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783074235.745519:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783074235.745546:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783074235.745571:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783074235.745597:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783074235.745621:0:96839:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1783074235.752404:0:96839:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:3.0:1783074235.752571:0:96839:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9524c4410000) now 3 - setup 00000020:00000080:3.0:1783074235.752576:0:96839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783074235.752586:0:96839:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:3.0:1783074235.752590:0:96839:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cd00a800 with handle 0x5fb609b3016e15bd to hash 00000020:00000040:3.0:1783074235.752595:0:96839:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9524c4410000) now 4 - export 00000020:00000040:3.0:1783074235.752602:0:96839:0:(genops.c:900:class_export_put()) PUTting export ffff9523cd00a800 : new refcount 1 00000020:00000080:3.0:1783074235.752604:0:96839:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb609b3016e15bd 00000020:00000040:3.0:1783074235.752606:0:96839:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15bd 00000020:00000040:3.0:1783074235.752608:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523cd00a800 refcount=2 00000020:01000004:3.0:1783074235.752612:0:96839:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783074235.752639:0:96839:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783074235.752642:0:96839:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783074235.752648:0:96839:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783074235.752670:0:96839:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783074235.752684:0:96839:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:3.0:1783074235.753177:0:96839:0:(genops.c:889:class_export_get()) GET export ffff9523c4c4c800 refcount=2 00000040:00000040:3.0:1783074235.753181:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 00000040:00000040:3.0:1783074235.754074:0:96839:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524d08d4300 : new refcount 1 00000040:01000000:3.0:1783074235.754079:0:96839:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 10000000:00000040:3.0:1783074235.754081:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 10000000:00000040:3.0:1783074235.754083:0:96839:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524d08d4300 : new refcount 1 00000020:00000040:3.0:1783074235.754086:0:96839:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.126@tcp (ffff9524e69d19c0) now 6 - mgc_fs 00000020:01000004:3.0:1783074235.754114:0:96839:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783074235.754117:0:96839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783074235.754119:0:96839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783074235.754120:0:96839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074235.754121:0:96839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074235.754122:0:96839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074235.754124:0:96839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074235.754125:0:96839:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074235.754127:0:96839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074235.754128:0:96839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783074235.754130:0:96839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783074235.754132:0:96839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783074235.754133:0:96839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783074235.754134:0:96839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074235.754135:0:96839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074235.754136:0:96839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074235.754138:0:96839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074235.754138:0:96839:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074235.754142:0:96839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074235.754143:0:96839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:3.0:1783074235.754148:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 10000000:01000000:3.0:1783074235.754170:0:96839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1783074235.754189:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.754203:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc495180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723657728:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1783074235.754229:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.754237:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.754273:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0236050 x1869685723657728 msgsize 4848 00000100:00100000:3.0:1783074235.754276:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.754277:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.754308:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.754342:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657728 00000100:00100000:3.0:1783074235.754349:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5754480 going to sleep for 11 seconds 00000100:00100000:2.0:1783074235.754350:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657728 00000020:00000040:2.0:1783074235.754354:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:2.0:1783074235.754358:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=21 00000100:00000040:3.0:1783074235.754464:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783074235.754501:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00000040:3.0:1783074235.754505:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074235.754510:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0236050 x1869685723657728/t0(0) o253->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 4848/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.754521:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:96839:x1869685723657728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783074235.754551:0:94277:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783074235.754554:0:94277:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783074235.754558:0:94277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:3.0:1783074235.754755:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723657728 00000100:00000040:3.0:1783074235.754763:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074235.754767:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.754780:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.754811:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074235.754817:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0236050 x1869685723657728/t0(0) o253->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 4848/4768 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.754826:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:96839:x1869685723657728:12345-0@lo:253:mount.lustre.0 Request processed in 307us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.754833:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00000040:3.0:1783074235.754836:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:3.0:1783074235.754845:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 20 00000100:00000040:1.0:1783074235.754847:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.754857:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.754864:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc495180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723657728:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1783074235.754871:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783074235.754881:0:96839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783074235.754883:0:96839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783074235.754884:0:96839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783074235.754885:0:96839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783074235.754886:0:96839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783074235.754888:0:96839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783074235.754889:0:96839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783074235.754890:0:96839:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783074235.754891:0:96839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783074235.754892:0:96839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:1.0:1783074235.754895:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc495180 x1869685723657728/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.754905:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000020:01000004:1.0:1783074235.754919:0:96839:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9523c4c49000 from lustre-OST0000 10000000:01000000:1.0:1783074235.754946:0:96839:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783074235.754948:0:96839:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:1.0:1783074235.754956:0:96839:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff9524c6ce6800) refs 5 10000000:01000000:1.0:1783074235.754958:0:96839:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9524e69d19c0 local copy 00000020:00000040:1.0:1783074235.754968:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524d3159e00 refcount=2 00010000:00010000:1.0:1783074235.754977:0:96839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1783074235.754999:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524c4c790c0 : new refcount 2 10000000:00000040:1.0:1783074235.755002:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 10000000:00000040:1.0:1783074235.755005:0:96839:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.126@tcp: copy local log lustre-sptlrpc 00000020:00000040:1.0:1783074235.755034:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:1.0:1783074235.755038:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:1.0:1783074235.755054:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.755063:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723657856:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783074235.755076:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.755082:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.755098:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0234c50 x1869685723657856 msgsize 512 00000100:00100000:1.0:1783074235.755101:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.755103:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783074235.755125:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.755135:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4162840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074235.755248:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657856 00000100:00100000:3.0:1783074235.755251:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657856 00000020:00000040:3.0:1783074235.755253:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:3.0:1783074235.755254:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=21 00000100:00000040:3.0:1783074235.755262:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783074235.755278:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00000040:3.0:1783074235.755281:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074235.755286:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0234c50 x1869685723657856/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 512/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.755297:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:96839:x1869685723657856:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1783074235.755308:0:94276:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:3.0:1783074235.755331:0:94276:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:3.0:1783074235.755353:0:94276:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:3.0:1783074235.755356:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723657856 00000100:00000040:3.0:1783074235.755361:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074235.755364:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.755381:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.755410:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074235.755421:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0234c50 x1869685723657856/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 512/272 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.755428:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+21:96839:x1869685723657856:12345-0@lo:501:mount.lustre.0 Request processed in 133us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783074235.755435:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00000040:3.0:1783074235.755437:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:3.0:1783074235.755444:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 20 00000100:00000040:1.0:1783074235.755604:0:96839:0:(client.c:1496:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.755612:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.755619:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.755699:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723657856:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783074235.755712:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.755720:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:1.0:1783074235.755723:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf4e00 x1869685723657856/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.755730:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 10000000:01000000:1.0:1783074235.755737:0:96839:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783074235.755753:0:96839:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:1.0:1783074235.755756:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524d3159e00 refcount=3 00010000:00010000:1.0:1783074235.755760:0:96839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.755768:0:96839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074235.755789:0:96839:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9523c4c49000 10000000:01000000:1.0:1783074235.755793:0:96839:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:1.0:1783074235.755797:0:96839:0:(genops.c:889:class_export_get()) GET export ffff9524d08c8000 refcount=18 10000000:00000040:1.0:1783074235.755800:0:96839:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9524c6ce6a00) refs 4 10000000:01000000:1.0:1783074235.755802:0:96839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783074235.755805:0:96839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:1.0:1783074235.755807:0:96839:0:(genops.c:889:class_export_get()) GET export ffff9524d08c8000 refcount=19 10000000:01000000:1.0:1783074235.755810:0:96839:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783074235.755813:0:96839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:1.0:1783074235.755817:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00010000:00000040:1.0:1783074235.755827:0:96839:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9524e0374100 count: 8 00000020:00000040:1.0:1783074235.755834:0:96839:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cb0eb000 with handle 0x5fb609b3016e15c4 to hash 00010000:00010000:1.0:1783074235.755839:0:96839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.755856:0:96839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.755865:0:96839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074235.755877:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.755886:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723657984:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1783074235.755898:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.755905:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.755919:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4b050 x1869685723657984 msgsize 328 00000100:00100000:1.0:1783074235.755922:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.755924:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783074235.755971:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.755986:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c4162840 going to sleep for 11 seconds 00000100:00100000:3.0:1783074235.756193:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723657984 00000100:00100000:3.0:1783074235.756197:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723657984 00000020:00000040:3.0:1783074235.756199:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:3.0:1783074235.756201:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=21 00000100:00000040:3.0:1783074235.756211:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783074235.756264:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00000040:3.0:1783074235.756267:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074235.756271:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4b050 x1869685723657984/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.756280:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+21:96839:x1869685723657984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783074235.756289:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783074235.756296:0:94277:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9524ca7b9e00 count: 10 00000020:00000040:3.0:1783074235.756301:0:94277:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c69bda00 with handle 0x5fb609b3016e15cb to hash 00010000:00010000:3.0:1783074235.756304:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523c69bda00/0x5fb609b3016e15cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e15c4 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756330:0:94277:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9524f7804800 : new locks_count 16 00000020:00000040:3.0:1783074235.756333:0:94277:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=22 00010000:00000040:3.0:1783074235.756346:0:94277:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9524ca7b9e00) refcount = 10 00010000:00000040:3.0:1783074235.756349:0:94277:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783074235.756353:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e0bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bec expref: 22 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756366:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bc2 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756373:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bb4 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756379:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0ba6 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756385:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3298a00/0x5fb609b3016e0b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b98 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756392:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b8a expref: 22 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756397:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524d3159600/0x5fb609b3016e0b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b7c expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756411:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3298800/0x5fb609b3016e0b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b384 expref: 9 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.756418:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524d3159800/0x5fb609b3016e0b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b37d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.756425:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523c69bda00/0x5fb609b3016e15cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e15c4 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.756435:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523c69bda00/0x5fb609b3016e15cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e15c4 expref: 22 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.756444:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523c69bda00, rc 0) 00010000:00000040:3.0:1783074235.756447:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723657984 00000100:00000040:3.0:1783074235.756458:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074235.756462:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.756478:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.756508:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074235.756514:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4b050 x1869685723657984/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/344 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.756522:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723657984:12345-0@lo:101:mount.lustre.0 Request processed in 243us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.756528:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00000040:3.0:1783074235.756531:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:3.0:1783074235.756538:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 21 00000100:00000040:2.0:1783074235.756594:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.756605:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.756614:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723657984:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783074235.756620:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.756629:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523cb0eb000 refcount=4 00010000:00000040:2.0:1783074235.756633:0:96839:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9523cb0eb000, remote cookie: 0x5fb609b3016e15cb, flags: 0x0 00010000:00000040:2.0:1783074235.756637:0:96839:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9524e0374100) refcount = 8 00010000:00000040:2.0:1783074235.756639:0:96839:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783074235.756642:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.756661:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bc9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.756667:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bbb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.756686:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bad expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.756693:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b9f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.756699:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b91 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.756705:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b83 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.756711:0:96839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e15cb expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.756719:0:96839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e15cb expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.756729:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf4e00 x1869685723657984/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.756738:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 10000000:00000040:2.0:1783074235.756745:0:96839:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff9524defa5400) refs 2 00000020:00000040:2.0:1783074235.756748:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523cb0eb000 refcount=3 10000000:00000040:2.0:1783074235.756771:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524c4c790c0 : new refcount 2 10000000:00000040:2.0:1783074235.756780:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 10000000:00000040:2.0:1783074235.756782:0:96839:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.126@tcp: copy local log lustre-OST0000 00000040:00080000:2.0:1783074235.757082:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783074235.757546:0:96839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783074235.758831:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783074235.758864:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783074235.758881:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783074235.758896:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783074235.758908:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783074235.758919:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783074235.758938:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783074235.758942:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:3.0:1783074235.758987:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.758993:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.759019:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.759031:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658112:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1783074235.759051:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.759070:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.759101:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b49050 x1869685723658112 msgsize 512 00000100:00100000:3.0:1783074235.759106:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.759107:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.759188:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.759213:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5754d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783074235.760667:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658112 00000100:00100000:1.0:1783074235.760690:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658112 00000020:00000040:1.0:1783074235.760694:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:1.0:1783074235.760699:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=22 00000100:00000040:1.0:1783074235.760721:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783074235.760751:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00000040:1.0:1783074235.760756:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074235.760763:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b49050 x1869685723658112/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 512/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.760777:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658112:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1783074235.760808:0:94276:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:1.0:1783074235.760811:0:94276:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:1.0:1783074235.760867:0:94276:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00000020:00000040:1.0:1783074235.760877:0:94276:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=23 00000020:00000040:1.0:1783074235.760881:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00010000:00000040:1.0:1783074235.760885:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658112 00000100:00000040:1.0:1783074235.760894:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:1.0:1783074235.760900:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.760927:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.760953:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074235.760959:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b49050 x1869685723658112/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 512/272 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.760969:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658112:12345-0@lo:501:mount.lustre.0 Request processed in 194us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.760976:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00000040:1.0:1783074235.760979:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:1.0:1783074235.760990:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 21 00000100:00000040:3.0:1783074235.760992:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.761005:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.761012:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658112:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1783074235.761021:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.761030:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.761034:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723658112/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.761042:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.761052:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.761056:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.761071:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.761080:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658240:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783074235.761107:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.761124:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.761146:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4b850 x1869685723658240 msgsize 272 00000100:00100000:3.0:1783074235.761151:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.761153:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.761181:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.761202:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5754d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074235.761223:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658240 00000100:00100000:0.0:1783074235.761227:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658240 00000020:00000040:0.0:1783074235.761229:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.761231:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=22 00000100:00000040:0.0:1783074235.761241:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.761265:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00000040:0.0:1783074235.761269:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.761273:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4b850 x1869685723658240/t0(0) o503->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.761286:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658240:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1783074235.761307:0:94277:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:0.0:1783074235.761356:0:94277:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:0.0:1783074235.761366:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658240 00000100:00000040:0.0:1783074235.761373:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.761379:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.761401:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.761426:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.761432:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4b850 x1869685723658240/t0(0) o503->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8416 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.761442:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658240:12345-0@lo:503:mount.lustre.0 Request processed in 157us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.761450:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00000040:0.0:1783074235.761453:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:0.0:1783074235.761463:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 21 00000100:00000040:3.0:1783074235.761519:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.761525:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.761529:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658240:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783074235.761533:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.761540:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723658240/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.761550:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.761553:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.761983:0:96839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1783074235.762027:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.762030:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.762042:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.762048:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658368:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.762068:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.762085:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.762103:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b49450 x1869685723658368 msgsize 272 00000100:00100000:3.0:1783074235.762107:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.762108:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.762183:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.762188:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658368 00000100:00100000:1.0:1783074235.762192:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658368 00000020:00000040:1.0:1783074235.762194:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:1.0:1783074235.762196:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=22 00000100:00100000:3.0:1783074235.762201:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5754d80 going to sleep for 11 seconds 00000100:00000040:1.0:1783074235.762207:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783074235.762226:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00000040:1.0:1783074235.762230:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074235.762235:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b49450 x1869685723658368/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.762249:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658368:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1783074235.762274:0:94276:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:1.0:1783074235.762619:0:94276:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:1.0:1783074235.762623:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658368 00000100:00000040:1.0:1783074235.762628:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:1.0:1783074235.762631:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.762645:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.762661:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074235.762665:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b49450 x1869685723658368/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.762684:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658368:12345-0@lo:502:mount.lustre.0 Request processed in 438us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.762691:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00000040:1.0:1783074235.762694:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:1.0:1783074235.762701:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 21 00000100:00000040:3.0:1783074235.762748:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.762757:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.762764:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658368:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.762770:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.762780:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723658368/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.762793:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.762799:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.762926:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783074235.762952:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783074235.762966:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783074235.762978:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783074235.763007:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783074235.763022:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783074235.763035:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783074235.763049:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783074235.763063:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783074235.763077:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783074235.763103:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783074235.763117:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:3.0:1783074235.763124:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.763128:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.763142:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.763151:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658496:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.763171:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.763178:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.763194:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4a850 x1869685723658496 msgsize 272 00000100:00100000:3.0:1783074235.763197:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.763199:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.763218:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.763231:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658496 00000100:00100000:3.0:1783074235.763234:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5754d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783074235.763236:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658496 00000020:00000040:2.0:1783074235.763239:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:2.0:1783074235.763241:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=22 00000100:00000040:2.0:1783074235.763253:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783074235.763272:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00000040:2.0:1783074235.763275:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:2.0:1783074235.763278:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4a850 x1869685723658496/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.763286:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658496:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783074235.763300:0:94278:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:2.0:1783074235.763356:0:94278:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:2.0:1783074235.763360:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658496 00000100:00000040:2.0:1783074235.763366:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074235.763371:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074235.763394:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.763417:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:2.0:1783074235.763423:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4a850 x1869685723658496/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.763434:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.763435:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658496:12345-0@lo:502:mount.lustre.0 Request processed in 147us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074235.763451:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00000040:3.0:1783074235.763455:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.763456:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00100000:3.0:1783074235.763465:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658496:0@lo:502:mount.lustre.0 00000020:00000040:2.0:1783074235.763467:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 21 00000100:00000040:3.0:1783074235.763470:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.763483:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723658496/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.763493:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.763498:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.763518:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783074235.763523:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:3.0:1783074235.763712:0:96839:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524c4c790c0 : new refcount 1 00000020:00000040:3.0:1783074235.763718:0:96839:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1783074235.763987:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783074235.763994:0:96843:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783074235.764002:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.764004:0:96843:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783074235.764010:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783074235.764024:0:96843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9524fa860000) 00000020:00000040:3.0:1783074235.764031:0:96843:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cd00c000 with handle 0x5fb609b3016e15d2 to hash 00000020:00000040:3.0:1783074235.764037:0:96843:0:(genops.c:900:class_export_put()) PUTting export ffff9523cd00c000 : new refcount 1 00000020:00000040:3.0:1783074235.764062:0:96843:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 2 - obd_device_list 00000020:00000080:3.0:1783074235.764067:0:96843:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:3.0:1783074235.764073:0:96843:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1783074235.764076:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783074235.764157:0:96843:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9523c4c49000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783074235.764164:0:96843:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:3.0:1783074235.764169:0:96843:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c6946000 with handle 0x5fb609b3016e15d9 to hash 00000020:00000040:3.0:1783074235.764172:0:96843:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9524c4410000) now 5 - export 00000020:00000040:3.0:1783074235.764175:0:96843:0:(genops.c:900:class_export_put()) PUTting export ffff9523c6946000 : new refcount 1 00000020:00000080:3.0:1783074235.764177:0:96843:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb609b3016e15d9 00000020:00000040:3.0:1783074235.764179:0:96843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15d9 00000020:00000040:3.0:1783074235.764181:0:96843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c6946000 refcount=2 00010000:00010000:3.0:1783074235.769648:0:96843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:3.0:1783074235.769662:0:96843:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 1331, crc32c 6507, adler 955, t10ip512 2832, t10ip4k 2811, t10crc512 609, t10crc4k 795 00002000:00000040:3.0:1783074235.769710:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:3.0:1783074235.769778:0:96843:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968718: rc = 0 00000001:00000040:3.0:1783074235.769783:0:96843:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:3.0:1783074235.769791:0:96843:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968718, last_xid = 1869685723596032, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783074235.769800:0:96843:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968718 srv lr: 4294968718 lx: 1869685723596032 gen 0 00000020:00000040:3.0:1783074235.769807:0:96843:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9524c4404800 with handle 0x5fb609b3016e15e0 to hash 00000020:00000040:3.0:1783074235.769841:0:96843:0:(genops.c:889:class_export_get()) GET export ffff9524c4404800 refcount=3 00000020:00000040:3.0:1783074235.769846:0:96843:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 3 - export 00000001:00000040:3.0:1783074235.769849:0:96843:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1783074235.769852:0:96843:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4404800 : new refcount 2 00000001:00000040:3.0:1783074235.769857:0:96843:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968736, last_xid = 1869685723650432, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783074235.769861:0:96843:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968736 srv lr: 4294968718 lx: 1869685723650432 gen 0 00000020:00000040:3.0:1783074235.769865:0:96843:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c316d000 with handle 0x5fb609b3016e15e7 to hash 00000020:00000040:3.0:1783074235.769881:0:96843:0:(genops.c:889:class_export_get()) GET export ffff9523c316d000 refcount=3 00000020:00000040:3.0:1783074235.769883:0:96843:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 4 - export 00000001:00000040:3.0:1783074235.769885:0:96843:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1783074235.769887:0:96843:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316d000 : new refcount 2 00000001:00000040:3.0:1783074235.769891:0:96843:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b, last_transno = 4294968740, last_xid = 1869685708128128, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783074235.769894:0:96843:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b idx: 2 lr: 4294968740 srv lr: 4294968718 lx: 1869685708128128 gen 0 00000020:00000040:3.0:1783074235.769898:0:96843:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c316b000 with handle 0x5fb609b3016e15ee to hash 00000020:00000040:3.0:1783074235.769908:0:96843:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=3 00000020:00000040:3.0:1783074235.769910:0:96843:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 5 - export 00000001:00000040:3.0:1783074235.769912:0:96843:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID '0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b' added, generation 0 00000020:00000040:3.0:1783074235.769915:0:96843:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 2 00000001:00000040:3.0:1783074235.769918:0:96843:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:3.0:1783074235.769921:0:96843:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:3.0:1783074235.769925:0:96843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968740 00000001:00000040:3.0:1783074235.769967:0:96843:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968740: rc = 0 00000001:00000040:3.0:1783074235.769980:0:96843:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968740: rc = 0 00002000:00000040:3.0:1783074235.769991:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:3.0:1783074235.770023:0:96843:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:3.0:1783074235.770073:0:96843:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:3.0:1783074235.770081:0:96843:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:3.0:1783074235.770087:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:3.0:1783074235.770122:0:96843:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:3.0:1783074235.770130:0:96843:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:3.0:1783074235.770165:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:3.0:1783074235.770180:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:3.0:1783074235.770214:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:3.0:1783074235.770300:0:96843:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:3.0:1783074235.770351:0:96843:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:3.0:1783074235.770515:0:96843:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:3.0:1783074235.770709:0:96843:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:3.0:1783074235.771751:0:96843:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 6 - setup 00000020:00000080:3.0:1783074235.771756:0:96843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783074235.771766:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074235.771771:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.771774:0:96843:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783074235.771777:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783074235.771780:0:96843:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783074235.771781:0:96843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074235.771783:0:96843:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783074235.771785:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783074235.771787:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.771789:0:96843:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783074235.771792:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074235.771795:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.771797:0:96843:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783074235.771800:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783074235.771807:0:96843:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783074235.771810:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074235.771814:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.771815:0:96843:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783074235.771818:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783074235.771821:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.771822:0:96843:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783074235.771826:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783074235.771848:0:96843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783074235.771852:0:96843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783074235.771853:0:96843:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783074235.771857:0:96843:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783074235.772054:0:96839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783074235.772088:0:96839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:2.0:1783074235.772105:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523cb0eb000 refcount=3 00010000:00010000:2.0:1783074235.772112:0:96839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e15cb expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.772123:0:96839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e15cb expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783074235.772133:0:96839:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9523c4c49000 from 1 10000000:01000000:2.0:1783074235.772136:0:96839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:2.0:1783074235.772144:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00010000:00000040:2.0:1783074235.772171:0:96839:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c8d7c300 count: 4 00000020:00000040:2.0:1783074235.772179:0:96839:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9524c151b800 with handle 0x5fb609b3016e15f5 to hash 00010000:00010000:2.0:1783074235.772185:0:96839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.772193:0:96839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.772204:0:96839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.772227:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.772241:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658624:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783074235.772266:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.772275:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074235.772349:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4ac50 x1869685723658624 msgsize 328 00000100:00100000:2.0:1783074235.772354:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074235.772356:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783074235.772375:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.772392:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658624 00000100:00100000:0.0:1783074235.772399:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658624 00000020:00000040:0.0:1783074235.772402:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000100:00100000:2.0:1783074235.772405:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3987180 going to sleep for 11 seconds 00000020:00000040:0.0:1783074235.772406:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=22 00000100:00000040:0.0:1783074235.772428:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.772455:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00000040:0.0:1783074235.772459:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.772465:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4ac50 x1869685723658624/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.772478:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:96839:x1869685723658624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074235.772499:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1783074235.772506:0:94276:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9524d2de4500 count: 5 00000020:00000040:0.0:1783074235.772513:0:94276:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9525021dba00 with handle 0x5fb609b3016e15fc to hash 00010000:00010000:0.0:1783074235.772517:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9525021dba00/0x5fb609b3016e15fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e15f5 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.772536:0:94276:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9524f7804800 : new locks_count 17 00000020:00000040:0.0:1783074235.772539:0:94276:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=23 00010000:00000040:0.0:1783074235.772556:0:94276:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9524d2de4500) refcount = 5 00010000:00000040:0.0:1783074235.772559:0:94276:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783074235.772565:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524edcc6200/0x5fb609b3016e07ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b31b expref: 9 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.772573:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524df28fe00/0x5fb609b3016e078c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0785 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.772580:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524df2c8400/0x5fb609b3016e0762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e075b expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.772587:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524df28ee00/0x5fb609b3016e06eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e06e4 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074235.772593:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9525021dba00/0x5fb609b3016e15fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e15f5 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074235.772603:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9525021dba00/0x5fb609b3016e15fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e15f5 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074235.772611:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021dba00, rc 0) 00010000:00000040:0.0:1783074235.772615:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658624 00000100:00000040:0.0:1783074235.772623:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.772628:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.772650:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.772683:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.772689:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4ac50 x1869685723658624/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/344 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.772706:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723658624:12345-0@lo:101:mount.lustre.0 Request processed in 229us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.772712:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00000040:0.0:1783074235.772715:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:2.0:1783074235.772721:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.772725:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000100:00000040:2.0:1783074235.772736:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.772745:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658624:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783074235.772754:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.772764:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524c151b800 refcount=4 00010000:00000040:2.0:1783074235.772769:0:96839:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9524c151b800, remote cookie: 0x5fb609b3016e15fc, flags: 0x0 00010000:00000040:2.0:1783074235.772773:0:96839:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9523c8d7c300) refcount = 4 00010000:00000040:2.0:1783074235.772776:0:96839:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783074235.772779:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524df28f400/0x5fb609b3016e0785 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e078c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.772786:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524fb671400/0x5fb609b3016e075b lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0762 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.772793:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524edcc7200/0x5fb609b3016e06e4 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e06eb expref: -99 pid: 94270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.772812:0:96839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e15fc expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.772833:0:96839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e15fc expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.772843:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f0918000 x1869685723658624/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.772853:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 10000000:00000040:2.0:1783074235.772860:0:96839:0:(mgc_request.c:108:config_log_get()) log params (ffff9524def9ec00) refs 2 00000020:00000040:2.0:1783074235.772863:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524c151b800 refcount=3 10000000:00000040:2.0:1783074235.772909:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524c4c790c0 : new refcount 2 10000000:00000040:2.0:1783074235.772913:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 10000000:00000040:2.0:1783074235.772916:0:96839:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.126@tcp: copy local log params 00000040:00080000:2.0:1783074235.773046:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783074235.773279:0:96839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783074235.773506:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783074235.773531:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783074235.773550:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783074235.773556:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1783074235.773588:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074235.773592:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:2.0:1783074235.773612:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.773622:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658752:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1783074235.773639:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.773647:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074235.773685:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4b450 x1869685723658752 msgsize 504 00000100:00100000:2.0:1783074235.773690:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074235.773692:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783074235.773718:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.773740:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658752 00000100:00100000:2.0:1783074235.773743:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d08d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783074235.773747:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658752 00000020:00000040:3.0:1783074235.773750:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:3.0:1783074235.773754:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000100:00000040:3.0:1783074235.773768:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783074235.773798:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00000040:3.0:1783074235.773802:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074235.773807:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4b450 x1869685723658752/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 504/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.773821:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723658752:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1783074235.773836:0:94277:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:3.0:1783074235.773840:0:94277:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:3.0:1783074235.773881:0:94277:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:3.0:1783074235.773887:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658752 00000100:00000040:3.0:1783074235.773893:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074235.773897:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.773928:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.773968:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074235.773981:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4b450 x1869685723658752/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 504/272 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.773988:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.773999:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.774008:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723658752:12345-0@lo:501:mount.lustre.0 Request processed in 173us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074235.774008:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658752:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1783074235.774017:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.774032:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000020:00000040:2.0:1783074235.774034:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.774037:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:2.0:1783074235.774041:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f0918000 x1869685723658752/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.774050:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000020:00000040:2.0:1783074235.774052:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074235.774064:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074235.774068:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:2.0:1783074235.774082:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.774092:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658880:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1783074235.774117:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.774123:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074235.774134:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b49850 x1869685723658880 msgsize 272 00000100:00100000:2.0:1783074235.774137:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074235.774138:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783074235.774156:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.774172:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d08d4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783074235.774216:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723658880 00000100:00100000:1.0:1783074235.774219:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723658880 00000020:00000040:1.0:1783074235.774221:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:1.0:1783074235.774223:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000100:00000040:1.0:1783074235.774234:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783074235.774281:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00000040:1.0:1783074235.774283:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074235.774287:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b49850 x1869685723658880/t0(0) o503->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.774296:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723658880:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1783074235.774330:0:94276:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:1.0:1783074235.774352:0:94276:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:1.0:1783074235.774358:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723658880 00000100:00000040:1.0:1783074235.774363:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:1.0:1783074235.774366:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.774385:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.774410:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074235.774416:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b49850 x1869685723658880/t0(0) o503->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8416 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.774426:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723658880:12345-0@lo:503:mount.lustre.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.774434:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00000040:1.0:1783074235.774437:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:3.0:1783074235.774440:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.774446:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000100:00000040:3.0:1783074235.774456:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.774464:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f0918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723658880:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783074235.774474:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.774487:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f0918000 x1869685723658880/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.774502:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.774509:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.774825:0:96839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1783074235.774870:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.774875:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.774888:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.774898:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659008:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.774919:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.774935:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.774952:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b48850 x1869685723659008 msgsize 272 00000100:00100000:3.0:1783074235.774956:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.774958:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.774980:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.775013:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659008 00000100:00100000:0.0:1783074235.775019:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659008 00000020:00000040:0.0:1783074235.775021:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.775024:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000100:00000040:0.0:1783074235.775035:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.775053:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00000040:0.0:1783074235.775056:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.775062:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b48850 x1869685723659008/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.775076:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723659008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783074235.775078:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c3987180 going to sleep for 11 seconds 00000040:00000040:0.0:1783074235.775094:0:94277:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:0.0:1783074235.775124:0:94277:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:0.0:1783074235.775127:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659008 00000100:00000040:0.0:1783074235.775133:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.775137:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.775155:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.775237:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074235.775240:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.775246:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b48850 x1869685723659008/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.775258:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.775261:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723659008:12345-0@lo:502:mount.lustre.0 Request processed in 188us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.775269:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783074235.775275:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00000040:0.0:1783074235.775278:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:3.0:1783074235.775280:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.775285:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000100:00000040:3.0:1783074235.775296:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723659008/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.775334:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.775341:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.775472:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783074235.775499:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783074235.775516:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783074235.775532:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783074235.775547:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:3.0:1783074235.775554:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.775558:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.775572:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.775592:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659136:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.775613:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.775620:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.775636:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4bc50 x1869685723659136 msgsize 272 00000100:00100000:3.0:1783074235.775640:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.775642:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.775661:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.775690:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783074235.775698:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659136 00000100:00100000:1.0:1783074235.775704:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659136 00000020:00000040:1.0:1783074235.775706:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:1.0:1783074235.775709:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000100:00000040:1.0:1783074235.775721:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783074235.775744:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00000040:1.0:1783074235.775747:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074235.775752:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4bc50 x1869685723659136/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.775763:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723659136:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1783074235.775780:0:94276:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:1.0:1783074235.775819:0:94276:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:1.0:1783074235.775823:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659136 00000100:00000040:1.0:1783074235.775829:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:1.0:1783074235.775834:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.775861:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.775881:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:1.0:1783074235.775886:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4bc50 x1869685723659136/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.775894:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723659136:12345-0@lo:502:mount.lustre.0 Request processed in 132us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.775901:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00000040:1.0:1783074235.775904:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:1.0:1783074235.775912:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000100:00000040:3.0:1783074235.775915:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.775926:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.775934:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659136:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.775941:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.775952:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723659136/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.775965:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.775972:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.775994:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783074235.776003:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:3.0:1783074235.776274:0:96839:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524c4c790c0 : new refcount 1 00000020:00000040:3.0:1783074235.776279:0:96839:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:1.0:1783074235.776650:0:96847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074235.776660:0:96847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074235.776662:0:96847:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783074235.776682:0:96847:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9523c4c49000 00000020:00000080:1.0:1783074235.776686:0:96847:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783074235.776695:0:96847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074235.776698:0:96847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074235.776700:0:96847:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783074235.776703:0:96847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783074235.776706:0:96847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074235.776708:0:96847:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783074235.776712:0:96847:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9523c4c49000 00000020:00000080:1.0:1783074235.776714:0:96847:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783074235.776755:0:96847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783074235.776758:0:96847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783074235.776759:0:96847:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783074235.776761:0:96847:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:3.0:1783074235.777530:0:96839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783074235.777562:0:96839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:3.0:1783074235.777577:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524c151b800 refcount=3 00010000:00010000:3.0:1783074235.777583:0:96839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e15fc expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.777593:0:96839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9524c151b800/0x5fb609b3016e15f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e15fc expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783074235.777645:0:96839:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783074235.777647:0:96839:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9523c4c49000 10000000:01000000:3.0:1783074235.777650:0:96839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9523c4c49000 10000000:01000000:3.0:1783074235.777653:0:96839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1783074235.777656:0:96839:0:(genops.c:889:class_export_get()) GET export ffff9524d08c8000 refcount=20 10000000:01000000:3.0:1783074235.777659:0:96839:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9523c4c49000 from 1 10000000:01000000:3.0:1783074235.777661:0:96839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:3.0:1783074235.777665:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00010000:00000040:3.0:1783074235.777695:0:96839:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9524e0374100 count: 9 00000020:00000040:3.0:1783074235.777707:0:96839:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c69bd000 with handle 0x5fb609b3016e1603 to hash 00010000:00010000:3.0:1783074235.777714:0:96839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.777722:0:96839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.777731:0:96839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783074235.777747:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.777757:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659264:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1783074235.777785:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.777793:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.777925:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b48c50 x1869685723659264 msgsize 328 00000100:00100000:3.0:1783074235.777930:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.777932:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.777957:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.777967:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659264 00000100:00100000:0.0:1783074235.777973:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659264 00000020:00000040:0.0:1783074235.777975:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.777978:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000100:00100000:3.0:1783074235.777983:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573ba80 going to sleep for 11 seconds 00000100:00000040:0.0:1783074235.777993:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.778021:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00000040:0.0:1783074235.778025:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.778030:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b48c50 x1869685723659264/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.778044:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+23:96839:x1869685723659264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783074235.778055:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1783074235.778064:0:94277:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9524ca7b9e00 count: 11 00000020:00000040:0.0:1783074235.778070:0:94277:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9525021da000 with handle 0x5fb609b3016e160a to hash 00010000:00010000:0.0:1783074235.778074:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9525021da000/0x5fb609b3016e160a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e1603 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778082:0:94277:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9524f7804800 : new locks_count 18 00000020:00000040:0.0:1783074235.778084:0:94277:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=24 00010000:00000040:0.0:1783074235.778099:0:94277:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9524ca7b9e00) refcount = 11 00010000:00000040:0.0:1783074235.778102:0:94277:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783074235.778105:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c69bda00/0x5fb609b3016e15cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e15c4 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778112:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524fb671e00/0x5fb609b3016e0bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bec expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778128:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3298400/0x5fb609b3016e0bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bc2 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778135:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3299000/0x5fb609b3016e0bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0bb4 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778142:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3299200/0x5fb609b3016e0bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0ba6 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778148:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3298a00/0x5fb609b3016e0b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b98 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778155:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524fb671c00/0x5fb609b3016e0b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b8a expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778162:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524d3159600/0x5fb609b3016e0b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0b7c expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778171:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523c3298800/0x5fb609b3016e0b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b384 expref: 9 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783074235.778178:0:94277:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524d3159800/0x5fb609b3016e0b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b37d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074235.778185:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9525021da000/0x5fb609b3016e160a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e1603 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074235.778196:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9525021da000/0x5fb609b3016e160a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e1603 expref: 24 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074235.778205:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9525021da000, rc 0) 00010000:00000040:0.0:1783074235.778208:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659264 00000100:00000040:0.0:1783074235.778220:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.778225:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.778241:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.778260:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.778265:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b48c50 x1869685723659264/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/344 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.778275:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659264:12345-0@lo:101:mount.lustre.0 Request processed in 233us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.778282:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00000040:0.0:1783074235.778285:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:0.0:1783074235.778294:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:3.0:1783074235.778300:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.778337:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.778345:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659264:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1783074235.778352:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.778361:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523c69bd000 refcount=4 00010000:00000040:3.0:1783074235.778366:0:96839:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9523c69bd000, remote cookie: 0x5fb609b3016e160a, flags: 0x0 00010000:00000040:3.0:1783074235.778385:0:96839:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9524e0374100) refcount = 9 00010000:00000040:3.0:1783074235.778388:0:96839:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783074235.778391:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9523cb0eb000/0x5fb609b3016e15c4 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e15cb expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778399:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524d3159e00/0x5fb609b3016e0bec lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bf3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778406:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524d3158e00/0x5fb609b3016e0bc2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bc9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778423:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524d3158800/0x5fb609b3016e0bb4 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bbb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778429:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524e4145600/0x5fb609b3016e0ba6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0bad expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778436:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524fb670a00/0x5fb609b3016e0b98 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b9f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778442:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9524e4145000/0x5fb609b3016e0b8a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b91 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783074235.778448:0:96839:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9523c3298e00/0x5fb609b3016e0b7c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e0b83 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.778455:0:96839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e160a expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.778463:0:96839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e160a expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783074235.778472:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723659264/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.778486:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 10000000:00000040:3.0:1783074235.778493:0:96839:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff9524f086f400) refs 2 00000020:00000040:3.0:1783074235.778496:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523c69bd000 refcount=3 10000000:00000040:3.0:1783074235.778517:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524c4c790c0 : new refcount 2 10000000:00000040:3.0:1783074235.778520:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 10000000:00000040:3.0:1783074235.778522:0:96839:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.126@tcp: copy local log lustre-client 00000040:00080000:3.0:1783074235.778644:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783074235.778857:0:96839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783074235.779047:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783074235.779073:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783074235.779088:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783074235.779118:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783074235.779139:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783074235.779154:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783074235.779170:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783074235.779185:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783074235.779201:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783074235.779217:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783074235.779232:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783074235.779251:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783074235.779274:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783074235.779301:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783074235.779342:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783074235.779361:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783074235.779375:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783074235.779391:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783074235.779405:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783074235.779420:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783074235.779435:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783074235.779449:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783074235.779463:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783074235.779486:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783074235.779507:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783074235.779529:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783074235.779548:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783074235.779571:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783074235.779593:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783074235.779616:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783074235.779640:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783074235.779662:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783074235.779706:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783074235.779723:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783074235.779740:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783074235.779757:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783074235.779776:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783074235.779804:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783074235.779811:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1783074235.779848:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.779854:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.779877:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.779889:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659392:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1783074235.779907:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.779916:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.779940:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4a450 x1869685723659392 msgsize 512 00000100:00100000:3.0:1783074235.779945:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.779947:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.779980:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.779999:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659392 00000100:00100000:3.0:1783074235.780003:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074235.780006:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659392 00000020:00000040:0.0:1783074235.780010:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.780013:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00000040:0.0:1783074235.780028:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.780052:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1783074235.780055:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.780061:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4a450 x1869685723659392/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 512/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.780074:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659392:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1783074235.780089:0:94278:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:0.0:1783074235.780092:0:94278:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:0.0:1783074235.780149:0:94278:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00000020:00000040:0.0:1783074235.780158:0:94278:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=25 00000020:00000040:0.0:1783074235.780161:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 24 00010000:00000040:0.0:1783074235.780166:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659392 00000100:00000040:0.0:1783074235.780173:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.780185:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.780205:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.780227:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.780232:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4a450 x1869685723659392/t0(0) o501->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 512/272 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.780243:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659392:12345-0@lo:501:mount.lustre.0 Request processed in 170us (299us total) trans 0 rc 0/0 00000100:00000040:3.0:1783074235.780250:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.780253:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1783074235.780258:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:3.0:1783074235.780263:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.780268:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00100000:3.0:1783074235.780269:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659392:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1783074235.780280:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.780296:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.780299:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723659392/t0(0) o501->MGC192.168.204.126@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.780306:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.780330:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.780334:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.780348:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.780356:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659520:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783074235.780383:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.780390:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.780408:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c3b4a050 x1869685723659520 msgsize 272 00000100:00100000:3.0:1783074235.780411:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.780412:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.780430:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.780448:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074235.780477:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659520 00000100:00100000:0.0:1783074235.780482:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659520 00000020:00000040:0.0:1783074235.780484:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.780486:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00000040:0.0:1783074235.780497:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.780521:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:0.0:1783074235.780524:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.780529:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c3b4a050 x1869685723659520/t0(0) o503->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.780541:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c3b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659520:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1783074235.780563:0:94277:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:0.0:1783074235.780590:0:94277:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:0.0:1783074235.780593:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659520 00000100:00000040:0.0:1783074235.780598:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.780603:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.780620:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.780660:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.780666:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c3b4a050 x1869685723659520/t0(0) o503->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8416 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.780685:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c3b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659520:12345-0@lo:503:mount.lustre.0 Request processed in 146us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.780693:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:0.0:1783074235.780697:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:0.0:1783074235.780705:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:3.0:1783074235.780706:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.780717:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.780723:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659520:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783074235.780731:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.780754:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723659520/t0(0) o503->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.780770:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.780775:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.781090:0:96839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1783074235.781128:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.781133:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.781148:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.781157:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659648:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.781180:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.781187:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.781206:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0760c50 x1869685723659648 msgsize 272 00000100:00100000:3.0:1783074235.781211:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.781213:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.781239:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.781252:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c5754d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783074235.781299:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659648 00000100:00100000:0.0:1783074235.781304:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659648 00000020:00000040:0.0:1783074235.781306:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.781398:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00000040:0.0:1783074235.781410:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.781429:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:0.0:1783074235.781432:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.781437:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0760c50 x1869685723659648/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.781456:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659648:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783074235.781470:0:94278:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:0.0:1783074235.781494:0:94278:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:0.0:1783074235.781496:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659648 00000100:00000040:0.0:1783074235.781500:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.781504:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.781518:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.781542:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.781545:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0760c50 x1869685723659648/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.781556:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659648:12345-0@lo:502:mount.lustre.0 Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.781562:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:0.0:1783074235.781564:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:0.0:1783074235.781572:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:2.0:1783074235.781719:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.781729:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.781737:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659648:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1783074235.781743:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.781754:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723659648/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.781767:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074235.781772:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:2.0:1783074235.781895:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783074235.781917:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783074235.781930:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783074235.781941:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783074235.781953:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783074235.781964:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783074235.781977:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783074235.782004:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783074235.782021:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783074235.782042:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783074235.782058:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783074235.782072:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783074235.782085:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783074235.782098:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783074235.782110:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783074235.782123:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783074235.782147:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783074235.782161:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783074235.782174:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783074235.782186:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783074235.782196:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783074235.782208:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783074235.782219:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783074235.782230:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783074235.782242:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1783074235.782254:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1783074235.782266:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1783074235.782277:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1783074235.782289:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1783074235.782301:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1783074235.782330:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1783074235.782346:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1783074235.782359:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1783074235.782369:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1783074235.782385:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1783074235.782398:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1783074235.782410:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1783074235.782421:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1783074235.782431:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1783074235.782442:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1783074235.782454:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1783074235.782465:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1783074235.782478:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1783074235.782491:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1783074235.782504:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1783074235.782519:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1783074235.782532:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1783074235.782545:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:2.0:1783074235.782560:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074235.782569:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:2.0:1783074235.782584:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.782594:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659776:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1783074235.782614:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.782621:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074235.782639:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9524c8bcc450 x1869685723659776 msgsize 272 00000100:00100000:2.0:1783074235.782643:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074235.782644:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783074235.782661:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.782692:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524e6a86000 going to sleep for 11 seconds 00000100:00100000:0.0:1783074235.782696:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659776 00000100:00100000:0.0:1783074235.782702:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659776 00000020:00000040:0.0:1783074235.782704:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.782707:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00000040:0.0:1783074235.782720:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783074235.782743:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1783074235.782746:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:0.0:1783074235.782751:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524c8bcc450 x1869685723659776/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.782762:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659776:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783074235.782780:0:94277:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:0.0:1783074235.782809:0:94277:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:0.0:1783074235.782813:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659776 00000100:00000040:0.0:1783074235.782819:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:0.0:1783074235.782823:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.782844:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.782871:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:0.0:1783074235.782876:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524c8bcc450 x1869685723659776/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.782883:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659776:12345-0@lo:502:mount.lustre.0 Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.782896:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1783074235.782899:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:0.0:1783074235.782905:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:3.0:1783074235.782970:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.782982:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.782988:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659776:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.782994:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.783017:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f091a680 x1869685723659776/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.783029:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.783035:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:3.0:1783074235.783173:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783074235.783200:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1783074235.783215:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1783074235.783227:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1783074235.783235:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1783074235.783243:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1783074235.783253:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1783074235.783264:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1783074235.783275:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1783074235.783424:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1783074235.783442:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1783074235.783452:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1783074235.783465:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1783074235.783478:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:3.0:1783074235.783483:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074235.783486:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074235.783496:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.783502:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659904:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783074235.783519:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.783524:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.783537:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9524c8bce850 x1869685723659904 msgsize 272 00000100:00100000:3.0:1783074235.783540:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.783546:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.783596:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.783608:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c573b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783074235.783634:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723659904 00000100:00100000:0.0:1783074235.783638:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723659904 00000020:00000040:0.0:1783074235.783640:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:0.0:1783074235.783643:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00000040:0.0:1783074235.783656:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783074235.783707:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:3.0:1783074235.783710:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074235.783714:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524c8bce850 x1869685723659904/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.783726:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659904:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1783074235.783741:0:94277:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524fb3949c0 : new refcount 2 00000040:00000040:3.0:1783074235.783763:0:94277:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524fb3949c0 : new refcount 1 00010000:00000040:3.0:1783074235.783765:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723659904 00000100:00000040:3.0:1783074235.783769:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:3.0:1783074235.783772:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.783785:0:94277:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.783809:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 51 to 0@lo 00000100:00000040:3.0:1783074235.783812:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524c8bce850 x1869685723659904/t0(0) o502->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 272/8472 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.783818:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c8bce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723659904:12345-0@lo:502:mount.lustre.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.783822:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:3.0:1783074235.783823:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:3.0:1783074235.783827:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:2.0:1783074235.783883:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.783892:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.783898:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723659904:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1783074235.783904:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.783915:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496a00 x1869685723659904/t0(0) o502->MGC192.168.204.126@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.783927:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:2.0:1783074235.783931:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000040:00080000:2.0:1783074235.783948:0:96839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:2.0:1783074235.783954:0:96839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:2.0:1783074235.784111:0:96839:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524c4c790c0 : new refcount 1 00000020:00000040:2.0:1783074235.784121:0:96839:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:2.0:1783074235.784727:0:96850:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.204.126@tcp 192.168.204.126@tcp cnt=1 00000020:01000004:2.0:1783074235.784748:0:96850:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783074235.784762:0:96850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) 00000020:00000040:2.0:1783074235.784768:0:96850:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c1704800 with handle 0x5fb609b3016e1611 to hash 00000020:00000040:2.0:1783074235.784775:0:96850:0:(genops.c:900:class_export_put()) PUTting export ffff9523c1704800 : new refcount 1 00000020:00000040:2.0:1783074235.784788:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) now 2 - obd_device_list 00000020:00000080:2.0:1783074235.784793:0:96850:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783074235.785015:0:96850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9523c4c49000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783074235.785019:0:96850:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9523c4c49000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783074235.785021:0:96850:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9523c4c49000 3 00000020:00000040:2.0:1783074235.785036:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) now 3 - import 00000020:00000040:2.0:1783074235.785040:0:96850:0:(genops.c:1244:class_import_put()) import ffff9524c3568000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1783074235.785049:0:96850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074235.785051:0:96850:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 52 to 0@lo 00000100:00000040:2.0:1783074235.785053:0:96850:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.126@tcp -> ffff9524c5d54000 00010000:00080000:2.0:1783074235.785057:0:96850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524c3568000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1783074235.786854:0:96850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:2.0:1783074235.786932:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) now 4 - setup 00000020:00000080:2.0:1783074235.786936:0:96850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783074235.786964:0:96850:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1783074235.786969:0:96850:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c1706800 with handle 0x5fb609b3016e1618 to hash 00000020:00000040:2.0:1783074235.786974:0:96850:0:(genops.c:889:class_export_get()) GET export ffff9523c1706800 refcount=3 00000020:00000040:2.0:1783074235.786977:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) now 5 - export 00000020:00000040:2.0:1783074235.786980:0:96850:0:(genops.c:900:class_export_put()) PUTting export ffff9523c1706800 : new refcount 2 00000020:00000080:2.0:1783074235.786982:0:96850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5fb609b3016e1618 00000020:00000040:2.0:1783074235.786984:0:96850:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e1618 00000020:00000040:2.0:1783074235.786986:0:96850:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c1706800 refcount=3 00000100:00080000:2.0:1783074235.786993:0:96850:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:2.0:1783074235.786997:0:96850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 53 to 0@lo 00000020:00000040:2.0:1783074235.787004:0:96850:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e1618 00000020:00000040:2.0:1783074235.787005:0:96850:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c1706800 refcount=4 00000100:00000040:2.0:1783074235.787008:0:96850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 54 to 0@lo 00000020:00000040:2.0:1783074235.787010:0:96850:0:(genops.c:900:class_export_put()) PUTting export ffff9523c1706800 : new refcount 3 00000100:00080000:2.0:1783074235.787013:0:96850:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9524c3568000 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:2.0:1783074235.787024:0:96850:0:(genops.c:1231:class_import_get()) import ffff9524c3568000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:2.0:1783074235.787043:0:96850:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074235.787055:0:96850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f0e14e03] to pc [ptlrpcd_rcv+-1] req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783074235.787079:0:96850:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:2.0:1783074235.787082:0:96850:0:(genops.c:1231:class_import_get()) import ffff9524c3568000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1783074235.787238:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.787250:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723660032:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1783074235.787279:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783074245 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.787287:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.787342:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092d500 x1869685723660032 msgsize 520 00000100:00100000:0.0:1783074235.787347:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074235.787367:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783074245 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.787378:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000020:00000040:0.0:1783074235.787487:0:96850:0:(genops.c:889:class_export_get()) GET export ffff9523c1706800 refcount=4 00000020:00000040:0.0:1783074235.787492:0:96850:0:(genops.c:889:class_export_get()) GET export ffff9523c1706800 refcount=5 00000100:00000040:0.0:1783074235.787525:0:96850:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.204.126@tcp 192.168.204.126@tcp cnt=1 00000020:01000004:0.0:1783074235.787539:0:96850:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783074235.787550:0:96850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) 00000020:00000040:0.0:1783074235.787554:0:96850:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c4c4e000 with handle 0x5fb609b3016e161f to hash 00000020:00000040:0.0:1783074235.787558:0:96850:0:(genops.c:900:class_export_put()) PUTting export ffff9523c4c4e000 : new refcount 1 00000020:00000040:0.0:1783074235.787566:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) now 2 - obd_device_list 00000020:00000080:0.0:1783074235.787570:0:96850:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1783074235.787690:0:96850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9523c4c49000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783074235.787694:0:96850:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9523c4c49000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783074235.787696:0:96850:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9523c4c49000 3 00000020:00000040:0.0:1783074235.787709:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) now 3 - import 00000020:00000040:0.0:1783074235.787714:0:96850:0:(genops.c:1244:class_import_put()) import ffff9524ee2c5800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1783074235.787722:0:96850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 55 to 0@lo 00000100:00000040:0.0:1783074235.787726:0:96850:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 55 to 0@lo 00000100:00000040:0.0:1783074235.787729:0:96850:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.126@tcp -> ffff9524c5d54000 00000100:00000040:1.0:1783074235.787730:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00080000:0.0:1783074235.787733:0:96850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9524ee2c5800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.126@tcp at head 00000020:00000040:1.0:1783074235.787740:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c2e07000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1783074235.787754:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.787773:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006fb7ebd5] to pc [ptlrpcd_00_02+2] req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.787793:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783074235.787800:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524f778d800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783074235.787808:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.787817:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a34fdd00] to pc [ptlrpcd_00_03+3] req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.787826:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783074235.787830:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524f0d24800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783074235.787836:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.787844:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007f6a24a5] to pc [ptlrpcd_00_00+0] req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074235.787859:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074235.787863:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783074235.787865:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783074235.787869:0:53092:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3073 00000100:00080000:1.0:1783074235.787872:0:53092:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:1.0:1783074235.787874:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 54 to 0@lo 00000100:00000040:1.0:1783074235.787877:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 55 to 0@lo 00000020:00000040:1.0:1783074235.787879:0:53092:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fdc 00000020:00000040:1.0:1783074235.787881:0:53092:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c32cf000 refcount=4 00000100:00000040:1.0:1783074235.787884:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 54 to 0@lo 00000100:00000040:1.0:1783074235.787893:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 55 to 0@lo 00000020:00000040:1.0:1783074235.787895:0:53092:0:(genops.c:900:class_export_put()) PUTting export ffff9523c32cf000 : new refcount 3 00000100:00080000:1.0:1783074235.787897:0:53092:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9523c1efd800 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:1.0:1783074235.787904:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c1efd800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1783074235.787914:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.787922:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000040dd303b] to pc [ptlrpcd_rcv+-1] req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.787938:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783074235.787944:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524f0d27800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783074235.787951:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.787957:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783074235.787972:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723660544:0@lo:8:kworker.0 00000100:00000040:1.0:1783074235.787975:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e2141f78] to pc [ptlrpcd_00_01+1] req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.787993:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074255 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.787997:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1783074235.788005:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1783074235.788008:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c4d13000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1783074235.788019:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074235.788027:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092fb80 x1869685723660544 msgsize 520 00000100:00000040:1.0:1783074235.788029:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000238b9d7a] to pc [ptlrpcd_00_02+2] req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.788040:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.788045:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783074235.788052:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524c6211000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783074235.788064:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074235.788064:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074255 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788090:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007d0b4fe7] to pc [ptlrpcd_00_03+3] req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.788092:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2971 usecs (3 jiffies) 00000100:00080000:1.0:1783074235.788107:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783074235.788110:0:53092:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783074235.788112:0:53092:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783074235.788115:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660544 00000100:00080000:1.0:1783074235.788117:0:53092:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3073 00000100:00080000:1.0:1783074235.788122:0:53092:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1783074235.788123:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660544 00000100:00000040:1.0:1783074235.788126:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 54 to 0@lo 00000020:00000040:0.0:1783074235.788128:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9ff1 00000100:00000040:1.0:1783074235.788132:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 55 to 0@lo 00000020:00000040:1.0:1783074235.788135:0:53092:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ac 00000020:00000040:1.0:1783074235.788138:0:53092:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c4400000 refcount=4 00000100:00000040:1.0:1783074235.788141:0:53092:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 54 to 0@lo 00000100:00000040:1.0:1783074235.788143:0:53092:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 55 to 0@lo 00000020:00000040:1.0:1783074235.788146:0:53092:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4400000 : new refcount 3 00000100:00080000:1.0:1783074235.788149:0:53092:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9523c6a63800 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:1.0:1783074235.788156:0:53092:0:(genops.c:1231:class_import_get()) import ffff9523c6a63800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783074235.788164:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5016 00000100:00100000:1.0:1783074235.788167:0:53092:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074235.788172:0:8444:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092fb80 x1869685723660544/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788182:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000afad0574] to pc [ptlrpcd_rcv+-1] req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.788190:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1869685723660544:12345-0@lo:8:kworker.0 00000100:00000040:1.0:1783074235.788202:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783074235.788207:0:8444:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 7 - find 00000020:00000040:1.0:1783074235.788209:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524c7838000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00010000:00000040:0.0:1783074235.788214:0:8444:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000100:00000040:1.0:1783074235.788220:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783074235.788228:0:8444:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9524fa860000) now 7 - find 00000100:00000040:1.0:1783074235.788235:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea5ae2e1] to pc [ptlrpcd_00_00+0] req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788244:0:53092:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1783074235.788245:0:8444:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 56 to 0@lo 00000100:00000040:0.0:1783074235.788249:0:8444:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 56 to 0@lo 00000100:00000040:0.0:1783074235.788257:0:8444:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1783074235.788259:0:53092:0:(genops.c:1231:class_import_get()) import ffff9524de7c4800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1783074235.788271:0:53092:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074235.788279:0:8444:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074255 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788283:0:53092:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000078a6cb3d] to pc [ptlrpcd_00_01+1] req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788303:0:53092:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3080) 00000100:00000040:0.0:1783074235.788305:0:8444:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 55 to 0@lo 00000100:00000040:0.0:1783074235.788339:0:8444:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092fb80 x1869685723660544/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788349:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.788351:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1869685723660544:12345-0@lo:8:kworker.0 Request processed in 162us (320us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783074235.788367:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5016 00000100:00100000:1.0:1783074235.788370:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723660160:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.788388:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788398:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.788406:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788416:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf4700 x1869685723660160 msgsize 224 00000100:00100000:0.0:1783074235.788419:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723661056:0@lo:8:kworker.0 00000100:00100000:1.0:1783074235.788426:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074235.788441:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074255 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.788446:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.788457:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.788466:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 6020 usecs (7 jiffies) 00000100:00000040:0.0:1783074235.788477:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092c380 x1869685723661056 msgsize 520 00000100:00100000:0.0:1783074235.788482:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074235.788498:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074255 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.788509:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 2358 usecs (3 jiffies) 00000100:00000040:0.0:1783074235.788526:0:3657:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968718 00000100:00000040:0.0:1783074235.788532:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074235.788541:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074235.788545:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1783074235.788557:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.788565:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723660544:0@lo:8:kworker.0 00000100:00000040:0.0:1783074235.788571:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf4a80 x1869685723660544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.788579:0:3657:0:(genops.c:1244:class_import_put()) import ffff9523c1efd800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000020:00000040:0.0:1783074235.788593:0:96851:0:(genops.c:889:class_export_get()) GET export ffff9523c1706800 refcount=6 00000020:00000040:0.0:1783074235.788596:0:96851:0:(genops.c:889:class_export_get()) GET export ffff9523c1706800 refcount=7 00000020:00000040:0.0:1783074235.788599:0:96851:0:(genops.c:900:class_export_put()) PUTting export ffff9523c1706800 : new refcount 6 00000100:00100000:2.0:1783074235.788737:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660032 00000100:00100000:2.0:1783074235.788742:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660032 00000020:00000040:2.0:1783074235.788744:0:66200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1783074235.788769:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660160 00000100:00100000:2.0:1783074235.788772:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660160 00000020:00000040:2.0:1783074235.788774:0:66200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0803 00000100:00100000:0.0:1783074235.788774:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000020:00000040:2.0:1783074235.788777:0:66200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fb6b7000 refcount=5 00000100:00000040:0.0:1783074235.788779:0:66202:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092d500 x1869685723660032/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783074255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.788787:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869685723660032:12345-0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783074235.788791:0:66200:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000020:00000040:0.0:1783074235.788796:0:66202:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 14 - find 00010000:00000040:0.0:1783074235.788803:0:66202:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783074235.788809:0:66202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3075 last 0 00000020:00000040:0.0:1783074235.788816:0:66202:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c4e7f000 with handle 0x5fb609b3016e1626 to hash 00000100:00100000:2.0:1783074235.788818:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00000040:2.0:1783074235.788821:0:66200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fb6b7000 : new rpc_count 1 00000100:00000040:2.0:1783074235.788826:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf4700 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.788835:0:66202:0:(genops.c:889:class_export_get()) GET export ffff9523c4e7f000 refcount=3 00000100:00100000:2.0:1783074235.788836:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723660160:12345-0@lo:400:kworker.0 00000020:00000040:0.0:1783074235.788838:0:66202:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 15 - export 00000020:00000040:0.0:1783074235.788841:0:66202:0:(genops.c:900:class_export_put()) PUTting export ffff9523c4e7f000 : new refcount 2 00000020:00000080:0.0:1783074235.788843:0:66202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb609b3016e1626 00000020:00000040:0.0:1783074235.788845:0:66202:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e1626 00000020:00000040:0.0:1783074235.788846:0:66202:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c4e7f000 refcount=3 00010000:00000040:2.0:1783074235.788850:0:66200:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723660160 00000001:00000040:0.0:1783074235.788853:0:66202:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.126@tcp 00000100:00000040:2.0:1783074235.788855:0:66200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 56 to 0@lo 00000001:00000040:0.0:1783074235.788857:0:66202:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 17 00000100:00000040:2.0:1783074235.788859:0:66200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1783074235.788861:0:66202:0:(genops.c:889:class_export_get()) GET export ffff9523c4e7f000 refcount=4 00000001:00000040:0.0:1783074235.788863:0:66202:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 18 00000001:00000040:0.0:1783074235.788867:0:66202:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9524e41c5800) : new refcount 17 00000004:00100000:0.0:1783074235.788877:0:66202:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:0.0:1783074235.788885:0:66202:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9523cec81840 for nid 0@lo - ref 6 00000020:00000040:0.0:1783074235.788894:0:66202:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 16 - import 00000020:00000040:0.0:1783074235.788899:0:66202:0:(genops.c:1244:class_import_put()) import ffff9523c4e7d800 refcount=1 obd=lustre-MDT0000 00000020:00000040:0.0:1783074235.788905:0:66202:0:(genops.c:889:class_export_get()) GET export ffff9523c4e7f000 refcount=5 00000100:00000040:0.0:1783074235.788908:0:66202:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9523c4e7f000 : new rpc_count 1 00000100:00000040:0.0:1783074235.788911:0:66202:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 57 to 0@lo 00000100:00000040:0.0:1783074235.788914:0:66202:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 57 to 0@lo 00000020:00000040:0.0:1783074235.788916:0:66202:0:(genops.c:889:class_export_get()) GET export ffff9523c4e7f000 refcount=6 00000100:00000040:0.0:1783074235.788921:0:66202:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00080000:0.0:1783074235.788927:0:66202:0:(import.c:65:import_set_state_nolock()) ffff9523c4e7d800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783074235.788931:0:66202:0:(genops.c:900:class_export_put()) PUTting export ffff9523c4e7f000 : new refcount 5 00000020:00000040:0.0:1783074235.788934:0:66202:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9524fb4d8000) now 16 - find 00010000:00000040:0.0:1783074235.788942:0:66202:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723660032 00000100:00000040:0.0:1783074235.788947:0:66202:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 59 to 0@lo 00000100:00000040:0.0:1783074235.788952:0:66202:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1783074235.788972:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661056 00000100:00100000:3.0:1783074235.788977:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661056 00000020:00000040:3.0:1783074235.788979:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ba 00000100:00100000:3.0:1783074235.789004:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5017 00000100:00000040:2.0:1783074235.789008:0:66200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.789011:0:66202:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783074245 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.789015:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092c380 x1869685723661056/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.789042:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869685723661056:12345-0@lo:8:kworker.0 00000100:00000040:0.0:1783074235.789046:0:66202:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00000040:2.0:1783074235.789049:0:66200:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 57 to 0@lo 00000020:00000040:3.0:1783074235.789053:0:8443:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 7 - find 00000100:00000040:2.0:1783074235.789055:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4700 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.789055:0:66202:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092d500 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783074255 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783074235.789061:0:8443:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1783074235.789066:0:8443:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9524fa860000) now 7 - find 00000100:00100000:2.0:1783074235.789077:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869685723660160:12345-0@lo:400:kworker.0 Request processed in 239us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074235.789077:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869685723660032:12345-0@lo:38:llog_process_th.0 Request processed in 286us (1731us total) trans 0 rc 0/0 00000100:00000040:3.0:1783074235.789080:0:8443:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00000040:3.0:1783074235.789086:0:8443:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00100000:0.0:1783074235.789090:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00000040:3.0:1783074235.789095:0:8443:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.789096:0:66202:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c4e7f000 : new rpc_count 0 00000020:00000040:0.0:1783074235.789105:0:66202:0:(genops.c:900:class_export_put()) PUTting export ffff9523c4e7f000 : new refcount 4 00000100:00000040:3.0:1783074235.789118:0:8443:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074255 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.789121:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00000040:2.0:1783074235.789127:0:66200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fb6b7000 : new rpc_count 0 00000020:00000040:2.0:1783074235.789136:0:66200:0:(genops.c:900:class_export_put()) PUTting export ffff9524fb6b7000 : new refcount 4 00000100:00000040:3.0:1783074235.789153:0:8443:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 57 to 0@lo 00000100:00000040:3.0:1783074235.789157:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092c380 x1869685723661056/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.789163:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869685723661056:12345-0@lo:8:kworker.0 Request processed in 122us (685us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783074235.789168:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5017 00000100:00000040:1.0:1783074235.789285:0:3660:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783074235.789292:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789301:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789328:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869685723660160:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789336:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789357:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723660800:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789371:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789379:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.789394:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf5880 x1869685723660800 msgsize 224 00000100:00100000:1.0:1783074235.789398:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.789417:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789427:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 56266 usecs (57 jiffies) 00000100:00000040:1.0:1783074235.789434:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf7b80 x1869685723660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.789443:0:3660:0:(genops.c:1244:class_import_put()) import ffff9523c2e07000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1783074235.789454:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:1.0:1783074235.789459:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789468:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723660288:0@lo:400:kworker.0 00000100:00100000:3.0:1783074235.789480:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660800 00000100:00100000:3.0:1783074235.789484:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660800 00000100:00000040:1.0:1783074235.789484:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.789488:0:68632:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e080a 00000020:00000040:3.0:1783074235.789492:0:68632:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316d800 refcount=5 00000100:00000040:1.0:1783074235.789499:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.789506:0:68632:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1783074235.789516:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf7b80 x1869685723660288 msgsize 224 00000100:00100000:1.0:1783074235.789524:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074235.789528:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00000040:3.0:1783074235.789531:0:68632:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316d800 : new rpc_count 1 00000100:00000040:3.0:1783074235.789535:0:68632:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf5880 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789545:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789555:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 5730 usecs (6 jiffies) 00000100:00000040:1.0:1783074235.789562:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789584:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723660928:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789599:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789606:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.789621:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf4a80 x1869685723660928 msgsize 224 00000100:00100000:1.0:1783074235.789625:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.789637:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789647:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1948 usecs (2 jiffies) 00000100:00000040:1.0:1783074235.789682:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789697:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723660416:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789712:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789719:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.789735:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9523c76c0000 x1869685723660416 msgsize 224 00000100:00100000:1.0:1783074235.789740:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074235.789746:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723660800:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789756:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783074235.789761:0:68632:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723660800 00000100:00000040:1.0:1783074235.789768:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2642018 usecs (2643 jiffies) 00000100:00000040:3.0:1783074235.789776:0:68632:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00000040:1.0:1783074235.789778:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.789785:0:68632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1783074235.789791:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723661184:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789806:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789822:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.789838:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9523c76c2d80 x1869685723661184 msgsize 224 00000100:00100000:1.0:1783074235.789842:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.789858:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789867:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 3793 usecs (4 jiffies) 00000100:00100000:1.0:1783074235.789878:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1783074235.789883:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789891:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723660672:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789904:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789911:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.789928:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9523c76c1f80 x1869685723660672 msgsize 224 00000100:00100000:1.0:1783074235.789932:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.789947:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789957:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 3067 usecs (4 jiffies) 00000100:00000040:1.0:1783074235.789963:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.789972:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524debf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723661312:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.789984:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.789985:0:3657:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968736 00000100:00000040:0.0:1783074235.789995:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.789997:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.790011:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc304000 x1869685723661312 msgsize 224 00000100:00100000:1.0:1783074235.790022:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783074235.790025:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783074235.790031:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1783074235.790036:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790038:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.790047:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723661056:0@lo:8:kworker.0 00000100:00000040:1.0:1783074235.790064:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 2692 usecs (3 jiffies) 00000100:00100000:0.0:1783074235.790068:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1783074235.790072:0:3657:0:(client.c:3221:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1783074235.790077:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074235.790087:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00100000:1.0:1783074235.790088:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660288 00000020:00000040:0.0:1783074235.790090:0:3657:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e1618 00000100:00100000:1.0:1783074235.790094:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660288 00000020:00000040:0.0:1783074235.790095:0:3657:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c1706800 refcount=7 00000020:00000040:1.0:1783074235.790098:0:67186:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016da084 00000020:00000040:1.0:1783074235.790103:0:67186:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f41aa800 refcount=5 00000100:00080000:0.0:1783074235.790103:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1783074235.790109:0:3657:0:(genops.c:900:class_export_put()) PUTting export ffff9523c1706800 : new refcount 6 00000100:00080000:0.0:1783074235.790113:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783074235.790116:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524c3568000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1783074235.790122:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074245 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790126:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661312 00000100:00100000:1.0:1783074235.790131:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661312 00000100:00100000:0.0:1783074235.790135:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f091ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869685723660032:0@lo:38:llog_process_th.0 00000020:00000040:1.0:1783074235.790136:0:67186:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0811 00000020:00000040:1.0:1783074235.790141:0:67186:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc3c4800 refcount=5 00000100:00000040:0.0:1783074235.790146:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf5180 x1869685723661056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783074255 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.790156:0:3657:0:(genops.c:1244:class_import_put()) import ffff9523c6a63800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1783074235.790160:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00000040:1.0:1783074235.790163:0:67186:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f41aa800 : new rpc_count 1 00000100:00000040:0.0:1783074235.790165:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f091ad80 x1869685723660032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074245 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790171:0:67186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf7b80 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.790188:0:68632:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790191:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723660288:12345-0@lo:400:kworker.0 00000020:00000040:0.0:1783074235.790206:0:3657:0:(genops.c:1244:class_import_put()) import ffff9524c3568000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00010000:00000040:1.0:1783074235.790207:0:67186:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723660288 00000100:00000040:1.0:1783074235.790215:0:67186:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 59 to 0@lo 00000100:00000040:1.0:1783074235.790219:0:67186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.790226:0:68632:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00000040:3.0:1783074235.790233:0:68632:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf5880 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790239:0:67186:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.790248:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869685723660800:12345-0@lo:400:kworker.0 Request processed in 703us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.790259:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00000040:1.0:1783074235.790262:0:67186:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 57 to 0@lo 00000100:00000040:3.0:1783074235.790263:0:68632:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316d800 : new rpc_count 0 00000100:00000040:1.0:1783074235.790269:0:67186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf7b80 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.790276:0:68632:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316d800 : new refcount 4 00000100:00100000:1.0:1783074235.790280:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723660288:12345-0@lo:400:kworker.0 Request processed in 92us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.790289:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00000040:1.0:1783074235.790292:0:67186:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f41aa800 : new rpc_count 0 00000100:00100000:3.0:1783074235.790296:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000020:00000040:1.0:1783074235.790303:0:67186:0:(genops.c:900:class_export_put()) PUTting export ffff9524f41aa800 : new refcount 4 00000100:00000040:3.0:1783074235.790344:0:68632:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc3c4800 : new rpc_count 1 00000100:00100000:1.0:1783074235.790346:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661184 00000100:00100000:1.0:1783074235.790351:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661184 00000100:00000040:3.0:1783074235.790353:0:68632:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc304000 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.790354:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06cf 00000020:00000040:1.0:1783074235.790359:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c6e2d800 refcount=5 00000100:00100000:3.0:1783074235.790376:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723661312:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.790377:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00010000:00000040:3.0:1783074235.790392:0:68632:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723661312 00000100:00100000:1.0:1783074235.790398:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660672 00000100:00000040:3.0:1783074235.790399:0:68632:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00100000:1.0:1783074235.790402:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660672 00000100:00000040:3.0:1783074235.790407:0:68632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1783074235.790407:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fff 00000020:00000040:1.0:1783074235.790411:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524e010a000 refcount=5 00000100:00100000:1.0:1783074235.790439:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00000040:1.0:1783074235.790442:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524c6e2d800 : new rpc_count 1 00000100:00000040:1.0:1783074235.790445:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c76c2d80 x1869685723661184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790457:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723661184:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783074235.790468:0:8445:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968716, transno 0, xid 1869685723661184 00000100:00000040:1.0:1783074235.790472:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 59 to 0@lo 00000100:00000040:1.0:1783074235.790475:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.790492:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790510:0:8445:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00000040:1.0:1783074235.790515:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c76c2d80 x1869685723661184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.790523:0:68632:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790526:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723661184:12345-0@lo:400:kworker.0 Request processed in 70us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.790541:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00000040:1.0:1783074235.790544:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524c6e2d800 : new rpc_count 0 00000020:00000040:1.0:1783074235.790552:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff9524c6e2d800 : new refcount 4 00000100:00000040:3.0:1783074235.790559:0:68632:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 57 to 0@lo 00000100:00100000:1.0:1783074235.790564:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00000040:1.0:1783074235.790567:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524e010a000 : new rpc_count 1 00000100:00000040:3.0:1783074235.790568:0:68632:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc304000 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790581:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c76c1f80 x1869685723660672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.790583:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723661312:12345-0@lo:400:kworker.0 Request processed in 212us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.790602:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723660672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074235.790613:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00010000:00000040:1.0:1783074235.790616:0:8445:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968702, transno 0, xid 1869685723660672 00000100:00000040:3.0:1783074235.790617:0:68632:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc3c4800 : new rpc_count 0 00000100:00000040:1.0:1783074235.790625:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000020:00000040:3.0:1783074235.790629:0:68632:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc3c4800 : new refcount 4 00000100:00000040:1.0:1783074235.790630:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.790645:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790657:0:8445:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 57 to 0@lo 00000100:00000040:1.0:1783074235.790660:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c76c1f80 x1869685723660672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790668:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723660672:12345-0@lo:400:kworker.0 Request processed in 70us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.790686:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00000040:1.0:1783074235.790688:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524e010a000 : new rpc_count 0 00000020:00000040:1.0:1783074235.790694:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff9524e010a000 : new refcount 4 00000100:00100000:1.0:1783074235.790716:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660928 00000100:00100000:1.0:1783074235.790720:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660928 00000020:00000040:1.0:1783074235.790722:0:26189:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06a5 00000020:00000040:1.0:1783074235.790724:0:26189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7805000 refcount=5 00000100:00000040:1.0:1783074235.790734:0:26189:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783074235.790751:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723660416 00000100:00100000:1.0:1783074235.790754:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723660416 00000020:00000040:1.0:1783074235.790755:0:26189:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e065f 00000020:00000040:1.0:1783074235.790758:0:26189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc207800 refcount=7 00000100:00100000:1.0:1783074235.790777:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00000040:1.0:1783074235.790780:0:26189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7805000 : new rpc_count 1 00000100:00000040:1.0:1783074235.790785:0:26189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf4a80 x1869685723660928/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.790793:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00000040:3.0:1783074235.790797:0:8453:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc207800 : new rpc_count 1 00000100:00000040:3.0:1783074235.790801:0:8453:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c76c0000 x1869685723660416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790825:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723660928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074235.790830:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c76c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723660416:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783074235.790839:0:26189:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723660928 00000100:00000040:1.0:1783074235.790846:0:26189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00010000:00000040:3.0:1783074235.790847:0:8453:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1869685723660416 00000100:00000040:1.0:1783074235.790852:0:26189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.790856:0:8453:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 59 to 0@lo 00000100:00000040:3.0:1783074235.790862:0:8453:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.790870:0:26189:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790886:0:26189:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 58 to 0@lo 00000100:00000040:3.0:1783074235.790890:0:8453:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790894:0:26189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4a80 x1869685723660928/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.790911:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723660928:12345-0@lo:400:kworker.0 Request processed in 90us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.790918:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00000040:1.0:1783074235.790921:0:26189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7805000 : new rpc_count 0 00000020:00000040:1.0:1783074235.790928:0:26189:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7805000 : new refcount 4 00000100:00000040:3.0:1783074235.790934:0:8453:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 57 to 0@lo 00000100:00000040:3.0:1783074235.790938:0:8453:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c76c0000 x1869685723660416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:561/0 lens 224/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.790944:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c76c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1869685723660416:12345-0@lo:400:kworker.0 Request processed in 122us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.790949:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00000040:3.0:1783074235.790951:0:8453:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc207800 : new rpc_count 0 00000020:00000040:3.0:1783074235.790957:0:8453:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc207800 : new refcount 6 00000100:00000040:1.0:1783074235.790979:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968702 00000100:00000040:1.0:1783074235.790986:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.790994:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791000:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723660672:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791011:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783074235.791015:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.791023:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791037:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723661312:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791048:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:1.0:1783074235.791052:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.791061:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791067:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723660416:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791077:0:3658:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968716 00000100:00000040:1.0:1783074235.791081:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.791088:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791094:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723661184:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791100:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf5500 x1869685723660672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791108:0:3658:0:(genops.c:1244:class_import_put()) import ffff9524f0d27800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783074235.791115:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf4e00 x1869685723661312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791121:0:3658:0:(genops.c:1244:class_import_put()) import ffff9524de7c4800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1783074235.791126:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf5f80 x1869685723660416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791132:0:3658:0:(genops.c:1244:class_import_put()) import ffff9524f0d24800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783074235.791136:0:3658:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf6a00 x1869685723661184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791149:0:3658:0:(genops.c:1244:class_import_put()) import ffff9524c7838000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783074235.791169:0:3660:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783074235.791173:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.791181:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791187:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723660288:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791195:0:3660:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783074235.791199:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.791206:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791213:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723660928:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791224:0:3660:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783074235.791228:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.791236:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.791243:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524debf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869685723660800:0@lo:400:kworker.0 00000100:00000040:1.0:1783074235.791248:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf5c00 x1869685723660288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791256:0:3660:0:(genops.c:1244:class_import_put()) import ffff9524f778d800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783074235.791263:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf7100 x1869685723660928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791274:0:3660:0:(genops.c:1244:class_import_put()) import ffff9524c6211000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783074235.791278:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524debf6300 x1869685723660800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.791283:0:3660:0:(genops.c:1244:class_import_put()) import ffff9523c4d13000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00010000:00010000:0.0:1783074235.791562:0:96850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:0.0:1783074235.791642:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) now 4 - setup 00000020:00000080:0.0:1783074235.791646:0:96850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1783074235.791700:0:96850:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:0.0:1783074235.791707:0:96850:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9524f41ac000 with handle 0x5fb609b3016e162d to hash 00000020:00000040:0.0:1783074235.791712:0:96850:0:(genops.c:889:class_export_get()) GET export ffff9524f41ac000 refcount=3 00000020:00000040:0.0:1783074235.791716:0:96850:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) now 5 - export 00000020:00000040:0.0:1783074235.791718:0:96850:0:(genops.c:900:class_export_put()) PUTting export ffff9524f41ac000 : new refcount 2 00000020:00000080:0.0:1783074235.791720:0:96850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5fb609b3016e162d 00000020:00000040:0.0:1783074235.791722:0:96850:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e162d 00000020:00000040:0.0:1783074235.791724:0:96850:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f41ac000 refcount=3 00000100:00080000:0.0:1783074235.791730:0:96850:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:0.0:1783074235.791733:0:96850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 58 to 0@lo 00000020:00000040:0.0:1783074235.791735:0:96850:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e162d 00000020:00000040:0.0:1783074235.791737:0:96850:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f41ac000 refcount=4 00000100:00000040:0.0:1783074235.791739:0:96850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 59 to 0@lo 00000020:00000040:0.0:1783074235.791741:0:96850:0:(genops.c:900:class_export_put()) PUTting export ffff9524f41ac000 : new refcount 3 00000100:00080000:0.0:1783074235.791744:0:96850:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9524ee2c5800 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:0.0:1783074235.791755:0:96850:0:(genops.c:1231:class_import_get()) import ffff9524ee2c5800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:0.0:1783074235.791770:0:96850:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074235.791782:0:96850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000066db7883] to pc [ptlrpcd_rcv+-1] req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.791805:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.791813:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869685723661440:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1783074235.791838:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783074245 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.791846:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074235.791862:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092ce00 x1869685723661440 msgsize 520 00000100:00100000:0.0:1783074235.791866:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074235.791891:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783074245 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.791901:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00080000:0.0:1783074235.791926:0:96850:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:0.0:1783074235.791930:0:96850:0:(genops.c:1231:class_import_get()) import ffff9524ee2c5800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:0.0:1783074235.792016:0:96850:0:(genops.c:889:class_export_get()) GET export ffff9524f41ac000 refcount=4 00000020:00000040:0.0:1783074235.792020:0:96850:0:(genops.c:889:class_export_get()) GET export ffff9524f41ac000 refcount=5 00000040:00080000:0.0:1783074235.792079:0:96850:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000040:0.0:1783074235.792156:0:96853:0:(genops.c:900:class_export_put()) PUTting export ffff9524f41ac000 : new refcount 4 00000020:01000000:3.0:1783074235.792218:0:96839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1783074235.792252:0:96839:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:3.0:1783074235.792269:0:96839:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523c69bd000 refcount=3 00010000:00010000:3.0:1783074235.792276:0:96839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e160a expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074235.792295:0:96839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c69bd000/0x5fb609b3016e1603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e160a expref: -99 pid: 96839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783074235.792375:0:96839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783074235.792377:0:96839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783074235.792378:0:96839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074235.792379:0:96839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074235.792380:0:96839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074235.792382:0:96839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074235.792383:0:96839:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074235.792385:0:96839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074235.792386:0:96839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783074235.792389:0:96839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1783074235.792392:0:96839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783074235.792393:0:96839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783074235.792394:0:96839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074235.792395:0:96839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074235.792396:0:96839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074235.792397:0:96839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783074235.792398:0:96839:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074235.792399:0:96839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074235.792400:0:96839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:3.0:1783074235.792404:0:96839:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 10000000:01000000:3.0:1783074235.792416:0:96839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1783074235.792425:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.792434:0:96839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723661568:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1783074235.792451:0:96839:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.792458:0:96839:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074235.792478:0:96839:0:(events.c:337:request_in_callback()) incoming req@ffff9523c311b850 x1869685723661568 msgsize 4848 00000100:00100000:3.0:1783074235.792482:0:96839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.792491:0:96839:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074235.792517:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.792530:0:96839:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524d2eec240 going to sleep for 11 seconds 00000100:00100000:3.0:1783074235.792549:0:67186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661440 00000100:00100000:3.0:1783074235.792553:0:67186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661440 00000020:00000040:3.0:1783074235.792555:0:67186:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:3.0:1783074235.792583:0:67186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00000040:3.0:1783074235.792589:0:67186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092ce00 x1869685723661440/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783074255 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.792597:0:67186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869685723661440:12345-0@lo:38:llog_process_th.0 00000020:00000040:3.0:1783074235.792607:0:67186:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 10 - find 00010000:00000040:3.0:1783074235.792615:0:67186:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1783074235.792620:0:67186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3075 last 0 00000020:00000040:3.0:1783074235.792626:0:67186:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cd00a000 with handle 0x5fb609b3016e1634 to hash 00000020:00000040:3.0:1783074235.792650:0:67186:0:(genops.c:889:class_export_get()) GET export ffff9523cd00a000 refcount=3 00000020:00000040:3.0:1783074235.792654:0:67186:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 11 - export 00000020:00000040:3.0:1783074235.792657:0:67186:0:(genops.c:900:class_export_put()) PUTting export ffff9523cd00a000 : new refcount 2 00000020:00000080:3.0:1783074235.792659:0:67186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5fb609b3016e1634 00000020:00000040:3.0:1783074235.792660:0:67186:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e1634 00000020:00000040:3.0:1783074235.792662:0:67186:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523cd00a000 refcount=3 00000001:00000040:3.0:1783074235.792678:0:67186:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.126@tcp 00000001:00000040:3.0:1783074235.792683:0:67186:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 18 00000020:00000040:3.0:1783074235.792687:0:67186:0:(genops.c:889:class_export_get()) GET export ffff9523cd00a000 refcount=4 00000001:00000040:3.0:1783074235.792689:0:67186:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 19 00000001:00000040:3.0:1783074235.792693:0:67186:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9524e41c5800) : new refcount 18 00000100:00100000:2.0:1783074235.792693:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661568 00000100:00100000:2.0:1783074235.792698:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661568 00000004:00100000:3.0:1783074235.792699:0:67186:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1783074235.792699:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:2.0:1783074235.792703:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000020:00000040:3.0:1783074235.792707:0:67186:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9524c4fa4540 for nid 0@lo - ref 4 00000020:00000040:3.0:1783074235.792714:0:67186:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 12 - import 00000100:00000040:2.0:1783074235.792717:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000040:3.0:1783074235.792726:0:67186:0:(genops.c:1244:class_import_put()) import ffff9523cd00e000 refcount=1 obd=lustre-MDT0001 00000020:00000040:3.0:1783074235.792731:0:67186:0:(genops.c:889:class_export_get()) GET export ffff9523cd00a000 refcount=5 00000100:00000040:3.0:1783074235.792733:0:67186:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9523cd00a000 : new rpc_count 1 00000100:00100000:2.0:1783074235.792733:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1783074235.792736:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:3.0:1783074235.792738:0:67186:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 60 to 0@lo 00000100:00000040:3.0:1783074235.792740:0:67186:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 60 to 0@lo 00000100:00000040:2.0:1783074235.792740:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c311b850 x1869685723661568/t0(0) o253->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 4848/0 e 0 to 0 dl 1783074246 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.792743:0:67186:0:(genops.c:889:class_export_get()) GET export ffff9523cd00a000 refcount=6 00000100:00000040:3.0:1783074235.792747:0:67186:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00100000:2.0:1783074235.792750:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723661568:12345-0@lo:253:mount.lustre.0 00000100:00080000:3.0:1783074235.792753:0:67186:0:(import.c:65:import_set_state_nolock()) ffff9523cd00e000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1783074235.792758:0:67186:0:(genops.c:900:class_export_put()) PUTting export ffff9523cd00a000 : new refcount 5 00000020:00000040:3.0:1783074235.792761:0:67186:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9524fab73380) now 12 - find 00010000:00000040:3.0:1783074235.792770:0:67186:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723661440 20000000:01000000:2.0:1783074235.792770:0:94278:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00000040:3.0:1783074235.792776:0:67186:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:3.0:1783074235.792780:0:67186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 20000000:01000000:2.0:1783074235.792781:0:94278:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00000040:3.0:1783074235.792799:0:67186:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783074245 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074235.792821:0:67186:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00000040:3.0:1783074235.792826:0:67186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092ce00 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783074255 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074235.792834:0:67186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1869685723661440:12345-0@lo:38:llog_process_th.0 Request processed in 237us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074235.792841:0:67186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00000040:3.0:1783074235.792843:0:67186:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523cd00a000 : new rpc_count 0 00000020:00000040:3.0:1783074235.792851:0:67186:0:(genops.c:900:class_export_put()) PUTting export ffff9523cd00a000 : new refcount 4 00000100:00100000:0.0:1783074235.792947:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1783074235.792956:0:3657:0:(client.c:3221:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1783074235.792961:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783074235.792971:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:0.0:1783074235.792973:0:3657:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e162d 00000020:00000040:0.0:1783074235.792976:0:3657:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f41ac000 refcount=5 00000100:00080000:0.0:1783074235.792981:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1783074235.792983:0:3657:0:(genops.c:900:class_export_put()) PUTting export ffff9524f41ac000 : new refcount 4 00000100:00080000:0.0:1783074235.792986:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783074235.792988:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9524ee2c5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1783074235.792994:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074245 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074235.793001:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869685723661440:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1783074235.793013:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f092f480 x1869685723661440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783074245 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074235.793022:0:3657:0:(genops.c:1244:class_import_put()) import ffff9524ee2c5800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1783074235.793376:0:53092:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3080) 20000000:01000000:2.0:1783074235.798072:0:94278:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783074235.798086:0:94278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783074235.798104:0:94279:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783074235.798110:0:94279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:1.0:1783074235.798120:0:94279:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c8d7c400 count: 4 00000020:00000040:1.0:1783074235.798131:0:94279:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cb0eae00 with handle 0x5fb609b3016e163b to hash 00010000:00010000:1.0:1783074235.798139:0:94279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.798154:0:94279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.798160:0:94279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.798166:0:94279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.798170:0:94279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074235.798174:0:94279:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c8d7c400) refcount = 4 00010000:00000040:1.0:1783074235.798176:0:94279:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783074235.798178:0:94279:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074235.798183:0:94279:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074235.798197:0:94279:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074235.798201:0:94279:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:1.0:1783074235.798202:0:94279:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783074235.798218:0:94279:0:(genops.c:1231:class_import_get()) import ffff9524df200800 refcount=2 obd=MGS 00010000:00000040:2.0:1783074235.798224:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723661568 00010000:00010000:1.0:1783074235.798234:0:94279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.798238:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00010000:00010000:1.0:1783074235.798246:0:94279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 9 pid: 94277 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.798248:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.798259:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074235.798268:0:94279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc307800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723661696:192.168.204.26@tcp:104: 00000100:00000040:1.0:1783074235.798286:0:94279:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.798293:0:94279:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074235.798298:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.798355:0:94279:0:(genops.c:1231:class_import_get()) import ffff9524de7c0800 refcount=2 obd=MGS 00010000:00010000:1.0:1783074235.798364:0:94279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 24 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.798371:0:94279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 24 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074235.798379:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074235.798386:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00000040:2.0:1783074235.798397:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c311b850 x1869685723661568/t0(0) o253->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 4848/4768 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.798397:0:94279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc305c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723661824:0@lo:104: 00000100:00000040:3.0:1783074235.798407:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.798413:0:94279:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074235.798417:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:96839:x1869685723661568:12345-0@lo:253:mount.lustre.0 Request processed in 5664us (5933us total) trans 0 rc 0/0 00000100:00000040:1.0:1783074235.798437:0:94279:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783074235.798438:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:3.0:1783074235.798440:0:96839:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.798443:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:0.0:1783074235.798451:0:3653:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1783074235.798455:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00100000:3.0:1783074235.798457:0:96839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:522b6a34-04f4-4017-ab45-61a21d19bfef:96839:1869685723661568:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1783074235.798457:0:94279:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc304e00 x1869685723661824 msgsize 328 00000100:00100000:1.0:1783074235.798467:0:94279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074235.798481:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.798485:0:94279:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1783074235.798506:0:96839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:00000040:1.0:1783074235.798508:0:94279:0:(genops.c:1231:class_import_get()) import ffff9524de7c0800 refcount=3 obd=MGS 00000020:01000004:3.0:1783074235.798511:0:96839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783074235.798514:0:96839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00010000:1.0:1783074235.798517:0:94279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 23 pid: 94278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.798524:0:94279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 23 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074235.798529:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074235.798534:0:94279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4685880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723661952:0@lo:104: 00000100:00000040:1.0:1783074235.798540:0:94279:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.798544:0:94279:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.798551:0:94279:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4685500 x1869685723661952 msgsize 328 00000100:00100000:1.0:1783074235.798554:0:94279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074235.798569:0:94279:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000004:3.0:1783074235.798572:0:96839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783074235.798575:0:96839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783074235.798578:0:96839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783074235.798580:0:96839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:1.0:1783074235.798580:0:94279:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524fb7e5900 going to sleep for 11 seconds 00000020:01000004:3.0:1783074235.798582:0:96839:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783074235.798593:0:96839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783074235.798595:0:96839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783074235.798599:0:10348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661824 00000100:00100000:2.0:1783074235.798600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723661952 00000100:00000040:3.0:1783074235.798601:0:96839:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496d80 x1869685723661568/t0(0) o253->MGC192.168.204.126@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.798606:0:10348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661824 00000100:00100000:2.0:1783074235.798607:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723661952 00000020:00000040:2.0:1783074235.798611:0:6513:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b301699bed 00000020:00000040:1.0:1783074235.798616:0:10348:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b301699bed 00000020:00000040:2.0:1783074235.798617:0:6513:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524d1c87800 refcount=3 00000020:00000040:3.0:1783074235.798618:0:96839:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000020:00000040:1.0:1783074235.798621:0:10348:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524d1c87800 refcount=4 00000020:02000000:3.0:1783074235.798631:0:96839:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00000040:2.0:1783074235.798636:0:6513:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00002000:00000040:3.0:1783074235.798753:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:3.0:1783074235.798763:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00000100:00100000:1.0:1783074235.798789:0:10348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00000040:1.0:1783074235.798795:0:10348:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524d1c87800 : new rpc_count 1 00000100:00000040:1.0:1783074235.798800:0:10348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4685500 x1869685723661952/t0(0) o104->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074235.798810:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00000040:2.0:1783074235.798815:0:6513:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524d1c87800 : new rpc_count 2 00000100:00100000:1.0:1783074235.798816:0:10348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:94279:x1869685723661952:12345-0@lo:104: 00000100:00000040:2.0:1783074235.798823:0:6513:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc304e00 x1869685723661824/t0(0) o104->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000040:3.0:1783074235.798826:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00000020:00000040:1.0:1783074235.798827:0:10348:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524df2c8600 refcount=2 00000100:00100000:2.0:1783074235.798843:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:94279:x1869685723661824:12345-0@lo:104: 00010000:00010000:1.0:1783074235.798844:0:10348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783074235.798852:0:6513:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524df2c9400 refcount=2 00010000:00010000:2.0:1783074235.798859:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074235.798864:0:10348:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:1.0:1783074235.798872:0:10348:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074235.798880:0:6513:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 63 to 0@lo 00002000:00000040:3.0:1783074235.798884:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00000100:00000040:2.0:1783074235.798885:0:6513:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.798892:0:10348:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074235.798911:0:6513:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783074235.798918:0:10348:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 62 to 0@lo 00002000:00000040:3.0:1783074235.798931:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00000100:00000040:2.0:1783074235.798932:0:6513:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00010000:00010000:1.0:1783074235.798946:0:10348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1783074235.798954:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:1.0:1783074235.798954:0:10348:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4685500 x1869685723661952/t0(0) o104->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074235.798965:0:6513:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc304e00 x1869685723661824/t0(0) o104->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074235.798969:0:10348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:522b6a34-04f4-4017-ab45-61a21d19bfef+4:94279:x1869685723661952:12345-0@lo:104: Request processed in 156us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.798984:0:10348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00000040:1.0:1783074235.798986:0:10348:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524d1c87800 : new rpc_count 1 00000100:00100000:2.0:1783074235.798997:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:522b6a34-04f4-4017-ab45-61a21d19bfef+4:94279:x1869685723661824:12345-0@lo:104: Request processed in 158us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074235.799004:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000020:00000040:1.0:1783074235.799007:0:10348:0:(genops.c:900:class_export_put()) PUTting export ffff9524d1c87800 : new refcount 3 00000100:00000040:2.0:1783074235.799008:0:6513:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524d1c87800 : new rpc_count 0 00000020:00000040:2.0:1783074235.799019:0:6513:0:(genops.c:900:class_export_put()) PUTting export ffff9524d1c87800 : new refcount 2 00010000:00010000:1.0:1783074235.799032:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783074235.799039:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.799057:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c8600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074235.799061:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783074235.799069:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524df2c8600 refcount=3 00010000:00010000:1.0:1783074235.799074:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074235.799081:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1783074235.799086:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 10000000:01000000:1.0:1783074235.799088:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:1.0:1783074235.799091:0:6517:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:1.0:1783074235.799094:0:6517:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:1.0:1783074235.799107:0:6517:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9523c4514c00) refs 2 00000020:00000040:1.0:1783074235.799114:0:6517:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9524df2c8600 with handle 0x5fb609b3016e0715 from hash 00000020:00000040:1.0:1783074235.799122:0:6517:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00010000:00010000:1.0:1783074235.799134:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1783074235.799135:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00010000:00010000:1.0:1783074235.799144:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:1.0:1783074235.799155:0:6517:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d157baa8] to pc [ptlrpcd_00_02+2] req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00002000:00000040:3.0:1783074235.799172:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00010000:00010000:1.0:1783074235.799182:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.799188:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783074235.799194:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c8600/0x5fb609b3016e0715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e071c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074235.799209:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723662080:0@lo:103:ldlm_bl.0 00002000:00000040:3.0:1783074235.799218:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00000100:00000040:2.0:1783074235.799231:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783074235.799233:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783074235.799238:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.799254:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:1.0:1783074235.799256:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9524df2c9400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1783074235.799260:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1783074235.799264:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000020:00000040:1.0:1783074235.799268:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524df2c9400 refcount=3 00000100:00000040:2.0:1783074235.799273:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0919f80 x1869685723662080 msgsize 328 00010000:00010000:1.0:1783074235.799274:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783074235.799286:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783074235.799292:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783074235.799297:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00000040:1.0:1783074235.799297:0:6517:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:1.0:1783074235.799302:0:6517:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:1.0:1783074235.799339:0:6517:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9524c3553a00) refs 2 00000100:00000040:2.0:1783074235.799340:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.799347:0:6517:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9524df2c9400 with handle 0x5fb609b3016e0731 from hash 00000020:00000040:1.0:1783074235.799355:0:6517:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00010000:00010000:1.0:1783074235.799365:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.799371:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783074235.799378:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662080 00000100:00000040:1.0:1783074235.799380:0:6517:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000057887d9b] to pc [ptlrpcd_00_03+3] req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.799384:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662080 00000020:00000040:2.0:1783074235.799388:0:19654:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:2.0:1783074235.799393:0:19654:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00000040:2.0:1783074235.799405:0:19654:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00010000:00010000:1.0:1783074235.799407:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783074235.799411:0:19654:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524edcc6e00 refcount=5 00010000:00010000:2.0:1783074235.799419:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 24 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074235.799438:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9524df2c9400/0x5fb609b3016e0731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb609b3016e0738 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074235.799445:0:6517:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9524fc360d00 count: 0 00010000:00010000:1.0:1783074235.799456:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783074235.799459:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783074235.799460:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00010000:00010000:1.0:1783074235.799461:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1783074235.799466:0:19654:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00010000:00010000:1.0:1783074235.799469:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1783074235.799478:0:19654:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0919f80 x1869685723662080/t0(0) o103->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.799482:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.799498:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723662080:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783074235.799501:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723662208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783074235.799509:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1783074235.799512:0:19654:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524edcc6e00 refcount=5 00010000:00000040:2.0:1783074235.799514:0:19654:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c8d7c400 count: 5 00010000:00010000:2.0:1783074235.799517:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 24 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074235.799520:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783074235.799530:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 24 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074235.799534:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1783074235.799546:0:19654:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9524edcc6e00 with handle 0x5fb609b3016e071c from hash 00010000:00000040:2.0:1783074235.799551:0:19654:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9523cb0eae00 00000100:00000040:1.0:1783074235.799553:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff9523c20c2d80 x1869685723662208 msgsize 328 00010000:00010000:2.0:1783074235.799555:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783074235.799561:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074235.799563:0:19654:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:2.0:1783074235.799569:0:19654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.799582:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.799587:0:19654:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.799618:0:19654:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00000040:3.0:1783074235.799621:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074235.799624:0:19654:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0919f80 x1869685723662080/t0(0) o103->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.799639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662208 00000100:00000040:3.0:1783074235.799646:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.799646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662208 00000020:00000040:1.0:1783074235.799651:0:6514:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000100:00100000:2.0:1783074235.799652:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3660:x1869685723662080:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (374us total) trans 0 rc 0/0 00000020:00000040:1.0:1783074235.799657:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=25 00000100:00100000:2.0:1783074235.799679:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1783074235.799681:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:522b6a34-04f4-4017-ab45-61a21d19bfef:3660:1869685723662080:0@lo:103:ldlm_bl.0 00000020:00000040:1.0:1783074235.799683:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524edcc6600 refcount=5 00000100:00000040:2.0:1783074235.799684:0:19654:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00010000:00010000:1.0:1783074235.799693:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 25 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783074235.799697:0:19654:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 24 00000100:00000040:0.0:1783074235.799698:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783074235.799703:0:3660:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4686a00 x1869685723662080/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074235.799733:0:3660:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:0.0:1783074235.799733:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783074235.799737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00000040:1.0:1783074235.799744:0:6514:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00100000:0.0:1783074235.799748:0:94279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc305c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723661824:0@lo:104: 00000100:00000040:1.0:1783074235.799759:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c20c2d80 x1869685723662208/t0(0) o103->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074235.799764:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783074235.799782:0:94279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6e00/0x5fb609b3016e071c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0715 expref: 24 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074235.799786:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723662208:12345-0@lo:103:ldlm_bl.0 00010000:00000040:0.0:1783074235.799796:0:94279:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9524f7804800 : new locks_count 17 00010000:00010000:1.0:1783074235.799799:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1783074235.799800:0:94279:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000020:00000040:1.0:1783074235.799804:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524edcc6600 refcount=4 00010000:00000040:1.0:1783074235.799809:0:6514:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c8d7c400 count: 4 00000100:00000040:0.0:1783074235.799810:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783074235.799815:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 23 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074235.799828:0:94279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4685880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723661952:0@lo:104: 00010000:00010000:1.0:1783074235.799834:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 23 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783074235.799845:0:6514:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9524edcc6600 with handle 0x5fb609b3016e0738 from hash 00010000:00010000:1.0:1783074235.799850:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6600/0x5fb609b3016e0738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb609b3016e0731 expref: 23 pid: 94278 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074235.799856:0:6514:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9524f7804800 : new locks_count 16 00000020:00000040:1.0:1783074235.799858:0:6514:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00010000:00000040:1.0:1783074235.799863:0:6514:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9523cb0eae00 00010000:00010000:1.0:1783074235.799866:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1783074235.799870:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:1.0:1783074235.799873:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074235.799890:0:6514:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074235.799920:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00000040:1.0:1783074235.799924:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c20c2d80 x1869685723662208/t0(0) o103->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:561/0 lens 328/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074235.799933:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:3661:x1869685723662208:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074235.799949:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00000040:1.0:1783074235.799952:0:6514:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:2.0:1783074235.799956:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074235.799961:0:6514:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 21 00000100:00000040:2.0:1783074235.799971:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.799977:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723662208:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1783074235.799982:0:3661:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4687100 x1869685723662208/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074235.799988:0:3661:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000100:00000040:0.0:1783074235.800191:0:3651:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783074235.800243:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783074235.800246:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092f480 x1869685708159872 msgsize 328 00000100:00100000:0.0:1783074235.800258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:2.0:1783074235.800262:0:94279:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783074235.800269:0:94279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc307800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94279:1869685723661696:192.168.204.26@tcp:104: 00000100:00000040:2.0:1783074235.800276:0:94279:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc305c00 x1869685723661824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1783074235.800289:0:94279:0:(genops.c:1244:class_import_put()) import ffff9524de7c0800 refcount=2 obd=MGS 00000100:00000040:2.0:1783074235.800298:0:94279:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9523c4685880 x1869685723661952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1783074235.800304:0:94279:0:(genops.c:1244:class_import_put()) import ffff9524de7c0800 refcount=1 obd=MGS 00000100:00000040:2.0:1783074235.800327:0:94279:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc307800 x1869685723661696/t0(0) o104->MGS@192.168.204.26@tcp:15/16 lens 328/224 e 0 to 0 dl 1783074251 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1783074235.800335:0:94279:0:(genops.c:1244:class_import_put()) import ffff9524df200800 refcount=1 obd=MGS 00010000:00010000:2.0:1783074235.800344:0:94279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074235.800365:0:19655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708159872 00000100:00100000:2.0:1783074235.800369:0:19655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708159872 00000020:00000040:2.0:1783074235.800371:0:19655:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e07d9 00000020:00000040:2.0:1783074235.800391:0:19655:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524df202800 refcount=10 00000100:00000040:2.0:1783074235.800402:0:19655:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:2.0:1783074235.800407:0:19655:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524edcc6000 refcount=4 00010000:00010000:2.0:1783074235.800411:0:19655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 10 pid: 94277 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074235.800437:0:19655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2637 00000100:00000040:2.0:1783074235.800440:0:19655:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524df202800 : new rpc_count 1 00000100:00000040:2.0:1783074235.800444:0:19655:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092f480 x1869685708159872/t0(0) o103->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:561/0 lens 328/0 e 0 to 0 dl 1783074246 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074235.800455:0:19655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2405:x1869685708159872:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783074235.800462:0:19655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1783074235.800464:0:19655:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9524edcc6000 refcount=4 00010000:00000040:2.0:1783074235.800465:0:19655:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c8d7c400 count: 3 00010000:00010000:2.0:1783074235.800468:0:19655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 10 pid: 94277 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.800474:0:19655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 10 pid: 94277 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783074235.800481:0:19655:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9524edcc6000 with handle 0x5fb609b3016e07e0 from hash 00010000:00010000:2.0:1783074235.800484:0:19655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9524edcc6000/0x5fb609b3016e07e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b30d expref: 10 pid: 94277 timeout: 3175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.800488:0:19655:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9524df202800 : new locks_count 3 00000020:00000040:2.0:1783074235.800489:0:19655:0:(genops.c:900:class_export_put()) PUTting export ffff9524df202800 : new refcount 9 00010000:00000040:2.0:1783074235.800492:0:19655:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9523cb0eae00 00010000:00010000:2.0:1783074235.800495:0:19655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074235.800508:0:19655:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c8d7c400) refcount = 2 00010000:00010000:2.0:1783074235.800512:0:19655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783074235.800534:0:19655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002415348s 00000020:00000040:2.0:1783074235.800538:0:19655:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523cb0eae00 refcount=5 00010000:00010000:2.0:1783074235.800541:0:19655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.800548:0:19655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.800554:0:19655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.800561:0:19655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.800567:0:19655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9523cb0eae00 already unused, calling callback (ffffffffc0c63ce0) 00010000:00010000:2.0:1783074235.800571:0:19655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783074235.800576:0:19655:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523cb0eae00 refcount=6 00010000:00010000:2.0:1783074235.800579:0:19655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783074235.800595:0:19655:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9523cb0eae00 with handle 0x5fb609b3016e163b from hash 00010000:00010000:2.0:1783074235.800600:0:19655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074235.800621:0:19655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1783074235.800638:0:19655:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074235.800643:0:19655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074235.800682:0:19655:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074235.800689:0:19655:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092f480 x1869685708159872/t0(0) o103->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:561/0 lens 328/224 e 0 to 0 dl 1783074246 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783074235.800695:0:94279:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074235.800700:0:19655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f1623620-a4b0-4769-84e0-0d08c968afe8+9:2405:x1869685708159872:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 244us (450us total) trans 0 rc 0/0 00010000:00010000:0.0:1783074235.800718:0:94279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783074235.800725:0:19655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2637 00010000:00010000:0.0:1783074235.800728:0:94279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9523cb0eae00/0x5fb609b3016e163b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783074235.800730:0:19655:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524df202800 : new rpc_count 0 00002000:00000040:3.0:1783074235.800733:0:96839:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00000020:00000040:2.0:1783074235.800742:0:19655:0:(genops.c:900:class_export_put()) PUTting export ffff9524df202800 : new refcount 8 00010000:00000040:0.0:1783074235.800742:0:94279:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9523c8d7c400 count: 0 00010000:00080000:3.0:1783074235.800848:0:96839:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968740 00010000:00080000:3.0:1783074235.801502:0:96855:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96855 00010000:02000000:3.0:1783074235.801518:0:96855:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000020:01000004:0.0:1783074235.801592:0:96839:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:0.0:1783074235.801598:0:96839:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9524d08d4300 : new refcount 2 00000040:00000040:0.0:1783074235.801603:0:96839:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9524d08d4300 : new refcount 1 00000020:00000040:0.0:1783074235.801919:0:96839:0:(genops.c:900:class_export_put()) PUTting export ffff9523c4c4c800 : new refcount 1 00000020:00000040:0.0:1783074235.801930:0:96839:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.126@tcp (ffff9524e69d19c0) now 6 - mgc_fs 10000000:01000000:0.0:1783074235.801933:0:96839:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783074235.801947:0:96839:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783074235.801967:0:96839:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1783074235.803105:0:96839:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783074235.803302:0:96839:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:3.0:1783074235.806202:0:96855:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1783074235.806208:0:96855:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:3.0:1783074236.017134:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783074236.180542:0:96904:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783074236.181033:0:96904:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 40000000:00000040:2.0:1783074236.546283:0:96952:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000020:00000040:2.0:1783074236.913987:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff9524c44119c0) now 12 - health_check_show 00000020:00000040:2.0:1783074236.914000:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff9524c44119c0) now 12 - health_check_show 00000020:00000040:2.0:1783074236.914003:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff9524fab74d40) now 10 - health_check_show 00000020:00000040:2.0:1783074236.914006:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff9524fab74d40) now 10 - health_check_show 00000020:00000040:2.0:1783074236.914008:0:97001:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.126@tcp (ffff9524e69d19c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914011:0:97001:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.126@tcp (ffff9524e69d19c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914013:0:97001:0:(obd_config.c:994:class_incref()) incref MGS (ffff9523c2284d40) now 8 - health_check_show 00000020:00000040:2.0:1783074236.914017:0:97001:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff9523c2284d40) now 8 - health_check_show 00000020:00000040:2.0:1783074236.914019:0:97001:0:(obd_config.c:994:class_incref()) incref MDS (ffff9523c2283380) now 4 - health_check_show 00000020:00000040:2.0:1783074236.914026:0:97001:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9523c2283380) now 4 - health_check_show 00000020:00000040:2.0:1783074236.914028:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9524fab70000) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914030:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9524fab70000) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914032:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 12 - health_check_show 00000020:00000040:2.0:1783074236.914035:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9524fab73380) now 12 - health_check_show 00000020:00000040:2.0:1783074236.914042:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9523c7150000) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914045:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9523c7150000) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914047:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff9523c3388000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914050:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff9523c3388000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914052:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff9524f4b93380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914054:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff9524f4b93380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914056:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff9524f4b90000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914058:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff9524f4b90000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914060:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff9523c7153380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914063:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff9523c7153380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914065:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9524fb4d99c0) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914067:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9524fb4d99c0) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914069:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 16 - health_check_show 00000020:00000040:2.0:1783074236.914071:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9524fb4d8000) now 16 - health_check_show 00000020:00000040:2.0:1783074236.914073:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff9524fb4dcd40) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914075:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff9524fb4dcd40) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914077:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff9524fb4db380) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914080:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff9524fb4db380) now 5 - health_check_show 00000020:00000040:2.0:1783074236.914082:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9524c4410000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914084:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff9524c4410000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914086:0:97001:0:(obd_config.c:994:class_incref()) incref OSS (ffff9524f4880000) now 4 - health_check_show 00000020:00000040:2.0:1783074236.914091:0:97001:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff9524f4880000) now 4 - health_check_show 00000020:00000040:2.0:1783074236.914093:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 7 - health_check_show 00000020:00000040:2.0:1783074236.914152:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9524fa860000) now 7 - health_check_show 00000020:00000040:2.0:1783074236.914155:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914157:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff9524d2e499c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914160:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914161:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff9524c4414d40) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914168:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff9524d2e4cd40) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914170:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff9524d2e4cd40) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914172:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9524d2e4b380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914174:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9524d2e4b380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914177:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff9523c22819c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914180:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff9523c22819c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914182:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9523c2c30000) now 10 - health_check_show 00000020:00000040:2.0:1783074236.914201:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9523c2c30000) now 10 - health_check_show 00000020:00000040:2.0:1783074236.914203:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff9523c2280000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914205:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff9523c2280000) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914207:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff9524f4884d40) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914209:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff9524f4884d40) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914211:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff9524fa8619c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914213:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff9524fa8619c0) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914216:0:97001:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff9523c338b380) now 6 - health_check_show 00000020:00000040:2.0:1783074236.914218:0:97001:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff9523c338b380) now 6 - health_check_show 00010000:00010000:3.0:1783074237.038552:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1783074237.295732:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524df2b6050 x1869685708160000 msgsize 328 00000100:00100000:0.0:1783074237.295748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:0.0:1783074237.295750:0:3653:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1783074237.295945:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160000 00000100:00100000:2.0:1783074237.295956:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160000 00000020:00000040:2.0:1783074237.295959:0:94277:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e07d9 00000020:00000040:2.0:1783074237.295964:0:94277:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524df202800 refcount=9 00000100:00000040:2.0:1783074237.296103:0:94277:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783074237.296138:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00000040:2.0:1783074237.296143:0:94277:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524df202800 : new rpc_count 1 00000100:00000040:2.0:1783074237.296149:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df2b6050 x1869685708160000/t0(0) o101->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.296159:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+9:70871:x1869685708160000:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783074237.296173:0:94277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:2.0:1783074237.296193:0:94277:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9524c151a200 with handle 0x5fb609b3016e1642 to hash 00010000:00010000:2.0:1783074237.296198:0:94277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9524c151a200/0x5fb609b3016e1642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc673b74fc263b686 expref: -99 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783074237.296204:0:94277:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9524df202800 : new locks_count 4 00000020:00000040:2.0:1783074237.296206:0:94277:0:(genops.c:889:class_export_get()) GET export ffff9524df202800 refcount=10 00010000:00000040:2.0:1783074237.296229:0:94277:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c170b000) refcount = 1 00010000:00010000:2.0:1783074237.296233:0:94277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9524c151a200/0x5fb609b3016e1642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b686 expref: 10 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074237.296241:0:94277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9524c151a200/0x5fb609b3016e1642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b686 expref: 10 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783074237.296248:0:94277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9524c151a200, rc 0) 00010000:00000040:2.0:1783074237.296251:0:94277:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685708160000 00000100:00000040:2.0:1783074237.296258:0:94277:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.296263:0:94277:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.296300:0:94277:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.296303:0:94277:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df2b6050 x1869685708160000/t0(0) o101->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:563/0 lens 328/344 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.296326:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708160000:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 152us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074237.296331:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00000040:2.0:1783074237.296334:0:94277:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524df202800 : new rpc_count 0 00000020:00000040:2.0:1783074237.296344:0:94277:0:(genops.c:900:class_export_put()) PUTting export ffff9524df202800 : new refcount 9 00000100:00000040:2.0:1783074237.298200:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524df2b7c50 x1869685708160128 msgsize 304 00000100:00100000:2.0:1783074237.298210:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:2.0:1783074237.298211:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1783074237.298451:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160128 00000100:00100000:3.0:1783074237.298467:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160128 00000020:00000040:3.0:1783074237.298470:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e07d9 00000020:00000040:3.0:1783074237.298474:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524df202800 refcount=10 00000100:00000040:3.0:1783074237.298492:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783074237.298559:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00000040:3.0:1783074237.298563:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524df202800 : new rpc_count 1 00000100:00000040:3.0:1783074237.298569:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df2b7c50 x1869685708160128/t0(0) o256->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:563/0 lens 304/0 e 0 to 0 dl 1783074248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.298583:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708160128:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783074237.298609:0:94278:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:3.0:1783074237.298621:0:94278:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1783074237.298628:0:94278:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783074237.298630:0:94278:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:3.0:1783074237.298637:0:94278:0:(genops.c:889:class_export_get()) GET export ffff9524df202800 refcount=11 00000020:00000040:2.0:1783074237.299610:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524df202800 : new refcount 10 00010000:00000040:2.0:1783074237.299672:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685708160128 00000100:00000040:2.0:1783074237.299683:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.299689:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.299719:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 8 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.299725:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df2b7c50 x1869685708160128/t0(0) o256->f1623620-a4b0-4769-84e0-0d08c968afe8@192.168.204.26@tcp:563/0 lens 304/240 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.299736:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1623620-a4b0-4769-84e0-0d08c968afe8+10:70871:x1869685708160128:12345-192.168.204.26@tcp:256:ll_cfg_requeue.0 Request processed in 1155us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074237.299744:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00000040:2.0:1783074237.299748:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524df202800 : new rpc_count 0 00000020:00000040:2.0:1783074237.299758:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524df202800 : new refcount 9 00000100:00000040:1.0:1783074237.303550:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c20c0700 x1869685708160256 msgsize 520 00000100:00100000:1.0:1783074237.303565:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074237.303604:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160256 00000100:00100000:0.0:1783074237.303612:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160256 00000020:00000040:0.0:1783074237.303614:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0842 00000100:00100000:0.0:1783074237.303662:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5018 00000100:00000040:0.0:1783074237.303671:0:26169:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c20c0700 x1869685708160256/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074237.303683:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2401:x1869685708160256:12345-192.168.204.26@tcp:8:ll_cfg_requeue.0 00000020:00000040:0.0:1783074237.303703:0:26169:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 7 - find 00010000:00000040:0.0:1783074237.303714:0:26169:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783074237.303730:0:26169:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b' at ffff9523c316b000, cookie 0x5fb609b3016e15ee 00010000:00080000:0.0:1783074237.303735:0:26169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp recovering/t4294968720 exp ffff9523c316b000 cur 3076 last 1783074235 00010000:02000400:0.0:1783074237.303745:0:26169:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:0.0:1783074237.303751:0:26169:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:0.0:1783074237.303759:0:26169:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 19 00000020:00000040:0.0:1783074237.303763:0:26169:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=4 00000001:00000040:0.0:1783074237.303765:0:26169:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 20 00000001:00000040:0.0:1783074237.303769:0:26169:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9524e41c5800) : new refcount 19 00002000:00100000:0.0:1783074237.303773:0:26169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b/ffff9523c316b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783074237.303789:0:26169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:0.0:1783074237.303852:0:26169:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9523c108c5a0 for nid 192.168.204.26@tcp - ref 2 00000020:00000040:0.0:1783074237.303962:0:26169:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 8 - import 00000020:00000040:0.0:1783074237.303968:0:26169:0:(genops.c:1244:class_import_put()) import ffff9524c5fdc000 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1783074237.303975:0:26169:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=5 00000100:00000040:0.0:1783074237.303978:0:26169:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:0.0:1783074237.303987:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.303990:0:26169:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524fb578240 refcount 9 to 192.168.204.26@tcp 00000020:00000040:0.0:1783074237.303993:0:26169:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=6 00000100:00000040:0.0:1783074237.303999:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00000100:00080000:0.0:1783074237.304007:0:26169:0:(import.c:65:import_set_state_nolock()) ffff9524c5fdc000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783074237.304013:0:26169:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 5 00000020:00000040:0.0:1783074237.304016:0:26169:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9524fa860000) now 8 - find 00010000:00000040:0.0:1783074237.304034:0:26169:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 0, xid 1869685708160256 00000100:00000040:0.0:1783074237.304042:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.304049:0:26169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.304090:0:26169:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.304096:0:26169:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c20c0700 x1869685708160256/t0(0) o8->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:0/0 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074237.304114:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2401:x1869685708160256:12345-192.168.204.26@tcp:8:ll_cfg_requeue.0 Request processed in 430us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074237.304123:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5018 00000100:00000040:0.0:1783074237.304126:0:26169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.304136:0:26169:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 4 00000100:00000040:3.0:1783074237.307978:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc496d80 x1869685708132224 msgsize 440 00000100:00100000:3.0:1783074237.307992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.308185:0:24854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132224 00000100:00100000:2.0:1783074237.308194:0:24854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132224 00000020:00000040:2.0:1783074237.308197:0:24854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.308202:0:24854:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=5 00000100:00000040:2.0:1783074237.308231:0:24854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.308279:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 566 00000100:00000040:2.0:1783074237.308284:0:24854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.308293:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc496d80 x1869685708132224/t0(4294968741) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.308421:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2401:x1869685708132224:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:2.0:1783074237.308437:0:24854:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc496d80 x1869685708132224/t0(4294968741) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.308446:0:24854:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968741, current: 4294968741, replaying 00010000:00000040:2.0:1783074237.308449:0:24854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.308510:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496d80 x1869685708132224/t0(4294968741) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.308537:0:96855:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1783074237.308544:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+5:2401:x1869685708132224:12345-192.168.204.26@tcp:10:dd.0 Request processed in 227us (554us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.308555:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 566 00000100:00000040:2.0:1783074237.308559:0:24854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 10000000:00000040:0.0:1783074237.422402:0:6527:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9523c4514c00) refs 2 10000000:01000000:0.0:1783074237.422412:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783074237.422415:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9524c6cae000 from 128 10000000:01000000:0.0:1783074237.422418:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:0.0:1783074237.422429:0:6527:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:0.0:1783074237.422468:0:6527:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9525021da400 with handle 0x5fb609b3016e1649 to hash 00010000:00010000:0.0:1783074237.422477:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074237.422488:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783074237.422499:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783074237.422522:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074237.422534:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662336:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1783074237.422559:0:6527:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074237.422567:0:6527:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783074237.422612:0:6527:0:(events.c:337:request_in_callback()) incoming req@ffff9524df2b5c50 x1869685723662336 msgsize 328 00000100:00100000:0.0:1783074237.422625:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783074237.422627:0:6527:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783074237.422659:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.422691:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662336 00000100:00100000:0.0:1783074237.422693:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9523c204a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783074237.422701:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662336 00000020:00000040:1.0:1783074237.422705:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:1.0:1783074237.422709:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=22 00000100:00000040:1.0:1783074237.422733:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783074237.422778:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1783074237.422783:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074237.422789:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df2b5c50 x1869685723662336/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.422801:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+22:6527:x1869685723662336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074237.422814:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1783074237.422822:0:94276:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c170b000 count: 2 00000020:00000040:1.0:1783074237.422828:0:94276:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cb0ea400 with handle 0x5fb609b3016e1650 to hash 00010000:00010000:1.0:1783074237.422832:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523cb0ea400/0x5fb609b3016e1650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e1649 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074237.422839:0:94276:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9524f7804800 : new locks_count 17 00000020:00000040:1.0:1783074237.422841:0:94276:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=23 00010000:00000040:1.0:1783074237.422856:0:94276:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c170b000) refcount = 2 00010000:00000040:1.0:1783074237.422858:0:94276:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783074237.422863:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524c151a200/0x5fb609b3016e1642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b686 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074237.422874:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523cb0ea400/0x5fb609b3016e1650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e1649 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074237.422882:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523cb0ea400/0x5fb609b3016e1650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e1649 expref: 23 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074237.422889:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523cb0ea400, rc 0) 00010000:00000040:1.0:1783074237.422892:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723662336 00000100:00000040:1.0:1783074237.422899:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:1.0:1783074237.422903:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074237.422932:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.422956:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00000040:1.0:1783074237.422963:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df2b5c50 x1869685723662336/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 328/344 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.422973:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723662336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074237.422980:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:0.0:1783074237.422981:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092ca80 x1869685708160384 msgsize 224 00000100:00000040:1.0:1783074237.422984:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00100000:0.0:1783074237.422992:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000020:00000040:1.0:1783074237.422998:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000100:00000040:0.0:1783074237.423026:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092d180 x1869685708160640 msgsize 224 00000100:00000040:3.0:1783074237.423029:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074237.423035:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.423039:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160384 00000100:00100000:1.0:1783074237.423046:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160384 00000020:00000040:1.0:1783074237.423049:0:66200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0666 00000100:00000040:3.0:1783074237.423051:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074237.423054:0:66200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fc200000 refcount=51 00000100:00100000:3.0:1783074237.423064:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662336:0@lo:101:ll_cfg_requeue.0 00000020:00000040:1.0:1783074237.423069:0:66200:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9524fb4d8000) now 16 - evictor 00000100:00000040:3.0:1783074237.423074:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074237.423074:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092ed80 x1869685708160512 msgsize 224 00000100:00100000:0.0:1783074237.423088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074237.423090:0:66200:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000020:00000040:3.0:1783074237.423105:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9525021da400 refcount=4 00010000:00000040:3.0:1783074237.423111:0:6527:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9525021da400, remote cookie: 0x5fb609b3016e1650, flags: 0x0 00000100:00100000:1.0:1783074237.423112:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160512 00010000:00000040:3.0:1783074237.423116:0:6527:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c43bc900) refcount = 1 00000100:00100000:1.0:1783074237.423117:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160512 00000100:00100000:0.0:1783074237.423119:0:26170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160640 00010000:00010000:3.0:1783074237.423122:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e1650 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783074237.423125:0:26170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160640 00000020:00000040:1.0:1783074237.423128:0:66200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016dfc80 00000020:00000040:0.0:1783074237.423130:0:26170:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e0849 00000020:00000040:1.0:1783074237.423134:0:66200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7816800 refcount=11 00000020:00000040:0.0:1783074237.423135:0:26170:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524fb6b3800 refcount=7 00010000:00010000:3.0:1783074237.423139:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e1650 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783074237.423145:0:66200:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9524fab73380) now 12 - evictor 00000100:00000040:3.0:1783074237.423151:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524f092c000 x1869685723662336/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783074237.423155:0:26170:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9523c2c30000) now 10 - evictor 00000020:00000040:3.0:1783074237.423167:0:6527:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 10000000:00000040:3.0:1783074237.423174:0:6527:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9523c4514c00) refs 3 00000100:00000040:0.0:1783074237.423174:0:26170:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1783074237.423175:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 922 00000020:00000040:3.0:1783074237.423180:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9525021da400 refcount=3 00000100:00000040:1.0:1783074237.423182:0:66200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fc200000 : new rpc_count 1 00000100:00000040:1.0:1783074237.423190:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092ca80 x1869685708160384/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783074237.423197:0:26170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2219 00000020:00000040:3.0:1783074237.423200:0:6527:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:0.0:1783074237.423202:0:26170:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524fb6b3800 : new rpc_count 1 00000100:00000040:0.0:1783074237.423209:0:26170:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092d180 x1869685708160640/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.423216:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+51:2402:x1869685708160384:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074237.423223:0:26170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708160640:12345-192.168.204.26@tcp:400:kworker.0 00000020:00000040:3.0:1783074237.423229:0:6527:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00010000:00000040:1.0:1783074237.423232:0:66200:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1869685708160384 00010000:00000040:0.0:1783074237.423234:0:26170:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685708160640 00000100:00000040:1.0:1783074237.423242:0:66200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 12 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.423243:0:26170:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 12 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.423245:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783074237.423252:0:26170:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.423255:0:66200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00100000:3.0:1783074237.423265:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662464:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1783074237.423280:0:26170:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.423286:0:66200:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.423287:0:26170:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092d180 x1869685708160640/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 224/224 e 0 to 0 dl 1783074248 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074237.423293:0:6527:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.423294:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092ca80 x1869685708160384/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 224/224 e 0 to 0 dl 1783074248 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.423342:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+51:2402:x1869685708160384:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 132us (357us total) trans 0 rc 0/0 00000100:00000040:3.0:1783074237.423349:0:6527:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1783074237.423359:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 922 00000100:00000040:1.0:1783074237.423364:0:66200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fc200000 : new rpc_count 0 00000100:00100000:0.0:1783074237.423365:0:26170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2402:x1869685708160640:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00000040:3.0:1783074237.423374:0:6527:0:(events.c:337:request_in_callback()) incoming req@ffff9524df2b6450 x1869685723662464 msgsize 304 00000020:00000040:1.0:1783074237.423375:0:66200:0:(genops.c:900:class_export_put()) PUTting export ffff9524fc200000 : new refcount 50 00000100:00100000:0.0:1783074237.423378:0:26170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2219 00000100:00000040:0.0:1783074237.423384:0:26170:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524fb6b3800 : new rpc_count 0 00000100:00100000:3.0:1783074237.423385:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074237.423390:0:6527:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1783074237.423391:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 923 00000100:00000040:1.0:1783074237.423396:0:66200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7816800 : new rpc_count 1 00000020:00000040:0.0:1783074237.423397:0:26170:0:(genops.c:900:class_export_put()) PUTting export ffff9524fb6b3800 : new refcount 6 00000100:00000040:1.0:1783074237.423403:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092ed80 x1869685708160512/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.423418:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2402:x1869685708160512:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1783074237.423420:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662464 00000100:00000040:3.0:1783074237.423427:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.423427:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662464 00000020:00000040:2.0:1783074237.423431:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00010000:00000040:1.0:1783074237.423431:0:66200:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 77309411475, transno 0, xid 1869685708160512 00000020:00000040:2.0:1783074237.423436:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000100:00080000:0.0:1783074237.423440:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000040:1.0:1783074237.423443:0:66200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000020:00000040:0.0:1783074237.423447:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9523c2c30000) now 10 - evictor 00000100:00080000:0.0:1783074237.423451:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000040:2.0:1783074237.423455:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000040:0.0:1783074237.423455:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9524fab73380) now 12 - evictor 00000100:00000040:1.0:1783074237.423460:0:66200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00100000:3.0:1783074237.423469:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3575780 going to sleep for 11 seconds 00000100:00080000:0.0:1783074237.423474:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:1.0:1783074237.423479:0:66200:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00000020:00000040:0.0:1783074237.423479:0:6525:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9524fb4d8000) now 16 - evictor 00000100:00100000:2.0:1783074237.423483:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1783074237.423488:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074237.423491:0:66200:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092ed80 x1869685708160512/t0(0) o400->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 224/224 e 0 to 0 dl 1783074248 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.423496:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df2b6450 x1869685723662464/t0(0) o256->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 304/0 e 0 to 0 dl 1783074248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.423512:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2402:x1869685708160512:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 94us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074237.423520:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723662464:12345-0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783074237.423525:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 923 00000100:00000040:1.0:1783074237.423529:0:66200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7816800 : new rpc_count 0 20000000:01000000:2.0:1783074237.423538:0:94278:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000020:00000040:1.0:1783074237.423538:0:66200:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7816800 : new refcount 10 20000000:00000040:2.0:1783074237.423551:0:94278:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1783074237.423559:0:94278:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783074237.423562:0:94278:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:2.0:1783074237.423568:0:94278:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=24 00000020:00000040:2.0:1783074237.423613:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00010000:00000040:2.0:1783074237.423625:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723662464 00000100:00000040:2.0:1783074237.423631:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:2.0:1783074237.423635:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074237.423665:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.423684:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00000040:2.0:1783074237.423689:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df2b6450 x1869685723662464/t0(0) o256->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 304/240 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.423703:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723662464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 188us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074237.423710:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1783074237.423713:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:3.0:1783074237.423722:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074237.423724:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 22 00000100:00000040:3.0:1783074237.423736:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074237.423745:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.423753:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662464:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1783074237.423760:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1783074237.423769:0:6527:0:(mgc_request.c:1601:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:3.0:1783074237.423778:0:6527:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783074237.423790:0:6527:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.204.126@tcp has 192.168.204.126@tcp. 10000000:00000040:3.0:1783074237.423803:0:6527:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1783074237.423807:0:6527:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9523c6a63800 already not connected (conn 4, was 0): DISCONN 00000100:00000040:3.0:1783074237.423816:0:6527:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:3.0:1783074237.423819:0:6527:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:3.0:1783074237.423822:0:6527:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.126@tcp -> ffff9524c5d54000 00010000:00080000:3.0:1783074237.423825:0:6527:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9523c6a63800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.126@tcp, moved to head 00010000:00000040:3.0:1783074237.423834:0:6527:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 61 to 0@lo 00000100:00080000:3.0:1783074237.423838:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1783074237.423842:0:6527:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 60 to 0@lo 00000100:00000040:3.0:1783074237.423844:0:6527:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 61 to 0@lo 00000020:00000040:3.0:1783074237.423846:0:6527:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ac 00000020:00000040:3.0:1783074237.423849:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c4400000 refcount=4 00000100:00000040:3.0:1783074237.423851:0:6527:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 60 to 0@lo 00000100:00000040:3.0:1783074237.423853:0:6527:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 61 to 0@lo 00000020:00000040:3.0:1783074237.423855:0:6527:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4400000 : new refcount 3 00000100:00080000:3.0:1783074237.423857:0:6527:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9523c6a63800 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:3.0:1783074237.423867:0:6527:0:(genops.c:1231:class_import_get()) import ffff9523c6a63800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1783074237.423878:0:6527:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783074237.423889:0:6527:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009aca1806] to pc [ptlrpcd_rcv+-1] req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1783074237.423908:0:6527:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783074237.423915:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496a00 x1869685723662464/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074237.423923:0:6527:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074237.423925:0:6527:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00000100:00000040:1.0:1783074237.423945:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783074237.423946:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1783074237.423953:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9525021da400 refcount=3 00010000:00010000:3.0:1783074237.423961:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e1650 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783074237.423962:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723662592:0@lo:8:ll_cfg_requeue.0 00010000:00010000:3.0:1783074237.423976:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e1650 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074237.423984:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074257 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.424006:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 10000000:00000040:3.0:1783074237.424009:0:6527:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9524c3553a00) refs 2 10000000:00000040:3.0:1783074237.424013:0:6527:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9523c4514c00) refs 3 10000000:01000000:3.0:1783074237.424016:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783074237.424018:0:6527:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9523c6b72800 from 128 10000000:01000000:3.0:1783074237.424021:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1783074237.424026:0:6527:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000100:00000040:1.0:1783074237.424031:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9523c20c1180 x1869685723662592 msgsize 520 00010000:00000040:3.0:1783074237.424036:0:6527:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c43bc900 count: 2 00000100:00100000:1.0:1783074237.424038:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:3.0:1783074237.424043:0:6527:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523c69bc800 with handle 0x5fb609b3016e1657 to hash 00010000:00010000:3.0:1783074237.424050:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074237.424057:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074237.424059:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074257 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783074237.424076:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783074237.424081:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 2350 usecs (3 jiffies) 00000100:00000040:3.0:1783074237.424091:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.424101:0:26172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662592 00000100:00100000:3.0:1783074237.424102:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783074237.424108:0:26172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662592 00000020:00000040:2.0:1783074237.424112:0:26172:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ba 00000100:00000040:3.0:1783074237.424117:0:6527:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074237.424124:0:6527:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783074237.424140:0:26172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019 00000100:00000040:3.0:1783074237.424142:0:6527:0:(events.c:337:request_in_callback()) incoming req@ffff9524df2b6c50 x1869685723662720 msgsize 328 00000100:00000040:2.0:1783074237.424145:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c20c1180 x1869685723662592/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.424151:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074237.424156:0:6527:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1783074237.424162:0:26172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3657:x1869685723662592:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1783074237.424174:0:26172:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 8 - find 00000100:00000040:3.0:1783074237.424175:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783074237.424186:0:26172:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1783074237.424195:0:26172:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9523c316d000, cookie 0x5fb609b3016e15e7 00010000:00080000:2.0:1783074237.424202:0:26172:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff9523c316d000 cur 3076 last 1783074235 00000100:00100000:3.0:1783074237.424205:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3575780 going to sleep for 11 seconds 00000100:00100000:1.0:1783074237.424210:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662720 00000001:00000040:2.0:1783074237.424215:0:26172:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.126@tcp 00000100:00100000:1.0:1783074237.424215:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662720 00000020:00000040:1.0:1783074237.424219:0:94276:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000001:00000040:2.0:1783074237.424221:0:26172:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 20 00000020:00000040:1.0:1783074237.424222:0:94276:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=23 00000020:00000040:2.0:1783074237.424228:0:26172:0:(genops.c:889:class_export_get()) GET export ffff9523c316d000 refcount=4 00000001:00000040:2.0:1783074237.424232:0:26172:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 21 00000100:00000040:1.0:1783074237.424233:0:94276:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000001:00000040:2.0:1783074237.424238:0:26172:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9524e41c5800) : new refcount 20 00002000:00100000:2.0:1783074237.424243:0:26172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9523c316d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783074237.424247:0:26172:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783074237.424250:0:26172:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783074237.424251:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:1.0:1783074237.424257:0:94276:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074237.424261:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df2b6c50 x1869685723662720/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074237.424264:0:26172:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9523c1788ba0 for nid 0@lo - ref 2 00000100:00100000:1.0:1783074237.424276:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+23:6527:x1869685723662720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783074237.424283:0:94276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1783074237.424287:0:94276:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9523c170b000 count: 3 00000020:00000040:1.0:1783074237.424291:0:94276:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9523cb0eb200 with handle 0x5fb609b3016e165e to hash 00010000:00010000:1.0:1783074237.424294:0:94276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9523cb0eb200/0x5fb609b3016e165e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb609b3016e1657 expref: -99 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074237.424299:0:94276:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9524f7804800 : new locks_count 18 00000020:00000040:1.0:1783074237.424301:0:94276:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=24 00010000:00000040:1.0:1783074237.424338:0:94276:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c170b000) refcount = 3 00010000:00000040:1.0:1783074237.424342:0:94276:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783074237.424345:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9523cb0ea400/0x5fb609b3016e1650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e1649 expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783074237.424360:0:94276:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9524c151a200/0x5fb609b3016e1642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xc673b74fc263b686 expref: 9 pid: 94277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074237.424368:0:94276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9523cb0eb200/0x5fb609b3016e165e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb609b3016e1657 expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074237.424378:0:94276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9523cb0eb200/0x5fb609b3016e165e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb609b3016e1657 expref: 24 pid: 94276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783074237.424385:0:94276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9523cb0eb200, rc 0) 00010000:00000040:1.0:1783074237.424387:0:94276:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723662720 00000100:00000040:1.0:1783074237.424392:0:94276:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:1.0:1783074237.424395:0:94276:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074237.424413:0:94276:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074237.424417:0:26172:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 9 - import 00000020:00000040:2.0:1783074237.424425:0:26172:0:(genops.c:1244:class_import_put()) import ffff9524fb54d800 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1783074237.424429:0:26172:0:(genops.c:889:class_export_get()) GET export ffff9523c316d000 refcount=5 00000100:00000040:2.0:1783074237.424433:0:26172:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9523c316d000 : new rpc_count 1 00000100:00000040:2.0:1783074237.424439:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 63 to 0@lo 00000100:00000040:2.0:1783074237.424443:0:26172:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 63 to 0@lo 00000020:00000040:2.0:1783074237.424448:0:26172:0:(genops.c:889:class_export_get()) GET export ffff9523c316d000 refcount=6 00000100:00000040:2.0:1783074237.424452:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000100:00080000:2.0:1783074237.424457:0:26172:0:(import.c:65:import_set_state_nolock()) ffff9524fb54d800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1783074237.424462:0:26172:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316d000 : new refcount 5 00000020:00000040:2.0:1783074237.424464:0:26172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9524fa860000) now 9 - find 00010000:00000040:2.0:1783074237.424472:0:26172:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968736, transno 0, xid 1869685723662592 00000100:00000040:1.0:1783074237.424475:0:94276:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 63 to 0@lo 00000100:00000040:2.0:1783074237.424477:0:26172:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000100:00000040:2.0:1783074237.424482:0:26172:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074237.424485:0:94276:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df2b6c50 x1869685723662720/t0(0) o101->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 328/344 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.424495:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723662720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074237.424502:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:1.0:1783074237.424509:0:94276:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000100:00000040:2.0:1783074237.424511:0:26172:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074257 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074237.424517:0:94276:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:2.0:1783074237.424539:0:26172:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 63 to 0@lo 00000100:00000040:2.0:1783074237.424546:0:26172:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c20c1180 x1869685723662592/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.424555:0:26172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c20c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723662592:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 392us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074237.424562:0:26172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019 00000100:00000040:2.0:1783074237.424565:0:26172:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316d000 : new rpc_count 0 00000020:00000040:2.0:1783074237.424572:0:26172:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316d000 : new refcount 4 00010000:00080000:1.0:1783074237.424629:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.424638:0:3657:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968736 00000100:00000040:1.0:1783074237.424656:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783074237.424664:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:1.0:1783074237.424665:0:3657:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e06ac 00000020:00000040:1.0:1783074237.424667:0:3657:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c4400000 refcount=4 00000020:00000040:1.0:1783074237.424673:0:3657:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4400000 : new refcount 3 00000100:00080000:1.0:1783074237.424676:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783074237.424679:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1783074237.424681:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968736 gen 2 00000100:00000040:1.0:1783074237.424683:0:3657:0:(client.c:3221:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1783074237.424686:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9523c6a63800 from lustre-OST0000_UUID committed 4294968736 last 0 00000100:00080000:1.0:1783074237.424688:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1783074237.424690:0:3657:0:(genops.c:1231:class_import_get()) import ffff9523c6a63800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783074237.424742:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074237.424752:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.424761:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662720:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1783074237.424768:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074237.424777:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523c69bc800 refcount=4 00010000:00000040:3.0:1783074237.424781:0:6527:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9523c69bc800, remote cookie: 0x5fb609b3016e165e, flags: 0x0 00010000:00000040:3.0:1783074237.424786:0:6527:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9523c43bc900) refcount = 2 00010000:00000040:3.0:1783074237.424788:0:6527:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783074237.424791:0:6527:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.126@tcp lock: ffff9525021da400/0x5fb609b3016e1649 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e1650 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074237.424804:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e165e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783074237.424812:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb609b3016e165e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783074237.424820:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496a00 x1869685723662720/t0(0) o101->MGC192.168.204.126@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783074253 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074237.424828:0:6527:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 10000000:00000040:3.0:1783074237.424832:0:6527:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9524c3553a00) refs 3 00000020:00000040:3.0:1783074237.424835:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523c69bc800 refcount=3 00000020:00000040:3.0:1783074237.424855:0:6527:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074237.424868:0:6527:0:(genops.c:1231:class_import_get()) import ffff9524d08cc800 refcount=5 obd=MGC192.168.204.126@tcp 00000100:00000040:3.0:1783074237.424878:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.424887:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662848:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1783074237.424903:0:6527:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074237.424911:0:6527:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783074237.424928:0:6527:0:(events.c:337:request_in_callback()) incoming req@ffff9524df2b5850 x1869685723662848 msgsize 304 00000100:00100000:3.0:1783074237.424934:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783074237.424936:0:6527:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783074237.424958:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.424965:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662848 00000100:00100000:1.0:1783074237.424976:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662848 00000020:00000040:1.0:1783074237.424979:0:94278:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e05f6 00000020:00000040:1.0:1783074237.424981:0:94278:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524f7804800 refcount=24 00000100:00100000:3.0:1783074237.424983:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff9524c3575780 going to sleep for 11 seconds 00000100:00000040:1.0:1783074237.424993:0:94278:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:2.0:1783074237.425005:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.425016:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723662592:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1783074237.425024:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496680 x1869685723662592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.425027:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:1.0:1783074237.425031:0:94278:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524f7804800 : new rpc_count 1 00000100:00000040:1.0:1783074237.425040:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df2b5850 x1869685723662848/t0(0) o256->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 304/0 e 0 to 0 dl 1783074248 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074237.425044:0:3657:0:(genops.c:1244:class_import_put()) import ffff9523c6a63800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:3.0:1783074237.425055:0:97056:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1783074237.425060:0:97056:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00000100:00100000:1.0:1783074237.425066:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723662848:12345-0@lo:256:ll_cfg_requeue.0 00010000:00010000:3.0:1783074237.425067:0:97056:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 20000000:01000000:1.0:1783074237.425083:0:94278:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1783074237.425094:0:94278:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1783074237.425099:0:94278:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783074237.425102:0:94278:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1783074237.425107:0:94278:0:(genops.c:889:class_export_get()) GET export ffff9524f7804800 refcount=25 00000100:00080000:3.0:1783074237.425378:0:97056:0:(import.c:65:import_set_state_nolock()) ffff9523c6a63800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1783074237.425385:0:97056:0:(genops.c:1231:class_import_get()) import ffff9523c6a63800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783074237.425399:0:97056:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001b7f5af2] to pc [ptlrpcd_rcv+-1] req@ffff9524fc495180 x1869685723662976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074237.425412:0:97056:0:(genops.c:1244:class_import_put()) import ffff9523c6a63800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:1.0:1783074237.425455:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 24 00010000:00000040:1.0:1783074237.425472:0:94278:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869685723662848 00000100:00000040:1.0:1783074237.425479:0:94278:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000100:00000040:1.0:1783074237.425483:0:94278:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074237.425499:0:94278:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.425513:0:94278:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 63 to 0@lo 00000100:00000040:1.0:1783074237.425524:0:94278:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df2b5850 x1869685723662848/t0(0) o256->522b6a34-04f4-4017-ab45-61a21d19bfef@0@lo:563/0 lens 304/240 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.425530:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524fc495180 x1869685723662976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.425538:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:6527:x1869685723662848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 480us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074237.425549:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524fc495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869685723662976:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783074237.425556:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:1.0:1783074237.425561:0:94278:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524f7804800 : new rpc_count 0 00000020:00000040:1.0:1783074237.425569:0:94278:0:(genops.c:900:class_export_put()) PUTting export ffff9524f7804800 : new refcount 23 00000100:00000040:2.0:1783074237.425570:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9524fc495180 x1869685723662976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074253 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.425580:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074237.425596:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0919180 x1869685723662976 msgsize 224 00000100:00100000:2.0:1783074237.425601:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074237.425612:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.425623:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc495180 x1869685723662976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074253 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.425632:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.425638:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 2260 usecs (3 jiffies) 00000100:00000040:1.0:1783074237.425656:0:6527:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.425665:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524fc496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:522b6a34-04f4-4017-ab45-61a21d19bfef:6527:1869685723662848:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1783074237.425673:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1783074237.425681:0:6527:0:(mgc_request.c:1601:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:1.0:1783074237.425690:0:6527:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783074237.425699:0:6527:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.204.126@tcp has 192.168.204.126@tcp. 00000100:00100000:3.0:1783074237.425704:0:8487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723662976 00000100:00100000:3.0:1783074237.425709:0:8487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723662976 10000000:00000040:1.0:1783074237.425711:0:6527:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000020:00000040:3.0:1783074237.425712:0:8487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15e7 00000020:00000040:3.0:1783074237.425717:0:8487:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316d000 refcount=5 00000100:00080000:1.0:1783074237.425717:0:6527:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9523c1efd800 already not connected (conn 4, was 0): DISCONN 00000100:00000040:1.0:1783074237.425729:0:6527:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000100:00000040:1.0:1783074237.425733:0:6527:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000100:00000040:1.0:1783074237.425736:0:6527:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.126@tcp -> ffff9524c5d54000 00000100:00000040:3.0:1783074237.425738:0:8487:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00010000:00080000:1.0:1783074237.425739:0:6527:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9523c1efd800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.126@tcp, moved to head 00010000:00000040:1.0:1783074237.425745:0:6527:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 63 to 0@lo 00000100:00080000:1.0:1783074237.425748:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1783074237.425752:0:6527:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:1.0:1783074237.425755:0:6527:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 63 to 0@lo 00000020:00000040:1.0:1783074237.425757:0:6527:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fdc 00000020:00000040:1.0:1783074237.425759:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c32cf000 refcount=4 00000100:00000040:1.0:1783074237.425762:0:6527:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 62 to 0@lo 00000100:00000040:1.0:1783074237.425764:0:6527:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 63 to 0@lo 00000020:00000040:1.0:1783074237.425766:0:6527:0:(genops.c:900:class_export_put()) PUTting export ffff9523c32cf000 : new refcount 3 00000100:00080000:1.0:1783074237.425769:0:6527:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9523c1efd800 using connection 192.168.204.126@tcp/0@lo 00000020:00000040:1.0:1783074237.425783:0:6527:0:(genops.c:1231:class_import_get()) import ffff9523c1efd800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1783074237.425794:0:6527:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783074237.425803:0:8487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00000040:3.0:1783074237.425808:0:8487:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316d000 : new rpc_count 1 00000100:00000040:1.0:1783074237.425809:0:6527:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000088196f33] to pc [ptlrpcd_rcv+-1] req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783074237.425823:0:8487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0919180 x1869685723662976/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1783074237.425828:0:6527:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783074237.425838:0:6527:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524fc496a00 x1869685723662848/t0(0) o256->MGC192.168.204.126@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783074253 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.425843:0:8487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723662976:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1783074237.425858:0:6527:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=4 obd=MGC192.168.204.126@tcp 00000020:00000040:3.0:1783074237.425861:0:8487:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f0919180 x1869685723662976/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783074237.425862:0:6527:0:(genops.c:1244:class_import_put()) import ffff9524d08cc800 refcount=3 obd=MGC192.168.204.126@tcp 00010000:00000040:3.0:1783074237.425873:0:8487:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316d000 : new rpc_count 2 00010000:00080000:3.0:1783074237.425878:0:8487:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524f0919180 x1869685723662976/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783074237.425881:0:6527:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1783074237.425887:0:6527:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9523c69bc800 refcount=3 00010000:00010000:1.0:1783074237.425890:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e165e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783074237.425895:0:8487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0919180 x1869685723662976/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783074237.425898:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9523c69bc800/0x5fb609b3016e1657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb609b3016e165e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1783074237.425915:0:6527:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9524c3553a00) refs 3 00000100:00100000:3.0:1783074237.425917:0:8487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1869685723662976:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 80us (318us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.425925:0:8487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00000040:3.0:1783074237.425928:0:8487:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316d000 : new rpc_count 1 00000100:00000040:2.0:1783074237.425968:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.425977:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524df3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723663104:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1783074237.425990:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074257 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.425996:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783074237.426009:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0918380 x1869685723663104 msgsize 520 00000100:00100000:2.0:1783074237.426012:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783074237.426029:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074257 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.426038:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2962 usecs (3 jiffies) 00000100:00100000:1.0:1783074237.426060:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663104 00000100:00100000:1.0:1783074237.426066:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663104 00000020:00000040:1.0:1783074237.426068:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9ff1 00000100:00100000:1.0:1783074237.426098:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5020 00000100:00000040:1.0:1783074237.426104:0:26167:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0918380 x1869685723663104/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783074257 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.426113:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3657:x1869685723663104:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1783074237.426124:0:26167:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 9 - find 00010000:00000040:1.0:1783074237.426133:0:26167:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1783074237.426138:0:96855:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1783074237.426147:0:26167:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9524c4404800, cookie 0x5fb609b3016e15e0 00010000:00080000:1.0:1783074237.426153:0:26167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9524c4404800 cur 3076 last 1783074235 00000001:00000040:1.0:1783074237.426162:0:26167:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.126@tcp 00000001:00000040:1.0:1783074237.426165:0:26167:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 21 00000020:00000040:1.0:1783074237.426169:0:26167:0:(genops.c:889:class_export_get()) GET export ffff9524c4404800 refcount=4 00000001:00000040:1.0:1783074237.426171:0:26167:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9524e41c5800) : new refcount 22 00000001:00000040:1.0:1783074237.426175:0:26167:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9524e41c5800) : new refcount 21 00002000:00100000:1.0:1783074237.426178:0:26167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9524c4404800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783074237.426182:0:26167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1783074237.426184:0:26167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1783074237.426192:0:26167:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9523c1788ba0 for nid 0@lo - ref 3 00000020:00000040:1.0:1783074237.426199:0:26167:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9524fa860000) now 10 - import 00000020:00000040:1.0:1783074237.426204:0:26167:0:(genops.c:1244:class_import_put()) import ffff9523cd004800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1783074237.426208:0:26167:0:(genops.c:889:class_export_get()) GET export ffff9524c4404800 refcount=5 00000100:00000040:1.0:1783074237.426210:0:26167:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9524c4404800 : new rpc_count 1 00000100:00000040:1.0:1783074237.426224:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000100:00000040:1.0:1783074237.426227:0:26167:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9524c5d54000 refcount 64 to 0@lo 00000020:00000040:1.0:1783074237.426230:0:26167:0:(genops.c:889:class_export_get()) GET export ffff9524c4404800 refcount=6 00000100:00000040:1.0:1783074237.426235:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 65 to 0@lo 00000100:00080000:1.0:1783074237.426240:0:26167:0:(import.c:65:import_set_state_nolock()) ffff9523cd004800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1783074237.426254:0:26167:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4404800 : new refcount 5 00000020:00000040:1.0:1783074237.426257:0:26167:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9524fa860000) now 10 - find 00010000:00000040:1.0:1783074237.426265:0:26167:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968718, transno 0, xid 1869685723663104 00000100:00000040:1.0:1783074237.426270:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524c5d54000 refcount 66 to 0@lo 00010000:00080000:3.0:1783074237.426274:0:96855:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:1.0:1783074237.426275:0:26167:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:3.0:1783074237.426282:0:96855:0:(ldlm_lib.c:2861:target_recovery_thread()) 1: request replay stage - 2 clients from t4294968741 00010000:00080000:3.0:1783074237.426285:0:96855:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 4294968741 00010000:00080000:3.0:1783074237.426289:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294968741, next_transno: 4294968741 00010000:00080000:3.0:1783074237.426292:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968741) 00010000:00080000:3.0:1783074237.426302:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708132224 t4294968741 from 192.168.204.26@tcp req@ffff9524fc496d80 x1869685708132224/t0(4294968741) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:1.0:1783074237.426305:0:26167:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783074257 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.426349:0:26167:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524c5d54000 refcount 65 to 0@lo 00000100:00000040:1.0:1783074237.426362:0:26167:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0918380 x1869685723663104/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074237.426368:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc496d80 x1869685708132224/t0(4294968741) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.426374:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1869685723663104:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 258us (361us total) trans 0 rc 0/0 00010000:00080000:2.0:1783074237.426379:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.426389:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5020 00000100:00000040:1.0:1783074237.426395:0:26167:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524c4404800 : new rpc_count 0 00000020:00000040:1.0:1783074237.426401:0:26167:0:(genops.c:900:class_export_put()) PUTting export ffff9524c4404800 : new refcount 4 00002000:00000040:3.0:1783074237.426407:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x782:0x0] 00000100:00000040:2.0:1783074237.426409:0:3657:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968718 00000100:00000040:2.0:1783074237.426423:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783074237.426434:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:2.0:1783074237.426437:0:3657:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016d9fdc 00000020:00000040:2.0:1783074237.426440:0:3657:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c32cf000 refcount=4 00000020:00000040:2.0:1783074237.426445:0:3657:0:(genops.c:900:class_export_put()) PUTting export ffff9523c32cf000 : new refcount 3 00000100:00080000:2.0:1783074237.426448:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783074237.426452:0:3657:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1783074237.426454:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968718 gen 2 00000100:00000040:2.0:1783074237.426457:0:3657:0:(client.c:3221:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1783074237.426460:0:3657:0:(recover.c:53:ptlrpc_replay_next()) import ffff9523c1efd800 from lustre-OST0000_UUID committed 4294968718 last 0 00000100:00080000:2.0:1783074237.426463:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1783074237.426466:0:3657:0:(genops.c:1231:class_import_get()) import ffff9523c1efd800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783074237.426758:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.426768:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524df3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723663104:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1783074237.426777:0:97057:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00000100:00000040:1.0:1783074237.426777:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9524df3ba300 x1869685723663104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783074257 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783074237.426783:0:97057:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1783074237.426789:0:97057:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000020:00000040:1.0:1783074237.426794:0:3657:0:(genops.c:1244:class_import_put()) import ffff9523c1efd800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1783074237.426828:0:97057:0:(import.c:65:import_set_state_nolock()) ffff9523c1efd800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1783074237.426835:0:97057:0:(genops.c:1231:class_import_get()) import ffff9523c1efd800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783074237.426862:0:97057:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f0e14e03] to pc [ptlrpcd_rcv+-1] req@ffff9524f091ad80 x1869685723663232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783074237.426878:0:97057:0:(genops.c:1244:class_import_put()) import ffff9523c1efd800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783074237.426900:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9524f091ad80 x1869685723663232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.426914:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f091ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869685723663232:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1783074237.426931:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9524f091ad80 x1869685723663232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074253 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.426940:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783074237.426959:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9524df3ba300 x1869685723663232 msgsize 224 00000100:00100000:1.0:1783074237.426964:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783074237.426985:0:3657:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9524f091ad80 x1869685723663232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783074253 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.426988:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663232 00000100:00100000:2.0:1783074237.426994:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663232 00000020:00000040:2.0:1783074237.426996:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15e0 00000020:00000040:2.0:1783074237.426999:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9524c4404800 refcount=5 00000100:00000040:1.0:1783074237.427000:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2952 usecs (3 jiffies) 00000100:00100000:2.0:1783074237.427028:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00000040:2.0:1783074237.427031:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9524c4404800 : new rpc_count 1 00000100:00000040:2.0:1783074237.427039:0:8444:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df3ba300 x1869685723663232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.427047:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1869685723663232:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1783074237.427053:0:8444:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3ba300 x1869685723663232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783074237.427058:0:8444:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9524c4404800 : new rpc_count 2 00010000:00080000:2.0:1783074237.427061:0:8444:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9524df3ba300 x1869685723663232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.427066:0:8444:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df3ba300 x1869685723663232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:563/0 lens 224/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.427071:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1869685723663232:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 26us (112us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.427075:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00000040:2.0:1783074237.427077:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9524c4404800 : new rpc_count 1 00000001:00000040:3.0:1783074237.427092:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 1 00000020:00000040:3.0:1783074237.427096:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=6 00010000:00000040:3.0:1783074237.427138:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968741, xid 1869685708132224 00000100:00000040:3.0:1783074237.427146:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.427150:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.427184:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.427197:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:3.0:1783074237.427202:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.427212:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 5 00010000:00080000:3.0:1783074237.427215:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968742 00010000:00080000:3.0:1783074237.427219:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968742 00000100:00000040:3.0:1783074237.428727:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc496a00 x1869685708132864 msgsize 440 00000100:00100000:3.0:1783074237.428738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.428790:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708132864 00000100:00100000:2.0:1783074237.428797:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708132864 00000020:00000040:2.0:1783074237.428799:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.428803:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=6 00000100:00000040:2.0:1783074237.428822:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.428867:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 567 00000100:00000040:2.0:1783074237.428871:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.428877:0:24837:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc496a00 x1869685708132864/t0(4294968742) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.428891:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708132864:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:2.0:1783074237.428900:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc496a00 x1869685708132864/t0(4294968742) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.428919:0:24837:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968742, current: 4294968742, replaying 00010000:00000040:2.0:1783074237.428921:0:24837:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.428933:0:24837:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496a00 x1869685708132864/t0(4294968742) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.428941:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+6:2401:x1869685708132864:12345-192.168.204.26@tcp:10:dd.0 Request processed in 53us (213us total) trans 0 rc 0/-999 00010000:00080000:3.0:1783074237.428943:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968742, next_transno: 4294968742 00010000:00080000:3.0:1783074237.428951:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968742) 00000100:00100000:2.0:1783074237.428954:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 567 00000100:00000040:2.0:1783074237.428959:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.428964:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708132864 t4294968742 from 192.168.204.26@tcp req@ffff9524fc496a00 x1869685708132864/t0(4294968742) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.428981:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc496a00 x1869685708132864/t0(4294968742) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.429004:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x783:0x0] 00000001:00000040:3.0:1783074237.429126:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 2 00000020:00000040:3.0:1783074237.429130:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=7 00010000:00000040:3.0:1783074237.429154:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968742, xid 1869685708132864 00000100:00000040:3.0:1783074237.429162:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.429167:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.429204:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.429212:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.429217:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.429233:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 6 00010000:00080000:3.0:1783074237.429238:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968743 00010000:00080000:3.0:1783074237.429242:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968743 00000100:00000040:2.0:1783074237.431382:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524f091a680 x1869685708135296 msgsize 440 00000100:00100000:2.0:1783074237.431395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.431435:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708135296 00000100:00100000:3.0:1783074237.431443:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708135296 00000020:00000040:3.0:1783074237.431446:0:8450:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.431450:0:8450:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=7 00000100:00000040:3.0:1783074237.431471:0:8450:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.431518:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 568 00000100:00000040:3.0:1783074237.431522:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.431528:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f091a680 x1869685708135296/t0(4294968743) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.431542:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2401:x1869685708135296:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:3.0:1783074237.431552:0:8450:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f091a680 x1869685708135296/t0(4294968743) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.431561:0:8450:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968743, current: 4294968743, replaying 00010000:00000040:3.0:1783074237.431564:0:8450:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.431575:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f091a680 x1869685708135296/t0(4294968743) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.431584:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2401:x1869685708135296:12345-192.168.204.26@tcp:10:dd.0 Request processed in 45us (202us total) trans 0 rc 0/-999 00010000:00080000:1.0:1783074237.431586:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968743, next_transno: 4294968743 00010000:00080000:1.0:1783074237.431590:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968743) 00000100:00100000:3.0:1783074237.431591:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 568 00000100:00000040:3.0:1783074237.431594:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:1.0:1783074237.431602:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708135296 t4294968743 from 192.168.204.26@tcp req@ffff9524f091a680 x1869685708135296/t0(4294968743) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.431617:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f091a680 x1869685708135296/t0(4294968743) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783074237.431650:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x784:0x0] 00000001:00000040:1.0:1783074237.431795:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 3 00000020:00000040:1.0:1783074237.431798:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=8 00010000:00000040:1.0:1783074237.431830:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968743, xid 1869685708135296 00000100:00000040:1.0:1783074237.431838:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.431843:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.431883:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:1.0:1783074237.431891:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783074237.431896:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.431904:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 7 00010000:00080000:1.0:1783074237.431908:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968744 00010000:00080000:1.0:1783074237.431912:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968744 00000100:00000040:2.0:1783074237.433800:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524f0918000 x1869685708136192 msgsize 440 00000100:00100000:2.0:1783074237.433813:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.433876:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136192 00000100:00100000:3.0:1783074237.433884:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136192 00000020:00000040:3.0:1783074237.433887:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.433890:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=8 00000100:00000040:3.0:1783074237.433916:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.433949:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 569 00000100:00000040:3.0:1783074237.433953:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.433960:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f0918000 x1869685708136192/t0(4294968744) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.433973:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2401:x1869685708136192:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:3.0:1783074237.433983:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f0918000 x1869685708136192/t0(4294968744) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.433992:0:24842:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968744, current: 4294968744, replaying 00010000:00000040:3.0:1783074237.433995:0:24842:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.434016:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f0918000 x1869685708136192/t0(4294968744) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.434026:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+8:2401:x1869685708136192:12345-192.168.204.26@tcp:10:dd.0 Request processed in 55us (225us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.434032:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 569 00000100:00000040:3.0:1783074237.434035:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.434051:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968744, next_transno: 4294968744 00010000:00080000:2.0:1783074237.434056:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968744) 00010000:00080000:2.0:1783074237.434064:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708136192 t4294968744 from 192.168.204.26@tcp req@ffff9524f0918000 x1869685708136192/t0(4294968744) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.434080:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f0918000 x1869685708136192/t0(4294968744) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.434104:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x785:0x0] 00000001:00000040:2.0:1783074237.434231:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 4 00000020:00000040:2.0:1783074237.434234:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=9 00010000:00000040:2.0:1783074237.434262:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968744, xid 1869685708136192 00000100:00000040:2.0:1783074237.434270:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.434275:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.434398:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.434414:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.434420:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.434429:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 8 00010000:00080000:2.0:1783074237.434434:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968745 00010000:00080000:2.0:1783074237.434438:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968745 00000100:00000040:3.0:1783074237.436428:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc496680 x1869685708136960 msgsize 440 00000100:00100000:3.0:1783074237.436442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.436513:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708136960 00000100:00100000:1.0:1783074237.436526:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708136960 00000020:00000040:1.0:1783074237.436528:0:24838:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.436533:0:24838:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=9 00000100:00000040:1.0:1783074237.436556:0:24838:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.436595:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 570 00000100:00000040:1.0:1783074237.436599:0:24838:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.436605:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc496680 x1869685708136960/t0(4294968745) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.436618:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2401:x1869685708136960:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.436629:0:24838:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc496680 x1869685708136960/t0(4294968745) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.436655:0:24838:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968745, current: 4294968745, replaying 00010000:00000040:1.0:1783074237.436658:0:24838:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.436677:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc496680 x1869685708136960/t0(4294968745) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.436687:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+9:2401:x1869685708136960:12345-192.168.204.26@tcp:10:dd.0 Request processed in 71us (260us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.436696:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 570 00000100:00000040:1.0:1783074237.436699:0:24838:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.436758:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968745, next_transno: 4294968745 00010000:00080000:2.0:1783074237.436762:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968745) 00010000:00080000:2.0:1783074237.436771:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708136960 t4294968745 from 192.168.204.26@tcp req@ffff9524fc496680 x1869685708136960/t0(4294968745) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.436786:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc496680 x1869685708136960/t0(4294968745) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.436810:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x786:0x0] 00000001:00000040:2.0:1783074237.436953:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 5 00000020:00000040:2.0:1783074237.436956:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=10 00010000:00000040:2.0:1783074237.436987:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968745, xid 1869685708136960 00000100:00000040:2.0:1783074237.436995:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.437001:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.437036:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.437045:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.437050:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.437060:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 9 00010000:00080000:2.0:1783074237.437064:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968746 00010000:00080000:2.0:1783074237.437068:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968746 00000100:00000040:3.0:1783074237.438713:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4685880 x1869685708138880 msgsize 440 00000100:00100000:3.0:1783074237.438726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.438915:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138880 00000100:00100000:2.0:1783074237.438923:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138880 00000020:00000040:2.0:1783074237.438925:0:24844:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.438930:0:24844:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=10 00000100:00000040:2.0:1783074237.438948:0:24844:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.438992:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 571 00000100:00000040:2.0:1783074237.438999:0:24844:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.439007:0:24844:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4685880 x1869685708138880/t0(4294968746) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.439021:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2401:x1869685708138880:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:2.0:1783074237.439033:0:24844:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4685880 x1869685708138880/t0(4294968746) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.439041:0:24844:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968746, current: 4294968746, replaying 00010000:00000040:2.0:1783074237.439044:0:24844:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.439059:0:24844:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4685880 x1869685708138880/t0(4294968746) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.439065:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+10:2401:x1869685708138880:12345-192.168.204.26@tcp:10:dd.0 Request processed in 48us (353us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.439071:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 571 00000100:00000040:2.0:1783074237.439073:0:24844:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:1.0:1783074237.439079:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968746, next_transno: 4294968746 00010000:00080000:1.0:1783074237.439083:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968746) 00010000:00080000:1.0:1783074237.439101:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708138880 t4294968746 from 192.168.204.26@tcp req@ffff9523c4685880 x1869685708138880/t0(4294968746) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.439118:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4685880 x1869685708138880/t0(4294968746) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783074237.439142:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x788:0x0] 00000001:00000040:1.0:1783074237.439296:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 6 00000020:00000040:1.0:1783074237.439299:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=11 00010000:00000040:1.0:1783074237.439360:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968746, xid 1869685708138880 00000100:00000040:1.0:1783074237.439369:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.439374:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.439403:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:1.0:1783074237.439411:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783074237.439416:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.439424:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 10 00010000:00080000:1.0:1783074237.439428:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968747 00010000:00080000:1.0:1783074237.439432:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968747 00000100:00000040:2.0:1783074237.441743:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc307800 x1869685708138752 msgsize 440 00000100:00100000:2.0:1783074237.441759:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.441892:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708138752 00000100:00100000:3.0:1783074237.441901:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708138752 00000020:00000040:3.0:1783074237.441904:0:8449:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.441907:0:8449:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=11 00000100:00000040:3.0:1783074237.441929:0:8449:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.442002:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 572 00000100:00000040:3.0:1783074237.442006:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.442032:0:8449:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc307800 x1869685708138752/t0(4294968747) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.442046:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2401:x1869685708138752:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:3.0:1783074237.442058:0:8449:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc307800 x1869685708138752/t0(4294968747) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.442066:0:8449:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968747, current: 4294968747, replaying 00010000:00000040:3.0:1783074237.442069:0:8449:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.442088:0:8449:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc307800 x1869685708138752/t0(4294968747) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.442098:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2401:x1869685708138752:12345-192.168.204.26@tcp:10:dd.0 Request processed in 55us (355us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.442106:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 572 00000100:00000040:3.0:1783074237.442109:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:1.0:1783074237.442156:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968747, next_transno: 4294968747 00010000:00080000:1.0:1783074237.442160:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968747) 00010000:00080000:1.0:1783074237.442168:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708138752 t4294968747 from 192.168.204.26@tcp req@ffff9524fc307800 x1869685708138752/t0(4294968747) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.442181:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc307800 x1869685708138752/t0(4294968747) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783074237.442201:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x787:0x0] 00000001:00000040:1.0:1783074237.442354:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 7 00000020:00000040:1.0:1783074237.442358:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=12 00010000:00000040:1.0:1783074237.442388:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968747, xid 1869685708138752 00000100:00000040:1.0:1783074237.442397:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.442407:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.442446:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:1.0:1783074237.442454:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783074237.442460:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.442469:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 11 00010000:00080000:1.0:1783074237.442473:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968748 00010000:00080000:1.0:1783074237.442477:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968748 00000100:00000040:3.0:1783074237.444517:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4687100 x1869685708139520 msgsize 440 00000100:00100000:3.0:1783074237.444529:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.444586:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708139520 00000100:00100000:1.0:1783074237.444594:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708139520 00000020:00000040:1.0:1783074237.444596:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.444600:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=12 00000100:00000040:1.0:1783074237.444618:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.444661:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 573 00000100:00000040:1.0:1783074237.444665:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.444671:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4687100 x1869685708139520/t0(4294968748) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.444685:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2401:x1869685708139520:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.444701:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4687100 x1869685708139520/t0(4294968748) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.444708:0:24856:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968748, current: 4294968748, replaying 00010000:00000040:1.0:1783074237.444711:0:24856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.444723:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4687100 x1869685708139520/t0(4294968748) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.444731:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+12:2401:x1869685708139520:12345-192.168.204.26@tcp:10:dd.0 Request processed in 50us (215us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.444738:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 573 00000100:00000040:1.0:1783074237.444741:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.444748:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968748, next_transno: 4294968748 00010000:00080000:2.0:1783074237.444754:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968748) 00010000:00080000:2.0:1783074237.444765:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708139520 t4294968748 from 192.168.204.26@tcp req@ffff9523c4687100 x1869685708139520/t0(4294968748) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.444783:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4687100 x1869685708139520/t0(4294968748) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.444807:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x789:0x0] 00000001:00000040:2.0:1783074237.444945:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 8 00000020:00000040:2.0:1783074237.444956:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=13 00010000:00000040:2.0:1783074237.444989:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968748, xid 1869685708139520 00000100:00000040:2.0:1783074237.444996:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.445001:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.445044:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.445052:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.445057:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.445068:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 12 00010000:00080000:2.0:1783074237.445073:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968749 00010000:00080000:2.0:1783074237.445077:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968749 00000100:00000040:3.0:1783074237.448151:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4686a00 x1869685708141952 msgsize 440 00000100:00100000:3.0:1783074237.448167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.448583:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708141952 00000100:00100000:1.0:1783074237.448592:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708141952 00000020:00000040:1.0:1783074237.448595:0:8448:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.448600:0:8448:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=13 00000100:00000040:1.0:1783074237.448621:0:8448:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.448687:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 574 00000100:00000040:1.0:1783074237.448691:0:8448:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.448698:0:8448:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4686a00 x1869685708141952/t0(4294968749) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.448713:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:2401:x1869685708141952:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.448725:0:8448:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4686a00 x1869685708141952/t0(4294968749) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.448734:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968749, current: 4294968749, replaying 00010000:00000040:1.0:1783074237.448737:0:8448:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.448751:0:8448:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4686a00 x1869685708141952/t0(4294968749) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.448768:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+13:2401:x1869685708141952:12345-192.168.204.26@tcp:10:dd.0 Request processed in 58us (617us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.448776:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 574 00000100:00000040:1.0:1783074237.448780:0:8448:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.448794:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968749, next_transno: 4294968749 00010000:00080000:2.0:1783074237.448800:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968749) 00010000:00080000:2.0:1783074237.448810:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708141952 t4294968749 from 192.168.204.26@tcp req@ffff9523c4686a00 x1869685708141952/t0(4294968749) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.448827:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4686a00 x1869685708141952/t0(4294968749) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.448853:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x791:0x0] 00000001:00000040:2.0:1783074237.449219:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 9 00000020:00000040:2.0:1783074237.449223:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=14 00010000:00000040:2.0:1783074237.449257:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968749, xid 1869685708141952 00000100:00000040:2.0:1783074237.449266:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.449272:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.449352:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.449361:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.449367:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.449378:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 13 00010000:00080000:2.0:1783074237.449382:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968750 00010000:00080000:2.0:1783074237.449386:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968750 00000100:00000040:3.0:1783074237.451623:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf3b80 x1869685708142336 msgsize 440 00000100:00100000:3.0:1783074237.451632:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.451686:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708142336 00000100:00100000:1.0:1783074237.451695:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708142336 00000020:00000040:1.0:1783074237.451697:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.451701:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=14 00000100:00000040:1.0:1783074237.451718:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.451755:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 575 00000100:00000040:1.0:1783074237.451758:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.451763:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf3b80 x1869685708142336/t0(4294968750) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.451774:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2401:x1869685708142336:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.451784:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf3b80 x1869685708142336/t0(4294968750) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.451793:0:24842:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968750, current: 4294968750, replaying 00010000:00000040:1.0:1783074237.451796:0:24842:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.451816:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf3b80 x1869685708142336/t0(4294968750) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.451826:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+14:2401:x1869685708142336:12345-192.168.204.26@tcp:10:dd.0 Request processed in 53us (202us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.451832:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 575 00000100:00000040:1.0:1783074237.451835:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.451902:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968750, next_transno: 4294968750 00010000:00080000:3.0:1783074237.451906:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968750) 00010000:00080000:3.0:1783074237.451914:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708142336 t4294968750 from 192.168.204.26@tcp req@ffff9524debf3b80 x1869685708142336/t0(4294968750) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.451929:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf3b80 x1869685708142336/t0(4294968750) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.451963:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78a:0x0] 00000001:00000040:3.0:1783074237.452098:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 10 00000020:00000040:3.0:1783074237.452102:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=15 00010000:00000040:3.0:1783074237.452130:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968750, xid 1869685708142336 00000100:00000040:3.0:1783074237.452138:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.452144:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.452235:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.452243:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.452248:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.452257:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 14 00010000:00080000:3.0:1783074237.452260:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968751 00010000:00080000:3.0:1783074237.452264:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968751 00000100:00000040:3.0:1783074237.453818:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf2300 x1869685708143744 msgsize 440 00000100:00100000:3.0:1783074237.453830:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.453907:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708143744 00000100:00100000:1.0:1783074237.453919:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708143744 00000020:00000040:1.0:1783074237.453922:0:24838:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.453926:0:24838:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=15 00000100:00000040:1.0:1783074237.453943:0:24838:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.454007:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 576 00000100:00000040:1.0:1783074237.454011:0:24838:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.454017:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf2300 x1869685708143744/t0(4294968751) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.454031:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2401:x1869685708143744:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.454040:0:24838:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2300 x1869685708143744/t0(4294968751) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.454048:0:24838:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968751, current: 4294968751, replaying 00010000:00000040:1.0:1783074237.454051:0:24838:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.454070:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf2300 x1869685708143744/t0(4294968751) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.454080:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+15:2401:x1869685708143744:12345-192.168.204.26@tcp:10:dd.0 Request processed in 51us (261us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.454087:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 576 00000100:00000040:1.0:1783074237.454090:0:24838:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.454125:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968751, next_transno: 4294968751 00010000:00080000:2.0:1783074237.454129:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968751) 00010000:00080000:2.0:1783074237.454136:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708143744 t4294968751 from 192.168.204.26@tcp req@ffff9524debf2300 x1869685708143744/t0(4294968751) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.454148:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2300 x1869685708143744/t0(4294968751) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.454167:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78b:0x0] 00000001:00000040:2.0:1783074237.454294:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 11 00000020:00000040:2.0:1783074237.454298:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=16 00010000:00000040:2.0:1783074237.454342:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968751, xid 1869685708143744 00000100:00000040:2.0:1783074237.454348:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.454352:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.454380:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.454385:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.454388:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.454395:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 15 00010000:00080000:2.0:1783074237.454399:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968752 00010000:00080000:2.0:1783074237.454402:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968752 00000100:00000040:2.0:1783074237.455519:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524fc305c00 x1869685708145536 msgsize 440 00000100:00100000:2.0:1783074237.455529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.455611:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708145536 00000100:00100000:1.0:1783074237.455616:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708145536 00000020:00000040:1.0:1783074237.455618:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.455622:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=16 00000100:00000040:1.0:1783074237.455635:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.455678:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 577 00000100:00000040:1.0:1783074237.455682:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.455688:0:24855:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524fc305c00 x1869685708145536/t0(4294968752) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.455713:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524fc305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:2401:x1869685708145536:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.455723:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc305c00 x1869685708145536/t0(4294968752) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.455730:0:24855:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968752, current: 4294968752, replaying 00010000:00000040:1.0:1783074237.455733:0:24855:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.455746:0:24855:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524fc305c00 x1869685708145536/t0(4294968752) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.455755:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524fc305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+16:2401:x1869685708145536:12345-192.168.204.26@tcp:10:dd.0 Request processed in 45us (234us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.455763:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 577 00000100:00000040:1.0:1783074237.455767:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.455770:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968752, next_transno: 4294968752 00010000:00080000:2.0:1783074237.455775:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968752) 00010000:00080000:2.0:1783074237.455783:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708145536 t4294968752 from 192.168.204.26@tcp req@ffff9524fc305c00 x1869685708145536/t0(4294968752) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.455798:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524fc305c00 x1869685708145536/t0(4294968752) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.455830:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78c:0x0] 00000001:00000040:2.0:1783074237.455935:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 12 00000020:00000040:2.0:1783074237.455938:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=17 00010000:00000040:2.0:1783074237.455956:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968752, xid 1869685708145536 00000100:00000040:2.0:1783074237.455961:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.455964:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.455995:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.456002:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.456006:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.456014:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 16 00010000:00080000:2.0:1783074237.456017:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968753 00010000:00080000:2.0:1783074237.456020:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968753 00000100:00000040:3.0:1783074237.457094:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf0e00 x1869685708146176 msgsize 440 00000100:00100000:3.0:1783074237.457100:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.457145:0:24854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708146176 00000100:00100000:2.0:1783074237.457151:0:24854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708146176 00000020:00000040:2.0:1783074237.457153:0:24854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.457156:0:24854:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=17 00000100:00000040:2.0:1783074237.457170:0:24854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.457198:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 578 00000100:00000040:2.0:1783074237.457202:0:24854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.457209:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf0e00 x1869685708146176/t0(4294968753) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.457224:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:2401:x1869685708146176:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:2.0:1783074237.457233:0:24854:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0e00 x1869685708146176/t0(4294968753) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.457240:0:24854:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968753, current: 4294968753, replaying 00010000:00000040:2.0:1783074237.457243:0:24854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.457264:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf0e00 x1869685708146176/t0(4294968753) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.457274:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+17:2401:x1869685708146176:12345-192.168.204.26@tcp:10:dd.0 Request processed in 55us (178us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.457283:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 578 00010000:00080000:3.0:1783074237.457284:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968753, next_transno: 4294968753 00000100:00000040:2.0:1783074237.457286:0:24854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.457290:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968753) 00010000:00080000:3.0:1783074237.457301:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708146176 t4294968753 from 192.168.204.26@tcp req@ffff9524debf0e00 x1869685708146176/t0(4294968753) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.457350:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0e00 x1869685708146176/t0(4294968753) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.457373:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78d:0x0] 00000001:00000040:3.0:1783074237.457469:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 13 00000020:00000040:3.0:1783074237.457473:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=18 00010000:00000040:3.0:1783074237.457494:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968753, xid 1869685708146176 00000100:00000040:3.0:1783074237.457506:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.457512:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.457546:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.457553:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.457557:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.457565:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 17 00010000:00080000:3.0:1783074237.457568:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968754 00010000:00080000:3.0:1783074237.457572:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968754 00000100:00000040:3.0:1783074237.459513:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf1880 x1869685708147584 msgsize 440 00000100:00100000:3.0:1783074237.459539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.459614:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708147584 00000100:00100000:2.0:1783074237.459620:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708147584 00000020:00000040:2.0:1783074237.459622:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.459626:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=18 00000100:00000040:2.0:1783074237.459653:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.459682:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 579 00000100:00000040:2.0:1783074237.459687:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.459693:0:24837:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf1880 x1869685708147584/t0(4294968754) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.459708:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:2401:x1869685708147584:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:2.0:1783074237.459719:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1880 x1869685708147584/t0(4294968754) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.459727:0:24837:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968754, current: 4294968754, replaying 00010000:00000040:2.0:1783074237.459730:0:24837:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.459746:0:24837:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf1880 x1869685708147584/t0(4294968754) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.459754:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+18:2401:x1869685708147584:12345-192.168.204.26@tcp:10:dd.0 Request processed in 51us (241us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.459761:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 579 00000100:00000040:2.0:1783074237.459764:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.459777:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968754, next_transno: 4294968754 00010000:00080000:3.0:1783074237.459782:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968754) 00010000:00080000:3.0:1783074237.459797:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708147584 t4294968754 from 192.168.204.26@tcp req@ffff9524debf1880 x1869685708147584/t0(4294968754) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.459814:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1880 x1869685708147584/t0(4294968754) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.459837:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78e:0x0] 00000001:00000040:3.0:1783074237.459967:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 14 00000020:00000040:3.0:1783074237.459971:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=19 00010000:00000040:3.0:1783074237.459994:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968754, xid 1869685708147584 00000100:00000040:3.0:1783074237.460000:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.460003:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.460052:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.460060:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.460065:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.460074:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 18 00010000:00080000:3.0:1783074237.460077:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968755 00010000:00080000:3.0:1783074237.460081:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968755 00000100:00000040:2.0:1783074237.464782:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4aea680 x1869685708148736 msgsize 440 00000100:00100000:2.0:1783074237.464798:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.464870:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708148736 00000100:00100000:3.0:1783074237.464880:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708148736 00000020:00000040:3.0:1783074237.464883:0:8450:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.464888:0:8450:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=19 00000100:00000040:3.0:1783074237.464913:0:8450:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.464957:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 580 00000100:00000040:3.0:1783074237.464961:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.464969:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4aea680 x1869685708148736/t0(4294968755) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.464982:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:2401:x1869685708148736:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:3.0:1783074237.464994:0:8450:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4aea680 x1869685708148736/t0(4294968755) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.465004:0:8450:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968755, current: 4294968755, replaying 00010000:00000040:3.0:1783074237.465007:0:8450:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.465023:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aea680 x1869685708148736/t0(4294968755) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.465032:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+19:2401:x1869685708148736:12345-192.168.204.26@tcp:10:dd.0 Request processed in 51us (250us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.465039:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 580 00000100:00000040:3.0:1783074237.465042:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.465050:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968755, next_transno: 4294968755 00010000:00080000:2.0:1783074237.465054:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968755) 00010000:00080000:2.0:1783074237.465063:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708148736 t4294968755 from 192.168.204.26@tcp req@ffff9523c4aea680 x1869685708148736/t0(4294968755) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.465076:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4aea680 x1869685708148736/t0(4294968755) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.465102:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78f:0x0] 00000001:00000040:2.0:1783074237.465252:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 15 00000020:00000040:2.0:1783074237.465255:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=20 00010000:00000040:2.0:1783074237.465285:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968755, xid 1869685708148736 00000100:00000040:2.0:1783074237.465294:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.465300:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.465367:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.465375:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.465380:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.465389:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 19 00010000:00080000:2.0:1783074237.465393:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968756 00010000:00080000:2.0:1783074237.465402:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968756 00000100:00000040:2.0:1783074237.466420:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4ae8e00 x1869685708150144 msgsize 440 00000100:00100000:2.0:1783074237.466429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.466500:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708150144 00000100:00100000:1.0:1783074237.466506:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708150144 00000020:00000040:1.0:1783074237.466508:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.466511:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=20 00000100:00000040:1.0:1783074237.466528:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.466592:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 581 00000100:00000040:1.0:1783074237.466595:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.466599:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4ae8e00 x1869685708150144/t0(4294968756) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.466608:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:2401:x1869685708150144:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.466614:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4ae8e00 x1869685708150144/t0(4294968756) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.466619:0:24842:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968756, current: 4294968756, replaying 00010000:00000040:1.0:1783074237.466626:0:24842:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.466650:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae8e00 x1869685708150144/t0(4294968756) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.466659:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+20:2401:x1869685708150144:12345-192.168.204.26@tcp:10:dd.0 Request processed in 52us (238us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.466670:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 581 00000100:00000040:1.0:1783074237.466673:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.466681:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968756, next_transno: 4294968756 00010000:00080000:3.0:1783074237.466687:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968756) 00010000:00080000:3.0:1783074237.466696:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708150144 t4294968756 from 192.168.204.26@tcp req@ffff9523c4ae8e00 x1869685708150144/t0(4294968756) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.466713:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4ae8e00 x1869685708150144/t0(4294968756) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.466743:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x790:0x0] 00000001:00000040:3.0:1783074237.466874:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 16 00000020:00000040:3.0:1783074237.466878:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=21 00010000:00000040:3.0:1783074237.466901:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968756, xid 1869685708150144 00000100:00000040:3.0:1783074237.466909:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.466914:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.466950:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.466957:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.466961:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.466970:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 20 00010000:00080000:3.0:1783074237.466974:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968757 00010000:00080000:3.0:1783074237.466978:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968757 00000100:00000040:3.0:1783074237.467937:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf1180 x1869685708151168 msgsize 440 00000100:00100000:3.0:1783074237.467945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.468007:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151168 00000100:00100000:1.0:1783074237.468013:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151168 00000020:00000040:1.0:1783074237.468016:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.468019:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=21 00000100:00000040:1.0:1783074237.468035:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.468074:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 582 00000100:00000040:1.0:1783074237.468077:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.468082:0:24843:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf1180 x1869685708151168/t0(4294968757) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.468097:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2401:x1869685708151168:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.468107:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1180 x1869685708151168/t0(4294968757) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.468115:0:24843:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968757, current: 4294968757, replaying 00010000:00000040:1.0:1783074237.468117:0:24843:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.468129:0:24843:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf1180 x1869685708151168/t0(4294968757) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.468137:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+21:2401:x1869685708151168:12345-192.168.204.26@tcp:10:dd.0 Request processed in 45us (199us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.468145:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 582 00010000:00080000:3.0:1783074237.468153:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968757, next_transno: 4294968757 00000100:00000040:1.0:1783074237.468157:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.468159:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968757) 00010000:00080000:3.0:1783074237.468170:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708151168 t4294968757 from 192.168.204.26@tcp req@ffff9524debf1180 x1869685708151168/t0(4294968757) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.468188:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1180 x1869685708151168/t0(4294968757) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.468209:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x792:0x0] 00000001:00000040:3.0:1783074237.468353:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 17 00000020:00000040:3.0:1783074237.468357:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=22 00010000:00000040:3.0:1783074237.468385:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968757, xid 1869685708151168 00000100:00000040:3.0:1783074237.468393:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.468398:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.468441:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.468449:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.468454:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.468462:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 21 00010000:00080000:3.0:1783074237.468467:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968758 00010000:00080000:3.0:1783074237.468471:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968758 00000100:00000040:2.0:1783074237.469486:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4ae9880 x1869685708151296 msgsize 440 00000100:00100000:2.0:1783074237.469503:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.469590:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708151296 00000100:00100000:3.0:1783074237.469597:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708151296 00000020:00000040:3.0:1783074237.469599:0:24844:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.469603:0:24844:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=22 00000100:00000040:3.0:1783074237.469619:0:24844:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.469664:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 583 00000100:00000040:3.0:1783074237.469667:0:24844:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.469673:0:24844:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4ae9880 x1869685708151296/t0(4294968758) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.469687:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2401:x1869685708151296:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:3.0:1783074237.469698:0:24844:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4ae9880 x1869685708151296/t0(4294968758) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.469706:0:24844:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968758, current: 4294968758, replaying 00010000:00000040:3.0:1783074237.469709:0:24844:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.469721:0:24844:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae9880 x1869685708151296/t0(4294968758) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.469733:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+22:2401:x1869685708151296:12345-192.168.204.26@tcp:10:dd.0 Request processed in 49us (247us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.469740:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 583 00000100:00000040:3.0:1783074237.469743:0:24844:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.469755:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968758, next_transno: 4294968758 00010000:00080000:2.0:1783074237.469760:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968758) 00010000:00080000:2.0:1783074237.469769:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708151296 t4294968758 from 192.168.204.26@tcp req@ffff9523c4ae9880 x1869685708151296/t0(4294968758) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.469792:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4ae9880 x1869685708151296/t0(4294968758) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.469817:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x793:0x0] 00000001:00000040:2.0:1783074237.469938:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 18 00000020:00000040:2.0:1783074237.469941:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=23 00010000:00000040:2.0:1783074237.469963:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968758, xid 1869685708151296 00000100:00000040:2.0:1783074237.469969:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.469973:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.470011:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.470016:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.470021:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.470028:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 22 00010000:00080000:2.0:1783074237.470032:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968759 00010000:00080000:2.0:1783074237.470035:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968759 00000100:00000040:2.0:1783074237.473187:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4aeb480 x1869685708152704 msgsize 440 00000100:00100000:2.0:1783074237.473202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.473286:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152704 00000100:00100000:3.0:1783074237.473301:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152704 00000020:00000040:3.0:1783074237.473303:0:8449:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.473308:0:8449:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=23 00000100:00000040:3.0:1783074237.473346:0:8449:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.473424:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 584 00000100:00000040:3.0:1783074237.473432:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.473439:0:8449:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4aeb480 x1869685708152704/t0(4294968759) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.473454:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:2401:x1869685708152704:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:3.0:1783074237.473465:0:8449:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4aeb480 x1869685708152704/t0(4294968759) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.473475:0:8449:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968759, current: 4294968759, replaying 00010000:00000040:3.0:1783074237.473478:0:8449:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.473492:0:8449:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aeb480 x1869685708152704/t0(4294968759) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.473501:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+23:2401:x1869685708152704:12345-192.168.204.26@tcp:10:dd.0 Request processed in 50us (315us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.473508:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 584 00000100:00000040:3.0:1783074237.473511:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.473526:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968759, next_transno: 4294968759 00010000:00080000:2.0:1783074237.473532:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968759) 00010000:00080000:2.0:1783074237.473554:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708152704 t4294968759 from 192.168.204.26@tcp req@ffff9523c4aeb480 x1869685708152704/t0(4294968759) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.473570:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4aeb480 x1869685708152704/t0(4294968759) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783074237.473597:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x794:0x0] 00000001:00000040:2.0:1783074237.473761:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 19 00000020:00000040:2.0:1783074237.473764:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=24 00010000:00000040:2.0:1783074237.473795:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968759, xid 1869685708152704 00000100:00000040:2.0:1783074237.473811:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.473817:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.473865:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.473873:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.473878:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.473887:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 23 00010000:00080000:2.0:1783074237.473891:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968760 00010000:00080000:2.0:1783074237.473895:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968760 00000100:00000040:3.0:1783074237.476770:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf2a00 x1869685708152960 msgsize 440 00000100:00100000:3.0:1783074237.476784:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.477002:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708152960 00000100:00100000:1.0:1783074237.477012:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708152960 00000020:00000040:1.0:1783074237.477015:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.477019:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=24 00000100:00000040:1.0:1783074237.477043:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.477097:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 585 00000100:00000040:1.0:1783074237.477102:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.477108:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf2a00 x1869685708152960/t0(4294968760) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.477127:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:2401:x1869685708152960:12345-192.168.204.26@tcp:10:dd.0 00000020:00000040:1.0:1783074237.477139:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2a00 x1869685708152960/t0(4294968760) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.477148:0:24856:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968760, current: 4294968760, replaying 00010000:00000040:1.0:1783074237.477154:0:24856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.477172:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf2a00 x1869685708152960/t0(4294968760) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.477182:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+24:2401:x1869685708152960:12345-192.168.204.26@tcp:10:dd.0 Request processed in 58us (413us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.477189:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 585 00000100:00000040:1.0:1783074237.477193:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.477209:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968760, next_transno: 4294968760 00010000:00080000:3.0:1783074237.477215:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968760) 00010000:00080000:3.0:1783074237.477225:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708152960 t4294968760 from 192.168.204.26@tcp req@ffff9524debf2a00 x1869685708152960/t0(4294968760) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.477242:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2a00 x1869685708152960/t0(4294968760) o10->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 440/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.477273:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x795:0x0] 00000001:00000040:3.0:1783074237.477438:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 20 00000020:00000040:3.0:1783074237.477442:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=25 00010000:00000040:3.0:1783074237.477485:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968760, xid 1869685708152960 00000100:00000040:3.0:1783074237.477492:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.477496:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.477535:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.477543:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.477549:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.477561:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 24 00010000:00080000:3.0:1783074237.477565:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968761 00010000:00080000:3.0:1783074237.477569:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968761 00000100:00000040:3.0:1783074237.478896:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf2680 x1869685708153600 msgsize 1512 00000100:00100000:3.0:1783074237.478906:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.478958:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708153600 00000100:00100000:1.0:1783074237.478964:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708153600 00000020:00000040:1.0:1783074237.478967:0:8448:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.478971:0:8448:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=25 00000100:00000040:1.0:1783074237.479006:0:8448:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.479043:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 586 00000100:00000040:1.0:1783074237.479048:0:8448:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.479062:0:8448:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf2680 x1869685708153600/t0(4294968761) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.479078:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:2401:x1869685708153600:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.479088:0:8448:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2680 x1869685708153600/t0(4294968761) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.479096:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968761, current: 4294968761, replaying 00010000:00000040:1.0:1783074237.479100:0:8448:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.479118:0:8448:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf2680 x1869685708153600/t0(4294968761) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.479128:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+25:2401:x1869685708153600:12345-192.168.204.26@tcp:4:dd.0 Request processed in 53us (231us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.479139:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 586 00000100:00000040:1.0:1783074237.479142:0:8448:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.479287:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968761, next_transno: 4294968761 00010000:00080000:3.0:1783074237.479291:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968761) 00010000:00080000:3.0:1783074237.479299:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708153600 t4294968761 from 192.168.204.26@tcp req@ffff9524debf2680 x1869685708153600/t0(4294968761) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.479384:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2680 x1869685708153600/t0(4294968761) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783074237.479417:0:96855:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:3.0:1783074237.479651:0:96855:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:3.0:1783074237.479705:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783074237.479733:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:3.0:1783074237.479736:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783074237.480109:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 21 00000020:00000040:3.0:1783074237.480113:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=26 00010000:00000040:3.0:1783074237.480306:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968761, xid 1869685708153600 00000100:00000040:3.0:1783074237.480657:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.480663:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.480705:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.480716:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.480723:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.480733:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 25 00010000:00080000:3.0:1783074237.480738:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968762 00010000:00080000:3.0:1783074237.480743:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968762 00000100:00000040:2.0:1783074237.483108:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4ae9180 x1869685708154240 msgsize 1512 00000100:00100000:2.0:1783074237.483121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.483195:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154240 00000100:00100000:1.0:1783074237.483208:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154240 00000020:00000040:1.0:1783074237.483212:0:24841:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.483216:0:24841:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=26 00000100:00000040:1.0:1783074237.483238:0:24841:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.483283:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 587 00000100:00000040:1.0:1783074237.483288:0:24841:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.483295:0:24841:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4ae9180 x1869685708154240/t0(4294968762) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.483308:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2401:x1869685708154240:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.483348:0:24841:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4ae9180 x1869685708154240/t0(4294968762) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.483368:0:24841:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968762, current: 4294968762, replaying 00010000:00000040:1.0:1783074237.483381:0:24841:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.483395:0:24841:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4ae9180 x1869685708154240/t0(4294968762) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.483403:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+26:2401:x1869685708154240:12345-192.168.204.26@tcp:4:dd.0 Request processed in 98us (295us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.483414:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 587 00000100:00000040:1.0:1783074237.483418:0:24841:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.483427:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968762, next_transno: 4294968762 00010000:00080000:3.0:1783074237.483432:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968762) 00010000:00080000:3.0:1783074237.483442:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708154240 t4294968762 from 192.168.204.26@tcp req@ffff9523c4ae9180 x1869685708154240/t0(4294968762) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.483458:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4ae9180 x1869685708154240/t0(4294968762) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.483535:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783074237.483560:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:3.0:1783074237.483563:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783074237.483767:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 22 00000020:00000040:3.0:1783074237.483771:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=27 00010000:00000040:3.0:1783074237.483963:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968762, xid 1869685708154240 00000100:00000040:3.0:1783074237.483971:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.483976:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.484012:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.484018:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.484022:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.484030:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 26 00010000:00080000:3.0:1783074237.484033:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968763 00010000:00080000:3.0:1783074237.484040:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968763 00000100:00000040:1.0:1783074237.485471:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524df3bb100 x1869685708154496 msgsize 1512 00000100:00100000:1.0:1783074237.485482:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.485525:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154496 00000100:00100000:3.0:1783074237.485532:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154496 00000020:00000040:3.0:1783074237.485535:0:24838:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.485539:0:24838:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=27 00000100:00000040:3.0:1783074237.485554:0:24838:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.485589:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 588 00000100:00000040:3.0:1783074237.485593:0:24838:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.485600:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df3bb100 x1869685708154496/t0(4294968763) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.485614:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2401:x1869685708154496:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:3.0:1783074237.485625:0:24838:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3bb100 x1869685708154496/t0(4294968763) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.485634:0:24838:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968763, current: 4294968763, replaying 00010000:00000040:3.0:1783074237.485637:0:24838:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.485661:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df3bb100 x1869685708154496/t0(4294968763) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.485668:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+27:2401:x1869685708154496:12345-192.168.204.26@tcp:4:dd.0 Request processed in 57us (197us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.485673:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 588 00000100:00000040:3.0:1783074237.485675:0:24838:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.485694:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968763, next_transno: 4294968763 00010000:00080000:2.0:1783074237.485699:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968763) 00010000:00080000:2.0:1783074237.485708:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708154496 t4294968763 from 192.168.204.26@tcp req@ffff9524df3bb100 x1869685708154496/t0(4294968763) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.485723:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3bb100 x1869685708154496/t0(4294968763) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.485786:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783074237.485806:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:2.0:1783074237.485809:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783074237.485984:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 23 00000020:00000040:2.0:1783074237.485987:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=28 00010000:00000040:2.0:1783074237.486622:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968763, xid 1869685708154496 00000100:00000040:2.0:1783074237.486631:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.486636:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.486687:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.486695:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.486702:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.486710:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 27 00010000:00080000:2.0:1783074237.486720:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968764 00010000:00080000:2.0:1783074237.486724:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968764 00000100:00000040:2.0:1783074237.488427:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9523c4aead80 x1869685708154752 msgsize 1512 00000100:00100000:2.0:1783074237.488437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.489043:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708154752 00000100:00100000:1.0:1783074237.489052:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708154752 00000020:00000040:1.0:1783074237.489054:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.489059:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=28 00000100:00000040:1.0:1783074237.489079:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.489122:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 589 00000100:00000040:1.0:1783074237.489126:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.489132:0:24855:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c4aead80 x1869685708154752/t0(4294968764) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.489147:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:2401:x1869685708154752:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.489159:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4aead80 x1869685708154752/t0(4294968764) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.489167:0:24855:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968764, current: 4294968764, replaying 00010000:00000040:1.0:1783074237.489170:0:24855:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.489182:0:24855:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c4aead80 x1869685708154752/t0(4294968764) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.489198:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+28:2401:x1869685708154752:12345-192.168.204.26@tcp:4:dd.0 Request processed in 54us (770us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.489207:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 589 00000100:00000040:1.0:1783074237.489210:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.489214:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968764, next_transno: 4294968764 00010000:00080000:2.0:1783074237.489219:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968764) 00010000:00080000:2.0:1783074237.489229:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708154752 t4294968764 from 192.168.204.26@tcp req@ffff9523c4aead80 x1869685708154752/t0(4294968764) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.489246:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c4aead80 x1869685708154752/t0(4294968764) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.489395:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783074237.489420:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:2.0:1783074237.489423:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783074237.489671:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 24 00000020:00000040:2.0:1783074237.489675:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=29 00010000:00000040:2.0:1783074237.490281:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968764, xid 1869685708154752 00000100:00000040:2.0:1783074237.490291:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.490297:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.490415:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.490426:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.490433:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.490443:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 28 00010000:00080000:2.0:1783074237.490447:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968765 00010000:00080000:2.0:1783074237.490452:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968765 00000100:00000040:1.0:1783074237.491695:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524df3bbb80 x1869685708155008 msgsize 1512 00000100:00100000:1.0:1783074237.491702:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.491939:0:24854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155008 00000100:00100000:2.0:1783074237.491947:0:24854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155008 00000020:00000040:2.0:1783074237.491950:0:24854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.491953:0:24854:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=29 00000100:00000040:2.0:1783074237.491978:0:24854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.492017:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 590 00000100:00000040:2.0:1783074237.492021:0:24854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.492027:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df3bbb80 x1869685708155008/t0(4294968765) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.492042:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2401:x1869685708155008:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:2.0:1783074237.492052:0:24854:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3bbb80 x1869685708155008/t0(4294968765) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.492061:0:24854:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968765, current: 4294968765, replaying 00010000:00000040:2.0:1783074237.492064:0:24854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.492079:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df3bbb80 x1869685708155008/t0(4294968765) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.492092:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+29:2401:x1869685708155008:12345-192.168.204.26@tcp:4:dd.0 Request processed in 50us (393us total) trans 0 rc 0/-999 00010000:00080000:3.0:1783074237.492110:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968765, next_transno: 4294968765 00010000:00080000:3.0:1783074237.492115:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968765) 00010000:00080000:3.0:1783074237.492124:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708155008 t4294968765 from 192.168.204.26@tcp req@ffff9524df3bbb80 x1869685708155008/t0(4294968765) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.492139:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3bbb80 x1869685708155008/t0(4294968765) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.492161:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 590 00000100:00000040:2.0:1783074237.492165:0:24854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00000020:00000040:3.0:1783074237.492220:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783074237.492246:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:3.0:1783074237.492248:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783074237.492515:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 25 00000020:00000040:3.0:1783074237.492519:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=30 00010000:00000040:3.0:1783074237.492793:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968765, xid 1869685708155008 00000100:00000040:3.0:1783074237.492801:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.492806:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.492835:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.492840:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.492843:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.492849:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 29 00010000:00080000:3.0:1783074237.492852:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968766 00010000:00080000:3.0:1783074237.492855:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968766 00000100:00000040:1.0:1783074237.494496:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524df3bb480 x1869685708155264 msgsize 1512 00000100:00100000:1.0:1783074237.494504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.494579:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155264 00000100:00100000:3.0:1783074237.494585:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155264 00000020:00000040:3.0:1783074237.494586:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.494589:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=30 00000100:00000040:3.0:1783074237.494604:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.495672:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 591 00000100:00000040:3.0:1783074237.495676:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.495682:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df3bb480 x1869685708155264/t0(4294968766) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.495693:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2401:x1869685708155264:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:3.0:1783074237.495702:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3bb480 x1869685708155264/t0(4294968766) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.495707:0:24856:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968766, current: 4294968766, replaying 00010000:00000040:3.0:1783074237.495719:0:24856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.495736:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df3bb480 x1869685708155264/t0(4294968766) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.495743:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+30:2401:x1869685708155264:12345-192.168.204.26@tcp:4:dd.0 Request processed in 52us (1247us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.495748:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 591 00000100:00000040:3.0:1783074237.495750:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:2.0:1783074237.495844:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968766, next_transno: 4294968766 00010000:00080000:2.0:1783074237.495847:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968766) 00010000:00080000:2.0:1783074237.495853:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708155264 t4294968766 from 192.168.204.26@tcp req@ffff9524df3bb480 x1869685708155264/t0(4294968766) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.495865:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3bb480 x1869685708155264/t0(4294968766) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783074237.495936:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783074237.495962:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:2.0:1783074237.495965:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783074237.496280:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 26 00000020:00000040:2.0:1783074237.496285:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=31 00010000:00000040:2.0:1783074237.496534:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968766, xid 1869685708155264 00000100:00000040:2.0:1783074237.496545:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:2.0:1783074237.496552:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:2.0:1783074237.496628:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:2.0:1783074237.496637:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783074237.496652:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:2.0:1783074237.496662:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 30 00010000:00080000:2.0:1783074237.496666:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968767 00010000:00080000:2.0:1783074237.496670:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968767 00000100:00000040:3.0:1783074237.499051:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf3800 x1869685708155520 msgsize 1512 00000100:00100000:3.0:1783074237.499059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074237.499135:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155520 00000100:00100000:0.0:1783074237.499144:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155520 00000020:00000040:0.0:1783074237.499147:0:8450:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:0.0:1783074237.499151:0:8450:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=31 00000100:00000040:0.0:1783074237.499176:0:8450:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783074237.499220:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 592 00000100:00000040:0.0:1783074237.499224:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:0.0:1783074237.499231:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf3800 x1869685708155520/t0(4294968767) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074237.499243:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2401:x1869685708155520:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:0.0:1783074237.499253:0:8450:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf3800 x1869685708155520/t0(4294968767) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783074237.499261:0:8450:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968767, current: 4294968767, replaying 00010000:00000040:0.0:1783074237.499264:0:8450:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:0.0:1783074237.499282:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf3800 x1869685708155520/t0(4294968767) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074237.499297:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+31:2401:x1869685708155520:12345-192.168.204.26@tcp:4:dd.0 Request processed in 57us (245us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074237.499304:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 592 00000100:00000040:0.0:1783074237.499307:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.499345:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968767, next_transno: 4294968767 00010000:00080000:3.0:1783074237.499353:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968767) 00010000:00080000:3.0:1783074237.499359:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708155520 t4294968767 from 192.168.204.26@tcp req@ffff9524debf3800 x1869685708155520/t0(4294968767) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.499371:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf3800 x1869685708155520/t0(4294968767) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.499433:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783074237.499453:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:3.0:1783074237.499456:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783074237.499611:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 27 00000020:00000040:3.0:1783074237.499614:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=32 00010000:00000040:3.0:1783074237.499872:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968767, xid 1869685708155520 00000100:00000040:3.0:1783074237.499881:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.499887:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.499921:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.499929:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.499933:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.499943:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 31 00010000:00080000:3.0:1783074237.499951:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968768 00010000:00080000:3.0:1783074237.499955:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968768 00000100:00000040:3.0:1783074237.501436:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf0a80 x1869685708155776 msgsize 1512 00000100:00100000:3.0:1783074237.501446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.501559:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708155776 00000100:00100000:1.0:1783074237.501565:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708155776 00000020:00000040:1.0:1783074237.501569:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.501573:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=32 00000100:00000040:1.0:1783074237.501591:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.501626:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 593 00000100:00000040:1.0:1783074237.501630:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.501636:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf0a80 x1869685708155776/t0(4294968768) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.501664:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:2401:x1869685708155776:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.501673:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0a80 x1869685708155776/t0(4294968768) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.501681:0:24842:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968768, current: 4294968768, replaying 00010000:00000040:1.0:1783074237.501685:0:24842:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.501699:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf0a80 x1869685708155776/t0(4294968768) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.501708:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+32:2401:x1869685708155776:12345-192.168.204.26@tcp:4:dd.0 Request processed in 47us (272us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.501780:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 593 00000100:00000040:1.0:1783074237.501783:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.501818:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968768, next_transno: 4294968768 00010000:00080000:0.0:1783074237.501823:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968768) 00010000:00080000:0.0:1783074237.501831:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708155776 t4294968768 from 192.168.204.26@tcp req@ffff9524debf0a80 x1869685708155776/t0(4294968768) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.501847:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0a80 x1869685708155776/t0(4294968768) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.501921:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.501944:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.501948:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.502291:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 28 00000020:00000040:0.0:1783074237.502296:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=33 00010000:00000040:0.0:1783074237.502542:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968768, xid 1869685708155776 00000100:00000040:0.0:1783074237.502553:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.502559:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.502675:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.502684:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.502691:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.502703:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 32 00010000:00080000:0.0:1783074237.502708:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968769 00010000:00080000:0.0:1783074237.502712:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968769 00000100:00000040:1.0:1783074237.505355:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524df3b8a80 x1869685708156032 msgsize 1512 00000100:00100000:1.0:1783074237.505367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.505470:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156032 00000100:00100000:3.0:1783074237.505478:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156032 00000020:00000040:3.0:1783074237.505481:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.505486:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=33 00000100:00000040:3.0:1783074237.505511:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.505556:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 594 00000100:00000040:3.0:1783074237.505561:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.505570:0:24843:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524df3b8a80 x1869685708156032/t0(4294968769) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.505583:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2401:x1869685708156032:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:3.0:1783074237.505594:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3b8a80 x1869685708156032/t0(4294968769) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.505602:0:24843:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968769, current: 4294968769, replaying 00010000:00000040:3.0:1783074237.505605:0:24843:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.505621:0:24843:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524df3b8a80 x1869685708156032/t0(4294968769) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.505629:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+33:2401:x1869685708156032:12345-192.168.204.26@tcp:4:dd.0 Request processed in 49us (275us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.505636:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 594 00000100:00000040:3.0:1783074237.505655:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.506458:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968769, next_transno: 4294968769 00010000:00080000:0.0:1783074237.506463:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968769) 00010000:00080000:0.0:1783074237.506479:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708156032 t4294968769 from 192.168.204.26@tcp req@ffff9524df3b8a80 x1869685708156032/t0(4294968769) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.506497:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524df3b8a80 x1869685708156032/t0(4294968769) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.506575:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.506600:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.506603:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.506851:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 29 00000020:00000040:0.0:1783074237.506856:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=34 00010000:00000040:3.0:1783074237.509148:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968769, xid 1869685708156032 00000100:00000040:3.0:1783074237.509164:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.509178:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.509229:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.509240:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.509249:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.509263:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 33 00010000:00080000:3.0:1783074237.509269:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968770 00010000:00080000:3.0:1783074237.509273:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968770 00000100:00000040:3.0:1783074237.511685:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf2d80 x1869685708156288 msgsize 1512 00000100:00100000:3.0:1783074237.511696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.512009:0:24844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156288 00000100:00100000:2.0:1783074237.512019:0:24844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156288 00000020:00000040:2.0:1783074237.512022:0:24844:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.512027:0:24844:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=34 00000100:00000040:2.0:1783074237.512049:0:24844:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.512131:0:24844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 595 00000100:00000040:2.0:1783074237.512135:0:24844:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.512143:0:24844:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf2d80 x1869685708156288/t0(4294968770) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.512162:0:24844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:2401:x1869685708156288:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:2.0:1783074237.512173:0:24844:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2d80 x1869685708156288/t0(4294968770) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.512182:0:24844:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968770, current: 4294968770, replaying 00010000:00000040:2.0:1783074237.512185:0:24844:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.512202:0:24844:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf2d80 x1869685708156288/t0(4294968770) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.512224:0:24844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+34:2401:x1869685708156288:12345-192.168.204.26@tcp:4:dd.0 Request processed in 65us (538us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.512231:0:24844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 595 00000100:00000040:2.0:1783074237.512234:0:24844:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.512270:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968770, next_transno: 4294968770 00010000:00080000:3.0:1783074237.512275:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968770) 00010000:00080000:3.0:1783074237.512283:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708156288 t4294968770 from 192.168.204.26@tcp req@ffff9524debf2d80 x1869685708156288/t0(4294968770) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.512298:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf2d80 x1869685708156288/t0(4294968770) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.512430:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783074237.512455:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:3.0:1783074237.512457:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783074237.512633:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 30 00000020:00000040:3.0:1783074237.512636:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=35 00010000:00000040:0.0:1783074237.513445:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968770, xid 1869685708156288 00000100:00000040:0.0:1783074237.513457:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.513464:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.513607:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.513617:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.513623:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.513633:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 34 00010000:00080000:0.0:1783074237.513652:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968771 00010000:00080000:0.0:1783074237.513657:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968771 00000100:00000040:3.0:1783074237.514764:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf1c00 x1869685708156544 msgsize 1512 00000100:00100000:3.0:1783074237.514773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.514960:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156544 00000100:00100000:2.0:1783074237.514967:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156544 00000020:00000040:2.0:1783074237.514970:0:8449:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.514974:0:8449:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=35 00000100:00000040:2.0:1783074237.514992:0:8449:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.515029:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 596 00000100:00000040:2.0:1783074237.515034:0:8449:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.515041:0:8449:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf1c00 x1869685708156544/t0(4294968771) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.515056:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2401:x1869685708156544:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:2.0:1783074237.515068:0:8449:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1c00 x1869685708156544/t0(4294968771) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.515077:0:8449:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968771, current: 4294968771, replaying 00010000:00000040:2.0:1783074237.515080:0:8449:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.515092:0:8449:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf1c00 x1869685708156544/t0(4294968771) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.515102:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+35:2401:x1869685708156544:12345-192.168.204.26@tcp:4:dd.0 Request processed in 50us (337us total) trans 0 rc 0/-999 00010000:00080000:0.0:1783074237.515109:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968771, next_transno: 4294968771 00000100:00100000:2.0:1783074237.515110:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 596 00000100:00000040:2.0:1783074237.515116:0:8449:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.515117:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968771) 00010000:00080000:0.0:1783074237.515129:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708156544 t4294968771 from 192.168.204.26@tcp req@ffff9524debf1c00 x1869685708156544/t0(4294968771) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.515147:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1c00 x1869685708156544/t0(4294968771) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.515215:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.515238:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.515241:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.515464:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 31 00000020:00000040:0.0:1783074237.515469:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=36 00010000:00000040:0.0:1783074237.515763:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968771, xid 1869685708156544 00000100:00000040:0.0:1783074237.515772:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.515778:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.515816:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.515824:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.515829:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.515838:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 35 00010000:00080000:0.0:1783074237.515842:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968772 00010000:00080000:0.0:1783074237.515845:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968772 00000100:00000040:1.0:1783074237.517280:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c1500 x1869685708156800 msgsize 1512 00000100:00100000:1.0:1783074237.517289:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.517734:0:24837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708156800 00000100:00100000:2.0:1783074237.517748:0:24837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708156800 00000020:00000040:2.0:1783074237.517752:0:24837:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.517756:0:24837:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=36 00000100:00000040:2.0:1783074237.517773:0:24837:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783074237.517812:0:24837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 597 00000100:00000040:2.0:1783074237.517816:0:24837:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:2.0:1783074237.517824:0:24837:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c1500 x1869685708156800/t0(4294968772) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.517838:0:24837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2401:x1869685708156800:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:2.0:1783074237.517847:0:24837:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c1500 x1869685708156800/t0(4294968772) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783074237.517855:0:24837:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968772, current: 4294968772, replaying 00010000:00000040:2.0:1783074237.517858:0:24837:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:2.0:1783074237.517919:0:24837:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c1500 x1869685708156800/t0(4294968772) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783074237.517928:0:24837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+36:2401:x1869685708156800:12345-192.168.204.26@tcp:4:dd.0 Request processed in 93us (647us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.517934:0:24837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 597 00000100:00000040:2.0:1783074237.517938:0:24837:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.517944:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968772, next_transno: 4294968772 00010000:00080000:0.0:1783074237.517949:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968772) 00010000:00080000:0.0:1783074237.517959:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708156800 t4294968772 from 192.168.204.26@tcp req@ffff9523c49c1500 x1869685708156800/t0(4294968772) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.517975:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c1500 x1869685708156800/t0(4294968772) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.518047:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.518072:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.518075:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.518356:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 32 00000020:00000040:0.0:1783074237.518360:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=37 00010000:00000040:0.0:1783074237.518509:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968772, xid 1869685708156800 00000100:00000040:0.0:1783074237.518519:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.518524:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.518559:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.518566:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.518572:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.518585:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 36 00010000:00080000:0.0:1783074237.518590:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968773 00010000:00080000:0.0:1783074237.518595:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968773 00000100:00000040:0.0:1783074237.520547:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524f092c700 x1869685708157056 msgsize 1512 00000100:00100000:0.0:1783074237.520558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.520651:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157056 00000100:00100000:1.0:1783074237.520659:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157056 00000020:00000040:1.0:1783074237.520662:0:8450:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.520666:0:8450:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=37 00000100:00000040:1.0:1783074237.520685:0:8450:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.520729:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 598 00000100:00000040:1.0:1783074237.520733:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.520740:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524f092c700 x1869685708157056/t0(4294968773) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.520753:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:2401:x1869685708157056:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.520764:0:8450:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f092c700 x1869685708157056/t0(4294968773) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.520773:0:8450:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968773, current: 4294968773, replaying 00010000:00000040:1.0:1783074237.520777:0:8450:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.520827:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524f092c700 x1869685708157056/t0(4294968773) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.520836:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+37:2401:x1869685708157056:12345-192.168.204.26@tcp:4:dd.0 Request processed in 85us (289us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.520843:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 598 00000100:00000040:1.0:1783074237.520851:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.520881:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968773, next_transno: 4294968773 00010000:00080000:0.0:1783074237.520885:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968773) 00010000:00080000:0.0:1783074237.520893:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708157056 t4294968773 from 192.168.204.26@tcp req@ffff9524f092c700 x1869685708157056/t0(4294968773) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.520906:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524f092c700 x1869685708157056/t0(4294968773) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.520976:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.521146:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.521149:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.521427:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 33 00000020:00000040:0.0:1783074237.521431:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=38 00010000:00000040:3.0:1783074237.521855:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968773, xid 1869685708157056 00000100:00000040:3.0:1783074237.521866:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.521872:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.521916:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.521925:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.521930:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.521945:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 37 00010000:00080000:3.0:1783074237.521949:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968774 00010000:00080000:3.0:1783074237.521952:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968774 00000100:00000040:1.0:1783074237.524084:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c0e00 x1869685708157312 msgsize 1512 00000100:00100000:1.0:1783074237.524095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.524130:0:24841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157312 00000100:00100000:3.0:1783074237.524138:0:24841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157312 00000020:00000040:3.0:1783074237.524141:0:24841:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.524145:0:24841:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=38 00000100:00000040:3.0:1783074237.524162:0:24841:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.524197:0:24841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 599 00000100:00000040:3.0:1783074237.524201:0:24841:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.524208:0:24841:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c0e00 x1869685708157312/t0(4294968774) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.524222:0:24841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2401:x1869685708157312:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:3.0:1783074237.524232:0:24841:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c0e00 x1869685708157312/t0(4294968774) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.524240:0:24841:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968774, current: 4294968774, replaying 00010000:00000040:3.0:1783074237.524242:0:24841:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.524257:0:24841:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c0e00 x1869685708157312/t0(4294968774) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.524271:0:24841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+38:2401:x1869685708157312:12345-192.168.204.26@tcp:4:dd.0 Request processed in 50us (185us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.524278:0:24841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 599 00010000:00080000:0.0:1783074237.524279:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968774, next_transno: 4294968774 00000100:00000040:3.0:1783074237.524282:0:24841:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.524283:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968774) 00010000:00080000:0.0:1783074237.524290:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708157312 t4294968774 from 192.168.204.26@tcp req@ffff9523c49c0e00 x1869685708157312/t0(4294968774) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.524308:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c0e00 x1869685708157312/t0(4294968774) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.524402:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.524427:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.524431:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.524608:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 34 00000020:00000040:0.0:1783074237.524610:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=39 00010000:00000040:0.0:1783074237.524847:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968774, xid 1869685708157312 00000100:00000040:0.0:1783074237.524857:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.524862:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.524939:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.524947:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.524952:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.524959:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 38 00010000:00080000:0.0:1783074237.524963:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968775 00010000:00080000:0.0:1783074237.524966:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968775 00000100:00000040:1.0:1783074237.526300:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c0000 x1869685708157568 msgsize 1512 00000100:00100000:1.0:1783074237.526441:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.526514:0:24838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157568 00000100:00100000:3.0:1783074237.526521:0:24838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157568 00000020:00000040:3.0:1783074237.526523:0:24838:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.526527:0:24838:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=39 00000100:00000040:3.0:1783074237.526553:0:24838:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.526685:0:24838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 600 00000100:00000040:3.0:1783074237.526688:0:24838:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.526693:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c0000 x1869685708157568/t0(4294968775) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.526702:0:24838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2401:x1869685708157568:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:3.0:1783074237.526709:0:24838:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c0000 x1869685708157568/t0(4294968775) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.526714:0:24838:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968775, current: 4294968775, replaying 00010000:00000040:3.0:1783074237.526717:0:24838:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.526729:0:24838:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c0000 x1869685708157568/t0(4294968775) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.526735:0:24838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+39:2401:x1869685708157568:12345-192.168.204.26@tcp:4:dd.0 Request processed in 34us (435us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.526740:0:24838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 600 00000100:00000040:3.0:1783074237.526742:0:24838:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.526766:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968775, next_transno: 4294968775 00010000:00080000:0.0:1783074237.526769:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968775) 00010000:00080000:0.0:1783074237.526774:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708157568 t4294968775 from 192.168.204.26@tcp req@ffff9523c49c0000 x1869685708157568/t0(4294968775) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.526785:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c0000 x1869685708157568/t0(4294968775) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.526835:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.526852:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.526853:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.527032:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 35 00000020:00000040:0.0:1783074237.527036:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=40 00010000:00000040:0.0:1783074237.527258:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968775, xid 1869685708157568 00000100:00000040:0.0:1783074237.527266:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.527270:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.527395:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.527403:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.527408:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.527416:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 39 00010000:00080000:0.0:1783074237.527419:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968776 00010000:00080000:0.0:1783074237.527428:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968776 00000100:00000040:3.0:1783074237.529222:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf1500 x1869685708157824 msgsize 1512 00000100:00100000:3.0:1783074237.529233:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.529290:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708157824 00000100:00100000:1.0:1783074237.529297:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708157824 00000020:00000040:1.0:1783074237.529300:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.529303:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=40 00000100:00000040:1.0:1783074237.529584:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.529621:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 601 00000100:00000040:1.0:1783074237.529624:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.529629:0:24855:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf1500 x1869685708157824/t0(4294968776) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.529649:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:2401:x1869685708157824:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.529660:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1500 x1869685708157824/t0(4294968776) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.529667:0:24855:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968776, current: 4294968776, replaying 00010000:00000040:1.0:1783074237.529670:0:24855:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.529685:0:24855:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf1500 x1869685708157824/t0(4294968776) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.529694:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+40:2401:x1869685708157824:12345-192.168.204.26@tcp:4:dd.0 Request processed in 57us (472us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.529702:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 601 00000100:00000040:1.0:1783074237.529708:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:0.0:1783074237.529736:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968776, next_transno: 4294968776 00010000:00080000:0.0:1783074237.529741:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968776) 00010000:00080000:0.0:1783074237.529749:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708157824 t4294968776 from 192.168.204.26@tcp req@ffff9524debf1500 x1869685708157824/t0(4294968776) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.529766:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1500 x1869685708157824/t0(4294968776) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783074237.529837:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783074237.529862:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:0.0:1783074237.529865:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783074237.530064:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 36 00000020:00000040:0.0:1783074237.530068:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=41 00010000:00000040:0.0:1783074237.530253:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968776, xid 1869685708157824 00000100:00000040:0.0:1783074237.530262:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:0.0:1783074237.530266:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:0.0:1783074237.530298:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:0.0:1783074237.530306:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783074237.530691:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:0.0:1783074237.530703:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 40 00010000:00080000:0.0:1783074237.530708:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968777 00010000:00080000:0.0:1783074237.530711:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968777 00000100:00000040:3.0:1783074237.531418:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf0380 x1869685708158080 msgsize 1512 00000100:00100000:3.0:1783074237.531426:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074237.531451:0:24854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158080 00000100:00100000:0.0:1783074237.531509:0:24854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158080 00000020:00000040:0.0:1783074237.531512:0:24854:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:0.0:1783074237.531516:0:24854:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=41 00000100:00000040:0.0:1783074237.531532:0:24854:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783074237.531567:0:24854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 602 00000100:00000040:0.0:1783074237.531572:0:24854:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:0.0:1783074237.531584:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf0380 x1869685708158080/t0(4294968777) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074237.531599:0:24854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:2401:x1869685708158080:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:0.0:1783074237.531608:0:24854:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0380 x1869685708158080/t0(4294968777) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783074237.531616:0:24854:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968777, current: 4294968777, replaying 00010000:00000040:0.0:1783074237.531618:0:24854:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:0.0:1783074237.531627:0:24854:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf0380 x1869685708158080/t0(4294968777) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074237.531635:0:24854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+41:2401:x1869685708158080:12345-192.168.204.26@tcp:4:dd.0 Request processed in 41us (216us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783074237.531653:0:24854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 602 00000100:00000040:0.0:1783074237.531656:0:24854:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:3.0:1783074237.532846:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968777, next_transno: 4294968777 00010000:00080000:3.0:1783074237.532851:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968777) 00010000:00080000:3.0:1783074237.532861:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708158080 t4294968777 from 192.168.204.26@tcp req@ffff9524debf0380 x1869685708158080/t0(4294968777) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.532877:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0380 x1869685708158080/t0(4294968777) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783074237.532951:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783074237.532974:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:3.0:1783074237.532977:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783074237.533176:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 37 00000020:00000040:3.0:1783074237.533180:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=42 00010000:00000040:3.0:1783074237.533406:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968777, xid 1869685708158080 00000100:00000040:3.0:1783074237.533416:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:3.0:1783074237.533424:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:3.0:1783074237.533468:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:3.0:1783074237.533477:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783074237.533483:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:3.0:1783074237.533495:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 41 00010000:00080000:3.0:1783074237.533499:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968778 00010000:00080000:3.0:1783074237.533503:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968778 00000100:00000040:1.0:1783074237.539849:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c1c00 x1869685708158336 msgsize 1512 00000100:00100000:1.0:1783074237.539865:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.539904:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158336 00000100:00100000:1.0:1783074237.539912:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158336 00000020:00000040:1.0:1783074237.539915:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.539919:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=42 00000100:00000040:1.0:1783074237.539943:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783074237.539986:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 603 00000100:00000040:1.0:1783074237.539990:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.539998:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c1c00 x1869685708158336/t0(4294968778) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.540013:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:2401:x1869685708158336:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:1.0:1783074237.540024:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c1c00 x1869685708158336/t0(4294968778) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.540032:0:24856:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968778, current: 4294968778, replaying 00010000:00000040:1.0:1783074237.540036:0:24856:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.540049:0:24856:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c1c00 x1869685708158336/t0(4294968778) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783074237.540058:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+42:2401:x1869685708158336:12345-192.168.204.26@tcp:4:dd.0 Request processed in 49us (209us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.540064:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 603 00000100:00000040:1.0:1783074237.540068:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:1.0:1783074237.540085:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968778, next_transno: 4294968778 00010000:00080000:1.0:1783074237.540089:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968778) 00010000:00080000:1.0:1783074237.540098:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708158336 t4294968778 from 192.168.204.26@tcp req@ffff9523c49c1c00 x1869685708158336/t0(4294968778) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.540111:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c1c00 x1869685708158336/t0(4294968778) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.540207:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783074237.540235:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:1.0:1783074237.540239:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783074237.540553:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 38 00000020:00000040:1.0:1783074237.540557:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=43 00010000:00000040:1.0:1783074237.542832:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968778, xid 1869685708158336 00000100:00000040:1.0:1783074237.542847:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.542856:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.542905:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:1.0:1783074237.542915:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783074237.542925:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.542937:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 42 00010000:00080000:1.0:1783074237.542942:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968779 00010000:00080000:1.0:1783074237.542947:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968779 00000100:00000040:1.0:1783074237.544233:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c3800 x1869685708158592 msgsize 1512 00000100:00100000:1.0:1783074237.544240:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.544261:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158592 00000100:00100000:1.0:1783074237.544267:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158592 00000020:00000040:1.0:1783074237.544268:0:8448:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.544271:0:8448:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=43 00000100:00000040:1.0:1783074237.544285:0:8448:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783074237.544425:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 604 00000100:00000040:0.0:1783074237.544431:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:0.0:1783074237.544439:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c3800 x1869685708158592/t0(4294968779) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783074237.544455:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:2401:x1869685708158592:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:0.0:1783074237.544466:0:8450:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c3800 x1869685708158592/t0(4294968779) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783074237.544474:0:8450:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968779, current: 4294968779, replaying 00010000:00000040:0.0:1783074237.544477:0:8450:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:0.0:1783074237.544496:0:8450:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c3800 x1869685708158592/t0(4294968779) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783074237.544518:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968779, next_transno: 4294968779 00000100:00100000:0.0:1783074237.544518:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+43:2401:x1869685708158592:12345-192.168.204.26@tcp:4:dd.0 Request processed in 67us (282us total) trans 0 rc 0/-999 00010000:00080000:1.0:1783074237.544522:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968779) 00000100:00100000:0.0:1783074237.544525:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 604 00000100:00000040:0.0:1783074237.544528:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:1.0:1783074237.544529:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708158592 t4294968779 from 192.168.204.26@tcp req@ffff9523c49c3800 x1869685708158592/t0(4294968779) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.544544:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c3800 x1869685708158592/t0(4294968779) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.544618:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783074237.544654:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:1.0:1783074237.544657:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783074237.544848:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 39 00000020:00000040:1.0:1783074237.544852:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=44 00010000:00000040:1.0:1783074237.545403:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968779, xid 1869685708158592 00000100:00000040:1.0:1783074237.545412:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.545419:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.545449:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:1.0:1783074237.545456:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783074237.545462:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.545471:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 43 00010000:00080000:1.0:1783074237.545475:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968780 00010000:00080000:1.0:1783074237.545479:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968780 00000100:00000040:1.0:1783074237.547434:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c2a00 x1869685708158848 msgsize 1512 00000100:00100000:1.0:1783074237.547446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074237.547481:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708158848 00000100:00100000:3.0:1783074237.547488:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708158848 00000020:00000040:3.0:1783074237.547491:0:24842:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:3.0:1783074237.547495:0:24842:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=44 00000100:00000040:3.0:1783074237.547513:0:24842:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783074237.547551:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 605 00000100:00000040:3.0:1783074237.547555:0:24842:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:3.0:1783074237.547562:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c2a00 x1869685708158848/t0(4294968780) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.547577:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+44:2401:x1869685708158848:12345-192.168.204.26@tcp:4:dd.0 00000020:00000040:3.0:1783074237.547587:0:24842:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c2a00 x1869685708158848/t0(4294968780) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783074237.547595:0:24842:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968780, current: 4294968780, replaying 00010000:00000040:3.0:1783074237.547603:0:24842:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:3.0:1783074237.547616:0:24842:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c2a00 x1869685708158848/t0(4294968780) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783074237.547626:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+44:2401:x1869685708158848:12345-192.168.204.26@tcp:4:dd.0 Request processed in 52us (190us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.547635:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 605 00000100:00000040:3.0:1783074237.547651:0:24842:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00010000:00080000:1.0:1783074237.547654:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968780, next_transno: 4294968780 00010000:00080000:1.0:1783074237.547659:0:96855:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968780) 00010000:00080000:1.0:1783074237.547670:0:96855:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869685708158848 t4294968780 from 192.168.204.26@tcp req@ffff9523c49c2a00 x1869685708158848/t0(4294968780) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.547690:0:96855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c2a00 x1869685708158848/t0(4294968780) o4->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 1512/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783074237.547758:0:96855:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783074237.547781:0:96855:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6507 MB/s 00000020:00000040:1.0:1783074237.547784:0:96855:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783074237.548170:0:96855:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9523c316b000 : new cb_count 40 00000020:00000040:1.0:1783074237.548174:0:96855:0:(genops.c:889:class_export_get()) GET export ffff9523c316b000 refcount=45 00010000:00000040:1.0:1783074237.548446:0:96855:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968740, transno 4294968780, xid 1869685708158848 00000100:00000040:1.0:1783074237.548457:0:96855:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9524fb578240 refcount 11 to 192.168.204.26@tcp 00000100:00000040:1.0:1783074237.548463:0:96855:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.26@tcp 00000100:00000040:1.0:1783074237.548505:0:96855:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9524fb578240 refcount 10 to 192.168.204.26@tcp 00010000:00080000:1.0:1783074237.548515:0:96855:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783074237.548521:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.548530:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 44 00010000:00080000:1.0:1783074237.548535:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968781 00010000:00080000:1.0:1783074237.548540:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968781 00000100:00000040:1.0:1783074237.551108:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c0380 x1869685708160768 msgsize 328 00000100:00100000:1.0:1783074237.551121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074237.551149:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c49c1f80 x1869685708160896 msgsize 328 00000100:00100000:1.0:1783074237.551155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074237.551174:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524c6ce8a80 x1869685708161024 msgsize 328 00000100:00100000:1.0:1783074237.551179:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074237.551198:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9524c6cebb80 x1869685708161152 msgsize 328 00000100:00100000:1.0:1783074237.551203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:1.0:1783074237.551222:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff9523c557c380 x1869685708161280 msgsize 328 00000100:00100000:1.0:1783074237.551227:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074237.551253:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160768 00000100:00100000:1.0:1783074237.551260:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160768 00000020:00000040:1.0:1783074237.551263:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.551267:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=45 00000100:00100000:1.0:1783074237.551341:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708160896 00000100:00100000:1.0:1783074237.551345:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708160896 00000020:00000040:1.0:1783074237.551348:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.551350:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=46 00000100:00100000:1.0:1783074237.551370:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161024 00000100:00100000:1.0:1783074237.551373:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161024 00000020:00000040:1.0:1783074237.551375:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.551383:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=47 00000100:00100000:1.0:1783074237.551407:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161152 00000100:00100000:1.0:1783074237.551410:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161152 00000020:00000040:1.0:1783074237.551412:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.551414:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=48 00000100:00100000:1.0:1783074237.551433:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161280 00000100:00100000:1.0:1783074237.551436:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161280 00000020:00000040:1.0:1783074237.551438:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:1.0:1783074237.551440:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=49 00000100:00100000:1.0:1783074237.551462:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5021 00000100:00000040:1.0:1783074237.551467:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 1 00000100:00000040:1.0:1783074237.551473:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c0380 x1869685708160768/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551488:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708160768:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783074237.551500:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c0380 x1869685708160768/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783074237.551510:0:8445:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00010000:00080000:1.0:1783074237.551515:0:8445:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9523c49c0380 x1869685708160768/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.551528:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c0380 x1869685708160768/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551538:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708160768:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 52us (429us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.551545:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5021 00000100:00000040:1.0:1783074237.551548:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00000100:00100000:1.0:1783074237.551558:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5022 00000100:00000040:1.0:1783074237.551567:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 2 00000100:00000040:1.0:1783074237.551572:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c49c1f80 x1869685708160896/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551584:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708160896:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783074237.551592:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c49c1f80 x1869685708160896/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783074237.551599:0:8445:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 3 00010000:00080000:1.0:1783074237.551602:0:8445:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9523c49c1f80 x1869685708160896/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.551610:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c49c1f80 x1869685708160896/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551618:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c49c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708160896:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 37us (467us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.551623:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5022 00000100:00000040:1.0:1783074237.551625:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 2 00000100:00100000:1.0:1783074237.551635:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5023 00000100:00000040:1.0:1783074237.551653:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 3 00000100:00000040:1.0:1783074237.551658:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524c6ce8a80 x1869685708161024/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551669:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708161024:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783074237.551677:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524c6ce8a80 x1869685708161024/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783074237.551683:0:8445:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 4 00010000:00080000:1.0:1783074237.551694:0:8445:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524c6ce8a80 x1869685708161024/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.551703:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524c6ce8a80 x1869685708161024/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.551717:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5024 00000100:00100000:1.0:1783074237.551717:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708161024:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 45us (536us total) trans 0 rc 0/-999 00000100:00000040:3.0:1783074237.551724:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 5 00000100:00100000:1.0:1783074237.551729:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5023 00000100:00000040:1.0:1783074237.551734:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 4 00000100:00000040:3.0:1783074237.551735:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524c6cebb80 x1869685708161152/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551751:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5025 00000100:00100000:3.0:1783074237.551754:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708161152:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000100:00000040:1.0:1783074237.551757:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 5 00000100:00000040:1.0:1783074237.551766:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9523c557c380 x1869685708161280/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783074237.551770:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524c6cebb80 x1869685708161152/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551788:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708161280:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783074237.551796:0:8445:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9523c557c380 x1869685708161280/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783074237.551803:0:8445:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 6 00010000:00080000:1.0:1783074237.551807:0:8445:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9523c557c380 x1869685708161280/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783074237.551815:0:8445:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9523c557c380 x1869685708161280/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783074237.551824:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708161280:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 41us (599us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783074237.551831:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5025 00000100:00000040:1.0:1783074237.551839:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 5 00010000:00080000:1.0:1783074237.551884:0:96855:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968781 00010000:00080000:1.0:1783074237.551888:0:96855:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00010000:00000040:1.0:1783074237.551895:0:96855:0:(ldlm_lib.c:2868:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:1.0:1783074237.551898:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.551901:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.551908:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9523c49c0380 x1869685708160768/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783074237.551911:0:8443:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 6 00010000:00080000:3.0:1783074237.551922:0:8443:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524c6cebb80 x1869685708161152/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.551922:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00000040:3.0:1783074237.551939:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524c6cebb80 x1869685708161152/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783074237.551950:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524c6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+49:2401:x1869685708161152:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 202us (749us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783074237.551957:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5024 00000100:00000040:3.0:1783074237.551960:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 5 00000100:00000040:3.0:1783074237.553183:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf0000 x1869685708161408 msgsize 328 00000100:00100000:3.0:1783074237.553197:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00000040:3.0:1783074237.553241:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf1f80 x1869685708161536 msgsize 328 00000100:00100000:3.0:1783074237.553246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1783074237.553264:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161408 00000100:00000040:3.0:1783074237.553269:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9524debf3100 x1869685708161664 msgsize 328 00000100:00100000:2.0:1783074237.553272:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161408 00000100:00100000:3.0:1783074237.553278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000020:00000040:2.0:1783074237.553278:0:26175:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.553284:0:26175:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=50 00000100:00100000:2.0:1783074237.553341:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161536 00000100:00100000:2.0:1783074237.553346:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161536 00000020:00000040:2.0:1783074237.553348:0:26175:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.553351:0:26175:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=51 00000100:00100000:2.0:1783074237.553370:0:26175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161664 00000100:00100000:2.0:1783074237.553380:0:26175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161664 00000020:00000040:2.0:1783074237.553382:0:26175:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5fb609b3016e15ee 00000020:00000040:2.0:1783074237.553384:0:26175:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9523c316b000 refcount=52 00000100:00100000:2.0:1783074237.553411:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5026 00000100:00000040:2.0:1783074237.553415:0:26175:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 6 00000100:00000040:2.0:1783074237.553422:0:26175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf0000 x1869685708161408/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.553436:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:2401:x1869685708161408:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783074237.553447:0:26175:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf0000 x1869685708161408/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783074237.553455:0:26175:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 7 00010000:00080000:2.0:1783074237.553460:0:26175:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524debf0000 x1869685708161408/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.553470:0:26175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf0000 x1869685708161408/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.553480:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:2401:x1869685708161408:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 46us (295us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.553487:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5026 00000100:00000040:2.0:1783074237.553490:0:26175:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 6 00000100:00100000:2.0:1783074237.553499:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5027 00000100:00000040:2.0:1783074237.553501:0:26175:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 7 00000100:00000040:2.0:1783074237.553505:0:26175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf1f80 x1869685708161536/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.553517:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:2401:x1869685708161536:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783074237.553535:0:26175:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf1f80 x1869685708161536/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783074237.553542:0:26175:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 8 00010000:00080000:2.0:1783074237.553546:0:26175:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524debf1f80 x1869685708161536/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.553554:0:26175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf1f80 x1869685708161536/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.553561:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:2401:x1869685708161536:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 47us (319us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.553567:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5027 00000100:00000040:2.0:1783074237.553569:0:26175:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 7 00000100:00100000:2.0:1783074237.553580:0:26175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5028 00000100:00000040:2.0:1783074237.553582:0:26175:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9523c316b000 : new rpc_count 8 00000100:00000040:2.0:1783074237.553586:0:26175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9524debf3100 x1869685708161664/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.553597:0:26175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:2401:x1869685708161664:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783074237.553603:0:26175:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9524debf3100 x1869685708161664/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783074237.553610:0:26175:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9523c316b000 : new rpc_count 9 00010000:00080000:2.0:1783074237.553613:0:26175:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9524debf3100 x1869685708161664/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783074237.553622:0:26175:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9524debf3100 x1869685708161664/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783074237.553656:0:26175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+52:2401:x1869685708161664:12345-192.168.204.26@tcp:101:ldlm_lock_repla.0 Request processed in 60us (384us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783074237.553663:0:26175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5028 00000100:00000040:2.0:1783074237.553665:0:26175:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9523c316b000 : new rpc_count 8 00010000:00000040:1.0:1783074237.557415:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 7 00000020:00000040:1.0:1783074237.557435:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 51 00010000:00080000:1.0:1783074237.557439:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557463:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557475:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9523c49c1f80 x1869685708160896/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557485:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557487:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 6 00000020:00000040:1.0:1783074237.557495:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 50 00010000:00080000:1.0:1783074237.557497:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557499:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557504:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9524c6ce8a80 x1869685708161024/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557511:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557513:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 5 00000020:00000040:1.0:1783074237.557519:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 49 00010000:00080000:1.0:1783074237.557521:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557522:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557526:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9523c557c380 x1869685708161280/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557534:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557543:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 4 00000020:00000040:1.0:1783074237.557552:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 48 00010000:00080000:1.0:1783074237.557555:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557557:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557564:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9524c6cebb80 x1869685708161152/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557571:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557573:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 3 00000020:00000040:1.0:1783074237.557581:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 47 00010000:00080000:1.0:1783074237.557584:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557586:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557592:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9524debf0000 x1869685708161408/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557598:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557600:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 2 00000020:00000040:1.0:1783074237.557606:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 46 00010000:00080000:1.0:1783074237.557608:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557610:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557615:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9524debf1f80 x1869685708161536/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557622:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557624:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 1 00000020:00000040:1.0:1783074237.557629:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 45 00010000:00080000:1.0:1783074237.557631:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783074237.557632:0:96855:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783074237.557636:0:96855:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.26@tcp: req@ffff9524debf3100 x1869685708161664/t0(0) o101->0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b@192.168.204.26@tcp:563/0 lens 328/0 e 0 to 0 dl 1783074248 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783074237.557898:0:96855:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:1.0:1783074237.557900:0:96855:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9523c316b000 : new rpc_count 0 00000020:00000040:1.0:1783074237.557906:0:96855:0:(genops.c:900:class_export_put()) PUTting export ffff9523c316b000 : new refcount 44 00010000:00080000:1.0:1783074237.557914:0:96855:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1783074238.062545:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783074238.156163:0:97196:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1783074238.574845:0:97248:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783074238.575089:0:97248:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1783074238.977831:0:97298:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783074238.978023:0:97298:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783074239.086453:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783074239.406790:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783074239.406813:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723663360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783074239.406880:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074239.406928:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663360 00000100:00100000:0.0:1783074239.406936:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663360 00000100:00100000:0.0:1783074239.407001:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:0.0:1783074239.407012:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723663360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783074239.407064:0:26189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444683776 avail 1298444288 00000100:00100000:0.0:1783074239.407114:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869685723663360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074239.407122:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1783074239.407155:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869685723663360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783074239.407474:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783074239.407485:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723663488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074239.407546:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c557f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723663616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074239.407552:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074239.407580:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074239.407590:0:9041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663488 00000100:00100000:0.0:1783074239.407595:0:9041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663488 00000100:00100000:1.0:1783074239.407639:0:23954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663616 00000100:00100000:0.0:1783074239.407643:0:9041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1783074239.407644:0:23954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663616 00000100:00100000:0.0:1783074239.407652:0:9041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723663488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783074239.407669:0:9041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783074239.407684:0:23954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:1.0:1783074239.407695:0:23954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723663616:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783074239.407701:0:9041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869685723663488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000004:00000024:1.0:1783074239.407719:0:23954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:0.0:1783074239.407739:0:9041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1783074239.407760:0:23954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723663616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00080000:0.0:1783074239.407761:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783074239.407772:0:23954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:0.0:1783074239.407806:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869685723663488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783074239.407817:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c557f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723663616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783074239.919945:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783074239.919968:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723663744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783074239.920031:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074239.920812:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663744 00000100:00100000:0.0:1783074239.920819:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663744 00000100:00080000:1.0:1783074239.920854:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074239.920873:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1783074239.920880:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723663744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783074239.920900:0:8447:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783074239.920945:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723663744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074239.920950:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1783074239.920989:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723663744:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783074240.110396:0:8460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783074240.942555:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723663872:0@lo:400:kworker.0 00000100:00080000:3.0:1783074240.942585:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074240.942592:0:44310:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1783074240.942593:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723664256:0@lo:400:kworker.0 00000100:00080000:3.0:1783074240.942619:0:44310:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783074240.942624:0:44310:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1783074240.942668:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074240.942668:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074240.942681:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723664128:0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.942716:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723664768:0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.942731:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723664384:0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.942739:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074240.942765:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074240.942852:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664384 00000100:00100000:2.0:1783074240.942861:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664384 00000100:00100000:2.0:1783074240.942909:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:2.0:1783074240.942918:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723664384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.943498:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723664640:0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.943622:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074240.943628:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723664896:0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.943640:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074240.943653:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869685723664384:12345-0@lo:400:kworker.0 Request processed in 733us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074240.943664:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:0.0:1783074240.943670:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074240.943671:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664256 00000100:00100000:3.0:1783074240.943679:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723665152:0@lo:400:kworker.0 00000100:00100000:2.0:1783074240.943685:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664768 00000100:00100000:1.0:1783074240.943689:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664256 00000100:00100000:2.0:1783074240.943691:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664768 00000100:00100000:0.0:1783074240.943721:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869685723664384:0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.943723:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074240.943730:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:1.0:1783074240.943735:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664640 00000100:00100000:1.0:1783074240.943740:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664640 00000100:00100000:0.0:1783074240.943746:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783074240.943757:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723664000:0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.943770:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1783074240.943774:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664128 00000100:00100000:3.0:1783074240.943779:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664128 00000100:00100000:1.0:1783074240.943781:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723664256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.943789:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074240.943811:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723664512:0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.943838:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1869685723664256:12345-0@lo:400:kworker.0 Request processed in 59us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074240.943845:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664896 00000100:00100000:0.0:1783074240.943846:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074240.943850:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1783074240.943851:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664896 00000100:00100000:0.0:1783074240.943867:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723665024:0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.943874:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665152 00000100:00100000:1.0:1783074240.943875:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1783074240.943879:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665152 00000100:00100000:1.0:1783074240.943887:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723664640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.943901:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664000 00000100:00100000:3.0:1783074240.943912:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664000 00000100:00100000:0.0:1783074240.943914:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074240.943938:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723664512 00000100:00100000:1.0:1783074240.943938:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723664640:12345-0@lo:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074240.943943:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723664512 00000100:00100000:1.0:1783074240.943949:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:0.0:1783074240.943961:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665024 00000100:00100000:3.0:1783074240.943966:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1783074240.943967:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665024 00000100:00100000:3.0:1783074240.943977:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723664128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.943977:0:94276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723663872 00000100:00100000:1.0:1783074240.943983:0:94276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723663872 00000100:00100000:0.0:1783074240.944020:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1783074240.944021:0:94276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783074240.944026:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869685723664128:12345-0@lo:400:kworker.0 Request processed in 51us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074240.944036:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723664896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.944038:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1783074240.944039:0:94276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723663872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074240.944042:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723664768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.944061:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1783074240.944070:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723665152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074240.944107:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1869685723664768:12345-0@lo:400:kworker.0 Request processed in 70us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074240.944114:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869685723664896:12345-0@lo:400:kworker.0 Request processed in 80us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074240.944117:0:94276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3658:x1869685723663872:12345-0@lo:400:kworker.0 Request processed in 82us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074240.944121:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1783074240.944128:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869685723665152:12345-0@lo:400:kworker.0 Request processed in 58us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074240.944130:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1783074240.944136:0:94276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783074240.944142:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1783074240.944157:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1783074240.944166:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1783074240.944171:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723664000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.944180:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723664512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783074240.944198:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783074240.944204:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00080000:1.0:1783074240.944205:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783074240.944216:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723664000:12345-0@lo:400:kworker.0 Request processed in 50us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074240.944218:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524f092df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723665024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.944229:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1783074240.944233:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723664512:12345-0@lo:400:kworker.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074240.944241:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869685723664768:0@lo:400:kworker.0 00000100:00100000:3.0:1783074240.944242:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1783074240.944265:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869685723664256:0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.944275:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723664000:0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.944289:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723664512:0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.944307:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869685723664128:0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.944308:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723665024:0@lo:400:kworker.0 00000100:00100000:0.0:1783074240.944347:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869685723664896:0@lo:400:kworker.0 00000100:00100000:1.0:1783074240.944351:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723664640:0@lo:400:kworker.0 00000100:00100000:2.0:1783074240.944357:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524f092df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723665024:12345-0@lo:400:kworker.0 Request processed in 143us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074240.944363:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:522b6a34-04f4-4017-ab45-61a21d19bfef:3658:1869685723663872:0@lo:400:kworker.0 00000100:00100000:2.0:1783074240.944373:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1783074240.945077:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869685723665152:0@lo:400:kworker.0 00010000:00010000:3.0:1783074241.134503:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783074241.316961:0:97490:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00000100:00100000:1.0:1783074241.966901:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723665280:0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.966965:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074241.967026:0:94278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665280 00000100:00100000:2.0:1783074241.967035:0:94278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665280 00000100:00080000:0.0:1783074241.967088:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074241.967094:0:85943:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783074241.967107:0:94278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783074241.967107:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9524f092dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723665408:0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.967119:0:94278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723665280:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783074241.967128:0:85943:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783074241.967132:0:85943:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1783074241.967142:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723665664:0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.967150:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783074241.967171:0:94278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:522b6a34-04f4-4017-ab45-61a21d19bfef+24:3661:x1869685723665280:12345-0@lo:400:kworker.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074241.967177:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723665920:0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.967180:0:94278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783074241.967211:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074241.967212:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723665536:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.967213:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074241.967239:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723666432:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.967362:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723666176:0@lo:400:kworker.0 00000100:00100000:0.0:1783074241.967438:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783074241.967466:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074241.967467:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074241.967470:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723666048:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.967506:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783074241.967518:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723665792:0@lo:400:kworker.0 00000100:00100000:0.0:1783074241.967519:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074241.967530:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665408 00000100:00100000:1.0:1783074241.967535:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665408 00000100:00100000:0.0:1783074241.967546:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723666560:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.967576:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074241.967580:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665920 00000100:00100000:1.0:1783074241.967585:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665920 00000100:00100000:0.0:1783074241.967596:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783074241.967604:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665536 00000100:00100000:1.0:1783074241.967608:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665536 00000100:00100000:3.0:1783074241.967612:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723666304:0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.967626:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723666432 00000100:00100000:1.0:1783074241.967630:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723666432 00000100:00100000:1.0:1783074241.967644:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723666560 00000100:00100000:1.0:1783074241.967649:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723666560 00000100:00100000:3.0:1783074241.967652:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783074241.967652:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723666176 00000100:00100000:0.0:1783074241.967659:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723666176 00000100:00100000:1.0:1783074241.967667:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723666304 00000100:00100000:1.0:1783074241.967672:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723666304 00000100:00100000:1.0:1783074241.967698:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1783074241.967705:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723665408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.967706:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665664 00000100:00100000:0.0:1783074241.967707:0:26174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723665792 00000100:00100000:0.0:1783074241.967714:0:26174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665792 00000100:00100000:3.0:1783074241.967715:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723665664 00000100:00100000:0.0:1783074241.967756:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:3.0:1783074241.967759:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685723666048 00000100:00100000:3.0:1783074241.967764:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685723666048 00000100:00100000:1.0:1783074241.967771:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869685723665408:12345-0@lo:400:kworker.0 Request processed in 61us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074241.967771:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723666176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.967772:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1783074241.967783:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723665920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.967784:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:3.0:1783074241.967796:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1783074241.967805:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1783074241.967807:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723665664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.968023:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723665536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.968428:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869685723665920:12345-0@lo:400:kworker.0 Request processed in 646us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074241.968434:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1783074241.968449:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:2.0:1783074241.968454:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c557ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723666432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.968476:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c557ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869685723666432:12345-0@lo:400:kworker.0 Request processed in 22us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074241.968481:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:2.0:1783074241.968489:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1783074241.968493:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524debf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723666560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.968516:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524debf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869685723666560:12345-0@lo:400:kworker.0 Request processed in 23us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074241.968520:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1783074241.968529:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1783074241.968534:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723666304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.968567:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869685723666304:12345-0@lo:400:kworker.0 Request processed in 22us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783074241.968571:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1783074241.968620:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869685723666560:0@lo:400:kworker.0 00000100:00100000:0.0:1783074241.969170:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3660:x1869685723666176:12345-0@lo:400:kworker.0 Request processed in 1403us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074241.969180:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00100000:1.0:1783074241.969186:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869685723665536:12345-0@lo:400:kworker.0 Request processed in 1161us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074241.969194:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1783074241.969207:0:26174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000001:00080000:2.0:1783074241.969210:0:96840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968780 is committed 00000100:00100000:0.0:1783074241.969220:0:26174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723665792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.969227:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:1.0:1783074241.969235:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9523c4af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723666048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783074241.969264:0:26174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1869685723665792:12345-0@lo:400:kworker.0 Request processed in 48us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074241.969272:0:26174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:1.0:1783074241.969278:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9523c4af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869685723666048:12345-0@lo:400:kworker.0 Request processed in 43us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074241.969285:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:0.0:1783074241.969331:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:522b6a34-04f4-4017-ab45-61a21d19bfef:3661:1869685723665280:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.969591:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1869685723665664:12345-0@lo:400:kworker.0 Request processed in 1784us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074241.969601:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1783074241.969658:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723665792:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.969677:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869685723666304:0@lo:400:kworker.0 00000100:00100000:3.0:1783074241.969693:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869685723666176:0@lo:400:kworker.0 00000100:00080000:0.0:1783074241.970240:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783074241.970277:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869685723665536:0@lo:400:kworker.0 00000100:00100000:0.0:1783074241.970288:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869685723666048:0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.970359:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869685723666432:0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.970375:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869685723665920:0@lo:400:kworker.0 00000100:00100000:1.0:1783074241.970386:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9524f092dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869685723665408:0@lo:400:kworker.0 00000100:00100000:2.0:1783074241.972099:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9523c4af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869685723665664:0@lo:400:kworker.0 00000001:02000400:2.0:1783074242.085810:0:97538:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:1.0:1783074242.158810:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783074242.542902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074242.542946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1783074242.542966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1783074242.542978:0:68632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161920 00000100:00100000:0.0:1783074242.542994:0:68632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161920 00000100:00100000:3.0:1783074242.542995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1783074242.542995:0:94277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708161792 00000100:00100000:1.0:1783074242.543000:0:94277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708161792 00000100:00100000:3.0:1783074242.543028:0:66200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708162048 00000100:00100000:3.0:1783074242.543034:0:66200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708162048 00000100:00100000:1.0:1783074242.543050:0:94277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:0.0:1783074242.543050:0:68632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 936 00000100:00100000:1.0:1783074242.543063:0:94277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708161792:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1783074242.543063:0:68632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d232a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+51:2405:x1869685708161920:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074242.543078:0:66200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 937 00000100:00100000:3.0:1783074242.543088:0:66200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2404:x1869685708162048:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1783074242.543148:0:94277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524df2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f1623620-a4b0-4769-84e0-0d08c968afe8+10:2404:x1869685708161792:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 88us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074242.543156:0:94277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:1.0:1783074242.543188:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685708162176 00000100:00100000:1.0:1783074242.543192:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685708162176 00000100:00100000:1.0:1783074242.543218:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2226 00000100:00100000:1.0:1783074242.543224:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9524d2329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708162176:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1783074242.544796:0:66200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+11:2404:x1869685708162048:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1703us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783074242.544816:0:66200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 937 00000100:00100000:1.0:1783074242.544914:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d2329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+7:2405:x1869685708162176:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1687us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783074242.544924:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2226 00000100:00100000:0.0:1783074242.544951:0:68632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9524d232a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5b8e22-486b-46cb-86e0-3d69fe6f7b8b+51:2405:x1869685708161920:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1890us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783074242.544960:0:68632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 936 00000100:00080000:0.0:1783074242.544985:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783074242.544990:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783074242.544993:0:6525:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1783074242.853041:0:97586:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00010000:00010000:1.0:1783074243.182675:0:46245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 59956 lines, 59956 kept, 0 dropped, 0 bad.